-- Logs begin at Wed 2021-12-29 20:10:02 UTC, end at Wed 2021-12-29 21:16:37 UTC. -- Dec 29 20:34:41.299598 dv-cinder-823170-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Dec 29 20:34:41.306635 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Dec 29 20:34:41.312521 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 29 20:34:41 2021] *** Dec 29 20:34:41.312521 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 29 20:34:41.312521 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 29 20:34:41.312521 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: nodename: dv-cinder-823170-1-iscsi Dec 29 20:34:41.312521 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: machine: x86_64 Dec 29 20:34:41.312521 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: clock source: unix Dec 29 20:34:41.312521 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: pcre jit disabled Dec 29 20:34:41.312521 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: detected number of CPU cores: 4 Dec 29 20:34:41.312521 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: current working directory: / Dec 29 20:34:41.312521 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: detected binary path: /usr/bin/uwsgi-core Dec 29 20:34:41.312521 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: your processes number limit is 47680 Dec 29 20:34:41.312521 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: your memory page size is 4096 bytes Dec 29 20:34:41.312521 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: detected max file descriptor number: 2048 Dec 29 20:34:41.312521 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: lock engine: pthread robust mutexes Dec 29 20:34:41.312521 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: thunder lock: enabled Dec 29 20:34:41.312521 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Dec 29 20:34:41.312521 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 29 20:34:41.351654 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: Python main interpreter initialized at 0x563d043969c0 Dec 29 20:34:41.351654 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: python threads support enabled Dec 29 20:34:41.351654 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: your server socket listen backlog is limited to 100 connections Dec 29 20:34:41.351654 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: your mercy for graceful operations on workers is 90 seconds Dec 29 20:34:41.352023 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: mapped 403077 bytes (393 KB) for 2 cores Dec 29 20:34:41.352100 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: *** Operational MODE: preforking *** Dec 29 20:34:41.352319 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: *** uWSGI is running in multiple interpreter mode *** Dec 29 20:34:41.352319 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: spawned uWSGI master process (pid: 66038) Dec 29 20:34:41.352524 dv-cinder-823170-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Dec 29 20:34:41.353623 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: spawned uWSGI worker 1 (pid: 66050, cores: 1) Dec 29 20:34:41.353623 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: spawned uWSGI worker 2 (pid: 66051, cores: 1) Dec 29 20:34:41.353623 dv-cinder-823170-1-iscsi devstack@keystone.service[66038]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 29 20:34:44.125888 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 29 20:34:44.126418 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 29 20:34:44.126418 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] command line args: [] {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 29 20:34:44.126617 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 29 20:34:44.127344 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ================================================================================ {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 29 20:34:44.127577 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 29 20:34:44.128000 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] admin_token = **** {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.128088 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 29 20:34:44.128165 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] config_dir = [] {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.128165 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.128294 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] command line args: [] {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 29 20:34:44.128381 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] config_source = [] {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.128381 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] debug = True {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.128510 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 29 20:34:44.128584 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.128751 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ================================================================================ {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 29 20:34:44.128822 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] admin_token = **** {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.128885 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.129021 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] insecure_debug = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.129104 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] config_dir = [] {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.129213 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.129293 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.129396 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] config_source = [] {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.129496 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.129571 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] debug = True {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.129802 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] list_limit = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.129895 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.129987 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] log_config_append = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.130053 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.130116 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.130178 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] insecure_debug = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.130240 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] log_dir = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.130386 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] log_file = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.130459 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.130614 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.130721 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.130880 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.131009 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] list_limit = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.131098 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] log_config_append = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.131155 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.131216 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.131386 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.131478 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] log_dir = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.131603 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.131679 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] log_file = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.131797 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.131877 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.131997 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.132075 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.132196 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.132275 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.132350 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.132471 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.132546 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.132666 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.132779 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.132856 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.133008 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.133092 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.133252 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.133347 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.133483 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.133592 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] notification_format = cadf {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.133732 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.133851 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.133976 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.134154 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.134274 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.37/identity {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.134391 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] publish_errors = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.134508 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.134625 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.134776 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] notification_format = cadf {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.134901 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.135016 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.135127 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.135237 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.135398 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.37/identity {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.135513 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.135625 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] publish_errors = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.135726 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] standard_threads = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.135835 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.135945 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] strict_password_check = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.136065 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.136176 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.136287 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.136404 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] use_eventlog = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.136404 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] use_journal = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.136627 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.136739 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] use_json = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.136909 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.137023 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] use_stderr = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.137142 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] standard_threads = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.137253 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] use_syslog = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.137370 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] strict_password_check = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.137487 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] watch_log_file = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.137598 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.137709 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.137827 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] use_eventlog = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.137945 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.138056 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] use_journal = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.138168 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.138278 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] use_json = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.138278 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] use_stderr = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.138496 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.138609 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] use_syslog = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.138747 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.138860 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] watch_log_file = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 29 20:34:44.138977 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.139088 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.139211 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.139324 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.139434 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.139544 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.139665 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.139784 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.139903 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.140016 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.140126 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.140243 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.140355 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.140466 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.140594 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.140708 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.140814 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.140923 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.141034 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.141217 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.141332 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.141443 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.141557 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.141667 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.141777 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.141899 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.142011 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.142122 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.142231 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.142984 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.143297 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.143422 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.143533 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.143647 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.143757 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.143757 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.143961 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.144078 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.144190 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.144304 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.144420 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.144529 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.144637 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.144757 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.144872 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.144982 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.145094 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.145208 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.145319 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.145439 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.145551 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.145660 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.145774 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.145884 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.145993 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.146113 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.146224 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.146332 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.146447 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.146558 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.146687 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.146808 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.146918 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.147027 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.147136 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.147244 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.147353 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.147536 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.147649 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.147758 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.147867 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.147976 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.148084 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.148201 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.148312 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.148420 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.148530 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.148640 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.148749 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.148866 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.148977 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.149085 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.149199 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.149315 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.149425 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.149543 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.149654 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.149764 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.149872 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.149980 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.150097 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.150208 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.150317 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.150425 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.150540 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.150702 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.150828 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.150940 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.151055 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.151171 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.151282 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.151390 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] cache.enabled = True {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.151512 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.151624 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.151733 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.151843 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.151843 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.152060 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.152164 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.152263 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.152361 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.152460 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.152560 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.152654 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.152754 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.152878 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] cache.enabled = True {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.152981 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.153082 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.153194 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.153311 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.153431 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.153548 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.153667 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.153777 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.153887 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.153996 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.154104 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.154214 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.154323 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.154432 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.154531 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.154639 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.154784 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.154903 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.155032 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.155143 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.155259 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.155381 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.155492 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.155602 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.155720 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.155836 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.155947 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] auth.external = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.156057 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.156158 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] auth.mapped = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.156265 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.156382 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.156495 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.156604 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.156719 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.156829 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] auth.password = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.156938 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.157056 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] auth.token = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.157167 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.157285 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.157395 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.157510 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] catalog.caching = True {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.157620 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] auth.external = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.157737 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.157849 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] auth.mapped = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.157963 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.158075 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.158185 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.158295 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.158481 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.158595 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] auth.password = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.158766 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.158880 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] auth.token = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.158880 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.159092 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] credential.caching = True {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.159213 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] catalog.caching = True {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.159325 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] credential.driver = sql {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.159435 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.159544 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.159654 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.159763 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.159880 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.159998 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.160117 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.160235 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.160346 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.160506 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.160633 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] credential.caching = True {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.160747 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.160864 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] credential.driver = sql {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.160976 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.161094 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.161208 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.161331 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.161445 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.161579 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.161702 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.161816 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.161928 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.162045 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.162165 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.162281 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.162393 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.162512 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.162631 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.162760 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.162884 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] federation.caching = True {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.162999 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.163110 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.163222 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.163334 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] federation.driver = sql {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.163446 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.163565 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.163565 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.163782 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.163894 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.164007 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.164118 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.164237 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.164352 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.164463 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] federation.caching = True {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.164603 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.164725 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.164840 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.164957 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] federation.driver = sql {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.165069 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.165190 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.165304 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.165418 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.165530 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] identity.caching = True {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.165643 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.165755 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.165875 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.165989 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.166101 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.166214 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.166332 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.166446 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.166566 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.166704 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] identity.driver = sql {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.166820 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.166932 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.167044 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.167157 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.167280 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] identity.caching = True {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.167395 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.167509 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.167621 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.167733 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.167857 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.167978 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.168093 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.168206 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.168318 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.168430 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] identity.driver = sql {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.168551 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.168665 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.168777 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.168889 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.169001 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.169113 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.169233 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.169347 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.169460 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.169572 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.169685 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.169797 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.169916 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.170031 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.170151 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.170265 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.170377 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.170490 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.170609 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.170739 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.170852 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.170964 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.171077 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.171189 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.171313 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.171428 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.171540 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.171652 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.171766 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.171878 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.172065 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.172180 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.172293 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.172405 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.172516 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.172636 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.172762 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.172876 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.173012 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.173126 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.173238 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.173350 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.173471 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.173611 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.173726 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.173839 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.173952 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.password = **** {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.174064 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.174184 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.174184 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.174396 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.174396 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.174605 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.174739 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.174869 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.174985 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.174985 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.175196 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.175308 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.175420 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.175540 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.password = **** {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.175654 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.175766 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.175878 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.175999 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.176112 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.176112 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.176332 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.176332 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.176542 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.176654 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.176766 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.176766 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.176987 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.177099 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.177211 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.177323 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.user = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.177435 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.177556 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.177670 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.177781 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.177901 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.178022 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.178135 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.178255 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.178375 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.178488 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.178600 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.178760 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.178874 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.178999 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.179115 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.user = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.179227 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.179339 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.179451 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.179571 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.179685 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.179797 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.179909 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.180021 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.180134 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.180254 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.180368 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.180480 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.180592 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.180704 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.180816 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.180936 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.181049 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.181163 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.181275 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.181387 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.181498 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.181618 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.181732 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.181844 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.181956 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.182068 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.182181 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.182301 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.182414 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.182546 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.182676 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.182676 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.182889 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.183012 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.183012 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.183226 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.183226 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.183436 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] policy.driver = sql {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.183436 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.183654 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.183768 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.183880 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.183991 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.184103 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.184215 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] receipt.caching = True {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.184335 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.184449 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.184561 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.184673 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.184820 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.184936 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.185056 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.185170 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.185282 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.185395 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.185507 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] policy.driver = sql {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.185627 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] resource.caching = True {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.185751 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.185866 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.185979 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.186091 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] resource.driver = sql {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.186209 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.186328 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.186450 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] receipt.caching = True {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.186564 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.186729 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.186845 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.186958 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.187069 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] revoke.caching = True {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.187191 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.187306 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.187420 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.187532 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.187644 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.187756 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] role.cache_time = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.187875 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] resource.caching = True {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.187989 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] role.caching = True {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.188102 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.188214 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] role.driver = sql {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.188326 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] resource.driver = sql {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.188439 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] role.list_limit = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.188560 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.188680 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.188799 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.188912 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.189025 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.189811 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.189950 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] revoke.caching = True {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.190066 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.190180 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.190292 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.190405 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.190518 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.190641 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] role.cache_time = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.190641 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] role.caching = True {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.190876 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.190876 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.191088 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] role.driver = sql {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.191200 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.191326 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] role.list_limit = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.191441 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.191555 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.191668 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.191782 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.191904 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.192019 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.192131 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.192244 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.192244 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.192464 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.192584 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.192699 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.192804 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.192915 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.193028 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.193140 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.193260 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.193374 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.193487 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.193599 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.193713 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.193826 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.193946 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.194060 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.194173 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.194286 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.194286 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.194497 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.194733 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.194880 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.194996 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.195108 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.195220 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.195364 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.195488 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.195603 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.195715 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.195828 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.195940 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.196052 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.196172 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.196285 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.196398 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.196510 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.196622 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] token.cache_time = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.196734 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.196855 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] token.caching = True {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.196969 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.197081 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.197193 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.197305 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] token.provider = fernet {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.197424 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.197537 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.197649 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.197761 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.197761 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.197972 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.198091 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.198205 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.198317 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.198428 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.198539 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.198667 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.198794 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] trust.driver = sql {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.198909 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] token.cache_time = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.199022 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.199134 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] token.caching = True {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.199492 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.199603 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.199723 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.199837 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] token.provider = fernet {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.199949 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.200061 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.200172 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.200284 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.200403 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.200517 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.200629 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.200741 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.200852 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.200964 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.201084 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] database.connection = **** {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.201197 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.201308 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.201420 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] trust.driver = sql {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.201532 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.201644 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.201763 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.201877 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.201988 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.202101 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.202212 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.202324 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.202442 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.202556 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.202712 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.202828 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.202940 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.203052 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.203177 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.203292 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.203404 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.203516 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] database.connection = **** {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.203628 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.203740 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.203859 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.203972 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.204084 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.204197 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.204309 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.204420 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.204540 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.204653 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.204845 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.205474 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.205588 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.205700 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.205820 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.205820 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 29 20:34:44.206033 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.206033 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.206033 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.206341 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.206459 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.206621 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.206887 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.207135 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.207372 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.207617 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.207855 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 29 20:34:44.208026 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 29 20:34:44.232769 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.232992 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.233220 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.234777 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.235013 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.235241 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.242429 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.244541 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.271424 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.271650 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.272121 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.272357 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.326333 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.327042 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.376346 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.376521 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.378095 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.378330 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.440645 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.440863 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.441079 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.441294 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.441508 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.441595 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.441720 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.441802 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.441986 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.442206 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.442439 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.442640 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.466851 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.467115 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.467220 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.467340 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.467422 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.467554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.467635 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.467763 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.467845 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.467970 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.468051 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.468176 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.468276 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.468472 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.479501 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.479863 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.492745 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.492973 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.493188 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.493272 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.493401 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.493482 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.493608 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.493697 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.493816 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.493897 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.494025 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.494106 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.494246 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.494464 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66050) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 29 20:34:44.511091 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.511292 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 29 20:34:44.511618 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.511742 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.511835 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 29 20:34:44.511953 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 29 20:34:44.512054 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.512282 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.512361 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.512485 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 29 20:34:44.512572 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.512753 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.512832 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.513012 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.513265 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.513516 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.523772 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.524039 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.524297 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.524445 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.524566 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.524717 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.524985 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.525264 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.532495 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=66051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.533367 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=66050) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.535785 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=66051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.536056 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.536328 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.536540 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=66050) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.536620 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.536816 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.536897 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.537093 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.537173 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.537351 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.537437 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.537620 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.537719 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.537875 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.537959 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.538132 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.538218 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.538386 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.538464 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.538646 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.538934 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.539194 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.564536 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.565460 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.566069 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=66051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.566341 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.567037 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=66050) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.567315 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.571417 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=66051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.571798 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.572068 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.572368 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=66050) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.572752 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.573030 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.579287 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=66051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.579557 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.581095 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=66050) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.581369 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.584416 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=66051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.584693 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.584967 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.585240 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.585507 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.585675 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=66050) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.585756 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.586019 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.586229 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.586319 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.586517 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.586820 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.587093 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.587364 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.587626 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.587887 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.604142 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.604407 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.606141 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.606415 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.608755 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=66051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.610824 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=66050) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.612946 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.613230 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.614955 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.615248 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.618017 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=66051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.620065 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=66050) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.621447 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=66051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.623516 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=66050) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.625010 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.625296 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.625579 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.625853 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.626129 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.626437 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.627241 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.627544 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.627828 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.628107 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.628393 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.628666 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.645701 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=66051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.645976 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.646234 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.646488 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.648160 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=66050) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.648442 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.648705 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.648969 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.654029 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.655786 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.656064 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.656562 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.658558 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.658865 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.659168 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=66051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.659438 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.659729 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.659998 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.660262 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.661783 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=66050) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.662060 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.662365 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.662645 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.662942 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.673118 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=66051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.673391 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.674302 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.674581 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.674877 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.675166 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.675439 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.676439 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=66050) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.676712 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.676986 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.677263 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.677538 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.677835 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.678105 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.692636 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=66051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.695688 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=66050) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.696835 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=66051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.700247 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=66050) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.700337 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.701791 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.703371 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=66051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.703454 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.703639 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.703905 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.705567 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.707278 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=66050) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.707560 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.707837 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.779781 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.781346 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=66051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.782862 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.784453 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.784733 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.784833 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=66050) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.785007 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.785290 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.788207 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.788498 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.788779 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.789069 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.794156 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=66051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.794433 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.794740 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.798016 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=66050) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.798305 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.798617 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.802630 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=66051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.802934 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.803230 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.803496 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.803757 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.804023 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.804287 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.804553 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.804814 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.805074 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.805358 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.805617 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.805871 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.806217 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=66051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.806558 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=66050) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 29 20:34:44.806859 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.807160 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.807521 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.807789 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.808061 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.808339 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.808608 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.808874 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.809136 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.809427 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.809690 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.809949 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.810301 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=66050) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 29 20:34:44.844126 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WSGI app 0 (mountpoint='') ready in 3 seconds on interpreter 0x563d043969c0 pid: 66051 (default app) Dec 29 20:34:44.847549 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5097f-a61b-455c-adfb-5b7a853c13a9 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:44.847847 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5097f-a61b-455c-adfb-5b7a853c13a9 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:44.848133 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5097f-a61b-455c-adfb-5b7a853c13a9 None None] PATH_INFO: `/v3` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:44.848295 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WSGI app 0 (mountpoint='') ready in 3 seconds on interpreter 0x563d043969c0 pid: 66050 (default app) Dec 29 20:34:44.852158 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1/1] 10.222.0.37 () {50 vars in 791 bytes} [Wed Dec 29 20:34:44 2021] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:34:50.136461 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36767f-4c50-4ed2-b738-9c960bc4d7a7 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:50.136939 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36767f-4c50-4ed2-b738-9c960bc4d7a7 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:50.137024 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36767f-4c50-4ed2-b738-9c960bc4d7a7 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:50.142176 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1/2] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:34:50 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:34:50.147626 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55d3da-d179-4cc9-bb96-fe4bd3c02cc2 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:50.148034 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55d3da-d179-4cc9-bb96-fe4bd3c02cc2 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:50.148195 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55d3da-d179-4cc9-bb96-fe4bd3c02cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:50.187762 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG oslo_db.sqlalchemy.engines [None req-cd55d3da-d179-4cc9-bb96-fe4bd3c02cc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=66051) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 29 20:34:50.333692 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG passlib.handlers.bcrypt [None req-cd55d3da-d179-4cc9-bb96-fe4bd3c02cc2 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=66051) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:567}} Dec 29 20:34:50.334097 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG passlib.handlers.bcrypt [None req-cd55d3da-d179-4cc9-bb96-fe4bd3c02cc2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=66051) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:382}} Dec 29 20:34:50.394527 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-cd55d3da-d179-4cc9-bb96-fe4bd3c02cc2 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:34:50.396052 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-cd55d3da-d179-4cc9-bb96-fe4bd3c02cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:34:50.497406 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 2/3] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:34:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:34:50.631396 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36767f-4c50-4ed2-b738-9c960bc4d7a7 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:34:50.673974 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG oslo_db.sqlalchemy.engines [None req-ab36767f-4c50-4ed2-b738-9c960bc4d7a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=66050) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 29 20:34:50.770979 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36767f-4c50-4ed2-b738-9c960bc4d7a7 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:34:50.774833 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3d1a8-f297-46d0-9433-93e8b4403e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:34:50.775424 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3d1a8-f297-46d0-9433-93e8b4403e17 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:50.775715 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3d1a8-f297-46d0-9433-93e8b4403e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:50.775999 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3d1a8-f297-46d0-9433-93e8b4403e17 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:50.784583 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3d1a8-f297-46d0-9433-93e8b4403e17 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:34:50.816089 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6ba3d1a8-f297-46d0-9433-93e8b4403e17 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 29 20:34:50.816421 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3d1a8-f297-46d0-9433-93e8b4403e17 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:34:50.825762 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 2/4] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:34:50 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:34:50.831896 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55d3da-d179-4cc9-bb96-fe4bd3c02cc2 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:34:50.842836 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55d3da-d179-4cc9-bb96-fe4bd3c02cc2 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:34:50.846931 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c2ef5-5fd9-483f-8aef-5f6ecec7b859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:34:50.847726 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c2ef5-5fd9-483f-8aef-5f6ecec7b859 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:50.848302 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c2ef5-5fd9-483f-8aef-5f6ecec7b859 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:50.848590 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c2ef5-5fd9-483f-8aef-5f6ecec7b859 admin admin] PATH_INFO: `/v3/projects/9d612e74acbd4ec5ba77fbe2eb639fcf` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:50.849840 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c2ef5-5fd9-483f-8aef-5f6ecec7b859 admin admin] RBAC: Authorizing `identity:get_project(project_id=9d612e74acbd4ec5ba77fbe2eb639fcf)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:34:50.881141 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3d9c2ef5-5fd9-483f-8aef-5f6ecec7b859 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 29 20:34:50.881483 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c2ef5-5fd9-483f-8aef-5f6ecec7b859 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:34:50.885904 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 3/5] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:34:50 2021] GET /identity/v3/projects/9d612e74acbd4ec5ba77fbe2eb639fcf => generated 344 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:34:52.821672 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe2d76-a2d8-4252-95ee-67297ff70515 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:52.822274 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe2d76-a2d8-4252-95ee-67297ff70515 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:52.822274 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe2d76-a2d8-4252-95ee-67297ff70515 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:52.826899 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 3/6] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:34:52 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 29 20:34:52.832309 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb06837-6c82-4d5c-8f80-1e8922c30535 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:52.832716 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb06837-6c82-4d5c-8f80-1e8922c30535 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:52.832885 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb06837-6c82-4d5c-8f80-1e8922c30535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:52.855319 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-0eb06837-6c82-4d5c-8f80-1e8922c30535 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:34:52.856790 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-0eb06837-6c82-4d5c-8f80-1e8922c30535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:34:52.864485 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 4/7] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:34:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:34:52.887040 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe2d76-a2d8-4252-95ee-67297ff70515 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:34:52.898476 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe2d76-a2d8-4252-95ee-67297ff70515 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:34:52.902273 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1686f2-953d-4900-a828-beb57fd3fa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:34:52.902874 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1686f2-953d-4900-a828-beb57fd3fa46 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:52.903193 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1686f2-953d-4900-a828-beb57fd3fa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:52.903482 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1686f2-953d-4900-a828-beb57fd3fa46 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:52.911178 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1686f2-953d-4900-a828-beb57fd3fa46 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:34:52.938559 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1686f2-953d-4900-a828-beb57fd3fa46 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:34:52.947548 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 4/8] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:34:52 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:34:52.953103 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb06837-6c82-4d5c-8f80-1e8922c30535 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:34:52.961667 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb06837-6c82-4d5c-8f80-1e8922c30535 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:34:52.965507 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909732b-6816-45a6-aabd-ccf4b846ce33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:34:52.966287 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909732b-6816-45a6-aabd-ccf4b846ce33 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:52.966575 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909732b-6816-45a6-aabd-ccf4b846ce33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:52.966887 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909732b-6816-45a6-aabd-ccf4b846ce33 admin admin] PATH_INFO: `/v3/users/a36a939159da4f1da66be9e4aad8ddd2` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:52.968100 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909732b-6816-45a6-aabd-ccf4b846ce33 admin admin] RBAC: Authorizing `identity:get_user(user_id=a36a939159da4f1da66be9e4aad8ddd2)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:34:52.996298 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909732b-6816-45a6-aabd-ccf4b846ce33 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:34:52.997713 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 5/9] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:34:52 2021] GET /identity/v3/users/a36a939159da4f1da66be9e4aad8ddd2 => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:34:54.928764 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c7979-adc9-44b9-8579-6a64c00e2dcb None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:54.929266 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c7979-adc9-44b9-8579-6a64c00e2dcb None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:54.929370 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c7979-adc9-44b9-8579-6a64c00e2dcb None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:54.931004 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 5/10] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:34:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:34:54.936026 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb74704-514a-4824-a193-6999d9eba210 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:54.936432 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb74704-514a-4824-a193-6999d9eba210 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:54.936597 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb74704-514a-4824-a193-6999d9eba210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:54.958781 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-1fb74704-514a-4824-a193-6999d9eba210 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:34:54.959901 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-1fb74704-514a-4824-a193-6999d9eba210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:34:54.966378 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 6/11] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:34:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:34:54.988506 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c7979-adc9-44b9-8579-6a64c00e2dcb None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:34:54.999597 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c7979-adc9-44b9-8579-6a64c00e2dcb None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:34:55.003432 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd513c-c170-4ea5-a916-8e1cd127f3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:34:55.004130 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd513c-c170-4ea5-a916-8e1cd127f3aa admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:55.004416 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd513c-c170-4ea5-a916-8e1cd127f3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:55.004707 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd513c-c170-4ea5-a916-8e1cd127f3aa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:55.017577 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd513c-c170-4ea5-a916-8e1cd127f3aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:34:55.023765 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-ffdd513c-c170-4ea5-a916-8e1cd127f3aa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:34:55.024845 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 6/12] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:34:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:34:55.030048 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb74704-514a-4824-a193-6999d9eba210 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:34:55.039177 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb74704-514a-4824-a193-6999d9eba210 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:34:55.043031 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1320616-e740-4c07-9dd3-5d77a04dd6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:34:55.043614 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1320616-e740-4c07-9dd3-5d77a04dd6be admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:55.043904 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1320616-e740-4c07-9dd3-5d77a04dd6be admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:55.044186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1320616-e740-4c07-9dd3-5d77a04dd6be admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:55.044890 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1320616-e740-4c07-9dd3-5d77a04dd6be admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:34:55.045185 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1320616-e740-4c07-9dd3-5d77a04dd6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:34:55.069840 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING py.warnings [None req-f1320616-e740-4c07-9dd3-5d77a04dd6be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:34:55.069840 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: warnings.warn(msg) Dec 29 20:34:55.069840 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: Dec 29 20:34:55.070751 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1320616-e740-4c07-9dd3-5d77a04dd6be admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:34:55.082473 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 7/13] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:34:55 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:34:55.087619 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd513c-c170-4ea5-a916-8e1cd127f3aa admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:34:55.097617 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd513c-c170-4ea5-a916-8e1cd127f3aa admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:34:55.101483 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51ee27-4c7e-47fc-8f38-419861a1dd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:34:55.102254 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51ee27-4c7e-47fc-8f38-419861a1dd55 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:55.102541 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51ee27-4c7e-47fc-8f38-419861a1dd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:55.102929 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51ee27-4c7e-47fc-8f38-419861a1dd55 admin admin] PATH_INFO: `/v3/users/a36a939159da4f1da66be9e4aad8ddd2` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:55.104400 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51ee27-4c7e-47fc-8f38-419861a1dd55 admin admin] RBAC: Authorizing `identity:get_user(user_id=a36a939159da4f1da66be9e4aad8ddd2)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:34:55.129577 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51ee27-4c7e-47fc-8f38-419861a1dd55 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:34:55.130947 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 7/14] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:34:55 2021] GET /identity/v3/users/a36a939159da4f1da66be9e4aad8ddd2 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:34:55.135664 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1320616-e740-4c07-9dd3-5d77a04dd6be admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:34:55.146153 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1320616-e740-4c07-9dd3-5d77a04dd6be admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:34:55.150004 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4bb35-b4bb-42d2-804b-f8534aa402d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:34:55.150738 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4bb35-b4bb-42d2-804b-f8534aa402d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:55.151031 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4bb35-b4bb-42d2-804b-f8534aa402d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:55.151314 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4bb35-b4bb-42d2-804b-f8534aa402d9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:55.152365 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4bb35-b4bb-42d2-804b-f8534aa402d9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:34:55.177794 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4bb35-b4bb-42d2-804b-f8534aa402d9 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:34:55.179210 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 8/15] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:34:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:34:55.184300 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51ee27-4c7e-47fc-8f38-419861a1dd55 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:34:55.193281 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51ee27-4c7e-47fc-8f38-419861a1dd55 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:34:55.197208 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784017aa-f684-46cc-b3dc-e3114ca9bfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:34:55.197764 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784017aa-f684-46cc-b3dc-e3114ca9bfb1 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:55.198051 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784017aa-f684-46cc-b3dc-e3114ca9bfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:55.198328 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784017aa-f684-46cc-b3dc-e3114ca9bfb1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:55.199128 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784017aa-f684-46cc-b3dc-e3114ca9bfb1 admin admin] RBAC: Adding query filter params (role.id=e66e6a94ba014fd193b851ceb92695ae, scope.domain.id=default, user.id=a36a939159da4f1da66be9e4aad8ddd2) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:34:55.199686 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784017aa-f684-46cc-b3dc-e3114ca9bfb1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:34:55.225449 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING py.warnings [None req-784017aa-f684-46cc-b3dc-e3114ca9bfb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:34:55.225449 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: warnings.warn(msg) Dec 29 20:34:55.225449 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: Dec 29 20:34:55.226584 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784017aa-f684-46cc-b3dc-e3114ca9bfb1 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:34:55.233117 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 8/16] 10.222.0.37 () {56 vars in 1343 bytes} [Wed Dec 29 20:34:55 2021] GET /identity/v3/role_assignments?user.id=a36a939159da4f1da66be9e4aad8ddd2&scope.domain.id=default&role.id=e66e6a94ba014fd193b851ceb92695ae => generated 233 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:34:57.154965 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434a406-a796-4cac-90c5-3281aa1eea53 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:57.155468 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434a406-a796-4cac-90c5-3281aa1eea53 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:57.155468 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434a406-a796-4cac-90c5-3281aa1eea53 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:57.157357 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 9/17] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:34:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:34:57.162613 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef3eb3-2342-4c1f-b70b-bc769b3a465a None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:57.163063 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef3eb3-2342-4c1f-b70b-bc769b3a465a None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:57.163213 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef3eb3-2342-4c1f-b70b-bc769b3a465a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:57.197363 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG passlib.handlers.bcrypt [None req-f4ef3eb3-2342-4c1f-b70b-bc769b3a465a None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=66050) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:567}} Dec 29 20:34:57.197776 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG passlib.handlers.bcrypt [None req-f4ef3eb3-2342-4c1f-b70b-bc769b3a465a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=66050) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:382}} Dec 29 20:34:57.243853 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-f4ef3eb3-2342-4c1f-b70b-bc769b3a465a None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:34:57.245366 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-f4ef3eb3-2342-4c1f-b70b-bc769b3a465a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:34:57.252813 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 9/18] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:34:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:34:57.274523 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434a406-a796-4cac-90c5-3281aa1eea53 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:34:57.285986 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434a406-a796-4cac-90c5-3281aa1eea53 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:34:57.289852 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fffb4e-e41b-4311-a2f9-f73136388ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:34:57.290565 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fffb4e-e41b-4311-a2f9-f73136388ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:57.290885 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fffb4e-e41b-4311-a2f9-f73136388ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:57.291174 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fffb4e-e41b-4311-a2f9-f73136388ae7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:57.302731 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fffb4e-e41b-4311-a2f9-f73136388ae7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:34:57.309005 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-91fffb4e-e41b-4311-a2f9-f73136388ae7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:34:57.310083 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 10/19] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:34:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:34:57.315928 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef3eb3-2342-4c1f-b70b-bc769b3a465a None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:34:57.324284 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef3eb3-2342-4c1f-b70b-bc769b3a465a None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:34:57.328462 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdaab1-1d37-4add-9f55-be0e7b0ad7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:34:57.329040 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdaab1-1d37-4add-9f55-be0e7b0ad7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:57.329327 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdaab1-1d37-4add-9f55-be0e7b0ad7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:57.329616 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdaab1-1d37-4add-9f55-be0e7b0ad7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:57.330315 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdaab1-1d37-4add-9f55-be0e7b0ad7b1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:34:57.330605 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdaab1-1d37-4add-9f55-be0e7b0ad7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:34:57.354794 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING py.warnings [None req-e0fdaab1-1d37-4add-9f55-be0e7b0ad7b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:34:57.354794 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: warnings.warn(msg) Dec 29 20:34:57.354794 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: Dec 29 20:34:57.355684 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdaab1-1d37-4add-9f55-be0e7b0ad7b1 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:34:57.365462 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 10/20] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:34:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:34:57.370686 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fffb4e-e41b-4311-a2f9-f73136388ae7 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:34:57.381240 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fffb4e-e41b-4311-a2f9-f73136388ae7 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:34:57.385189 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd42a9a-0fea-43a1-9a15-ab8e467e07f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:34:57.385967 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd42a9a-0fea-43a1-9a15-ab8e467e07f6 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:57.386261 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd42a9a-0fea-43a1-9a15-ab8e467e07f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:57.386544 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd42a9a-0fea-43a1-9a15-ab8e467e07f6 admin admin] PATH_INFO: `/v3/users/a36a939159da4f1da66be9e4aad8ddd2` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:57.387704 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd42a9a-0fea-43a1-9a15-ab8e467e07f6 admin admin] RBAC: Authorizing `identity:get_user(user_id=a36a939159da4f1da66be9e4aad8ddd2)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:34:57.413089 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd42a9a-0fea-43a1-9a15-ab8e467e07f6 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:34:57.414458 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 11/21] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:34:57 2021] GET /identity/v3/users/a36a939159da4f1da66be9e4aad8ddd2 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:34:57.419238 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdaab1-1d37-4add-9f55-be0e7b0ad7b1 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:34:57.428724 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdaab1-1d37-4add-9f55-be0e7b0ad7b1 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:34:57.432565 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f2560-40cf-4160-a8e8-74412377bc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:34:57.433254 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f2560-40cf-4160-a8e8-74412377bc22 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:57.433540 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f2560-40cf-4160-a8e8-74412377bc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:57.433816 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f2560-40cf-4160-a8e8-74412377bc22 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:57.434898 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f2560-40cf-4160-a8e8-74412377bc22 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:34:57.460725 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f2560-40cf-4160-a8e8-74412377bc22 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:34:57.462099 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 11/22] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:34:57 2021] GET /identity/v3/domains/default => generated 199 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:34:57.467113 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd42a9a-0fea-43a1-9a15-ab8e467e07f6 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:34:57.476809 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd42a9a-0fea-43a1-9a15-ab8e467e07f6 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:34:57.480711 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2ff22-63d7-4e6e-8c29-f473bef5998e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:34:57.481480 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2ff22-63d7-4e6e-8c29-f473bef5998e admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:57.481771 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2ff22-63d7-4e6e-8c29-f473bef5998e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:57.482055 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2ff22-63d7-4e6e-8c29-f473bef5998e admin admin] PATH_INFO: `/v3/domains/default/users/a36a939159da4f1da66be9e4aad8ddd2/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:57.483858 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2ff22-63d7-4e6e-8c29-f473bef5998e admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a36a939159da4f1da66be9e4aad8ddd2, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:34:57.508449 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING py.warnings [None req-bba2ff22-63d7-4e6e-8c29-f473bef5998e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:34:57.508449 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: warnings.warn(msg) Dec 29 20:34:57.508449 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: Dec 29 20:34:57.510391 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2ff22-63d7-4e6e-8c29-f473bef5998e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:34:57.703342 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 12/23] 10.222.0.37 () {58 vars in 1382 bytes} [Wed Dec 29 20:34:57 2021] PUT /identity/v3/domains/default/users/a36a939159da4f1da66be9e4aad8ddd2/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:34:59.639253 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751cd9b-4581-4e78-a0e5-ffcd7cd2f252 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:59.639767 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751cd9b-4581-4e78-a0e5-ffcd7cd2f252 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:59.639849 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751cd9b-4581-4e78-a0e5-ffcd7cd2f252 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:59.641468 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 12/24] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:34:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:34:59.648088 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bd979-4e54-431b-9ced-4886f30a9233 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:59.648482 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bd979-4e54-431b-9ced-4886f30a9233 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:59.648701 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bd979-4e54-431b-9ced-4886f30a9233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:59.672329 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-1c2bd979-4e54-431b-9ced-4886f30a9233 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:34:59.674025 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-1c2bd979-4e54-431b-9ced-4886f30a9233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:34:59.739413 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 13/25] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:34:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:34:59.761652 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751cd9b-4581-4e78-a0e5-ffcd7cd2f252 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:34:59.773822 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751cd9b-4581-4e78-a0e5-ffcd7cd2f252 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:34:59.777555 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602c083-3366-4a95-b66b-aec68fa9352a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:34:59.778261 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602c083-3366-4a95-b66b-aec68fa9352a admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:59.778551 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602c083-3366-4a95-b66b-aec68fa9352a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:59.778870 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602c083-3366-4a95-b66b-aec68fa9352a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:59.790473 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602c083-3366-4a95-b66b-aec68fa9352a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:34:59.796681 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-a602c083-3366-4a95-b66b-aec68fa9352a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:34:59.797744 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 13/26] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:34:59 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:34:59.803023 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bd979-4e54-431b-9ced-4886f30a9233 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:34:59.811429 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bd979-4e54-431b-9ced-4886f30a9233 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:34:59.816009 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ee5c2-269a-4f88-9b48-8133c55daf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:34:59.816588 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ee5c2-269a-4f88-9b48-8133c55daf07 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:59.816880 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ee5c2-269a-4f88-9b48-8133c55daf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:59.817161 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ee5c2-269a-4f88-9b48-8133c55daf07 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:59.817868 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ee5c2-269a-4f88-9b48-8133c55daf07 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:34:59.818165 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ee5c2-269a-4f88-9b48-8133c55daf07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:34:59.844130 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ee5c2-269a-4f88-9b48-8133c55daf07 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:34:59.855541 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 14/27] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:34:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:34:59.860911 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602c083-3366-4a95-b66b-aec68fa9352a admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:34:59.870355 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602c083-3366-4a95-b66b-aec68fa9352a admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:34:59.874369 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5b9de-b1ee-42a8-8d3a-c29cb2714d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:34:59.875186 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5b9de-b1ee-42a8-8d3a-c29cb2714d6f admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:59.875483 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5b9de-b1ee-42a8-8d3a-c29cb2714d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:59.875768 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5b9de-b1ee-42a8-8d3a-c29cb2714d6f admin admin] PATH_INFO: `/v3/users/a36a939159da4f1da66be9e4aad8ddd2` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:59.877628 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5b9de-b1ee-42a8-8d3a-c29cb2714d6f admin admin] RBAC: Authorizing `identity:get_user(user_id=a36a939159da4f1da66be9e4aad8ddd2)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:34:59.903848 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5b9de-b1ee-42a8-8d3a-c29cb2714d6f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:34:59.905237 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 14/28] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:34:59 2021] GET /identity/v3/users/a36a939159da4f1da66be9e4aad8ddd2 => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:34:59.910440 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ee5c2-269a-4f88-9b48-8133c55daf07 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:34:59.919631 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ee5c2-269a-4f88-9b48-8133c55daf07 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:34:59.923560 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d69c73-d4b9-4f8e-b4fe-8398ed58e552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:34:59.924269 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d69c73-d4b9-4f8e-b4fe-8398ed58e552 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:59.924561 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d69c73-d4b9-4f8e-b4fe-8398ed58e552 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:59.924844 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d69c73-d4b9-4f8e-b4fe-8398ed58e552 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:59.926072 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d69c73-d4b9-4f8e-b4fe-8398ed58e552 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:34:59.951927 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d69c73-d4b9-4f8e-b4fe-8398ed58e552 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:34:59.953356 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 15/29] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:34:59 2021] GET /identity/v3/domains/default => generated 199 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:34:59.959028 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5b9de-b1ee-42a8-8d3a-c29cb2714d6f admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:34:59.967991 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5b9de-b1ee-42a8-8d3a-c29cb2714d6f admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:34:59.972055 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe360e-69a0-43ce-97ad-66b27b11816b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:34:59.972610 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe360e-69a0-43ce-97ad-66b27b11816b admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:34:59.972899 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe360e-69a0-43ce-97ad-66b27b11816b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:34:59.973179 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe360e-69a0-43ce-97ad-66b27b11816b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:34:59.973941 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe360e-69a0-43ce-97ad-66b27b11816b admin admin] RBAC: Adding query filter params (role.id=e66e6a94ba014fd193b851ceb92695ae, scope.domain.id=default, user.id=a36a939159da4f1da66be9e4aad8ddd2) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:34:59.974241 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe360e-69a0-43ce-97ad-66b27b11816b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:34:59.999471 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe360e-69a0-43ce-97ad-66b27b11816b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:00.005524 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 15/30] 10.222.0.37 () {56 vars in 1343 bytes} [Wed Dec 29 20:34:59 2021] GET /identity/v3/role_assignments?user.id=a36a939159da4f1da66be9e4aad8ddd2&scope.domain.id=default&role.id=e66e6a94ba014fd193b851ceb92695ae => generated 530 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:35:01.947151 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312e96f-8714-44d3-bb93-1dbc1a5413d5 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:01.947627 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312e96f-8714-44d3-bb93-1dbc1a5413d5 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:01.947726 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312e96f-8714-44d3-bb93-1dbc1a5413d5 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:01.949389 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 16/31] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:35:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:35:01.954797 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad7c0e-b85b-4e30-b358-0ef3e19e762f None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:01.955159 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad7c0e-b85b-4e30-b358-0ef3e19e762f None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:01.955376 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad7c0e-b85b-4e30-b358-0ef3e19e762f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:01.977929 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-66ad7c0e-b85b-4e30-b358-0ef3e19e762f None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:35:01.979109 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-66ad7c0e-b85b-4e30-b358-0ef3e19e762f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:35:01.985645 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 16/32] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:35:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:35:02.006564 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312e96f-8714-44d3-bb93-1dbc1a5413d5 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:02.018371 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312e96f-8714-44d3-bb93-1dbc1a5413d5 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:02.022131 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ee462-59d3-41a2-9c38-1051c36894fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:02.022717 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ee462-59d3-41a2-9c38-1051c36894fe admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:02.023009 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ee462-59d3-41a2-9c38-1051c36894fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:02.023293 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ee462-59d3-41a2-9c38-1051c36894fe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:02.030700 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ee462-59d3-41a2-9c38-1051c36894fe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:02.056959 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ee462-59d3-41a2-9c38-1051c36894fe admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:02.065235 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 17/33] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:35:02 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:35:02.070410 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad7c0e-b85b-4e30-b358-0ef3e19e762f None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:02.079104 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad7c0e-b85b-4e30-b358-0ef3e19e762f None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:02.083095 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06760e23-1f42-4746-ad95-774db2d8b20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:02.083802 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06760e23-1f42-4746-ad95-774db2d8b20d admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:02.084093 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06760e23-1f42-4746-ad95-774db2d8b20d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:02.084376 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06760e23-1f42-4746-ad95-774db2d8b20d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:02.085440 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06760e23-1f42-4746-ad95-774db2d8b20d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:02.111594 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06760e23-1f42-4746-ad95-774db2d8b20d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:02.113050 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 17/34] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:35:02 2021] GET /identity/v3/domains/default => generated 199 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:04.040420 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9501b73-bc37-4b1d-8803-150c0b8acbe3 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:04.040918 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9501b73-bc37-4b1d-8803-150c0b8acbe3 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:04.040998 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9501b73-bc37-4b1d-8803-150c0b8acbe3 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:04.042645 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 18/35] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:35:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:35:04.047578 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b75187-b990-43af-9441-c99c9f08b9a5 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:04.047941 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b75187-b990-43af-9441-c99c9f08b9a5 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:04.048660 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b75187-b990-43af-9441-c99c9f08b9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:04.071280 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-b7b75187-b990-43af-9441-c99c9f08b9a5 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:35:04.072444 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-b7b75187-b990-43af-9441-c99c9f08b9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:35:04.079278 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 18/36] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:35:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:35:04.100869 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9501b73-bc37-4b1d-8803-150c0b8acbe3 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:04.112777 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9501b73-bc37-4b1d-8803-150c0b8acbe3 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:04.116447 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db81b9-b041-40e8-ac2c-9466b833d7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:04.117143 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db81b9-b041-40e8-ac2c-9466b833d7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:04.117433 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db81b9-b041-40e8-ac2c-9466b833d7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:04.117716 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db81b9-b041-40e8-ac2c-9466b833d7e8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:04.129959 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db81b9-b041-40e8-ac2c-9466b833d7e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:04.154796 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db81b9-b041-40e8-ac2c-9466b833d7e8 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:04.170932 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-39db81b9-b041-40e8-ac2c-9466b833d7e8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:35:04.171974 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 19/37] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:35:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:35:04.177886 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b75187-b990-43af-9441-c99c9f08b9a5 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:04.186374 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b75187-b990-43af-9441-c99c9f08b9a5 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:04.190937 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925907df-e189-4ccf-8219-adf8b34641cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:04.191518 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925907df-e189-4ccf-8219-adf8b34641cf admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:04.191810 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925907df-e189-4ccf-8219-adf8b34641cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:04.192095 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925907df-e189-4ccf-8219-adf8b34641cf admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:04.192781 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925907df-e189-4ccf-8219-adf8b34641cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:04.193079 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925907df-e189-4ccf-8219-adf8b34641cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:04.217654 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING py.warnings [None req-925907df-e189-4ccf-8219-adf8b34641cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:35:04.217654 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: warnings.warn(msg) Dec 29 20:35:04.217654 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: Dec 29 20:35:04.218549 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925907df-e189-4ccf-8219-adf8b34641cf admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:04.234404 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 19/38] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:35:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:04.240588 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db81b9-b041-40e8-ac2c-9466b833d7e8 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:04.249703 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db81b9-b041-40e8-ac2c-9466b833d7e8 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:04.253898 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c8e30-de03-4029-ae1a-dd0bc760d98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:04.254477 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c8e30-de03-4029-ae1a-dd0bc760d98a admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:04.254809 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c8e30-de03-4029-ae1a-dd0bc760d98a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:04.255099 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c8e30-de03-4029-ae1a-dd0bc760d98a admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:04.255756 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c8e30-de03-4029-ae1a-dd0bc760d98a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:04.280180 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING py.warnings [None req-b85c8e30-de03-4029-ae1a-dd0bc760d98a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:35:04.280180 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: warnings.warn(msg) Dec 29 20:35:04.280180 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: Dec 29 20:35:04.281398 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c8e30-de03-4029-ae1a-dd0bc760d98a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:04.309864 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 20/39] 10.222.0.37 () {60 vars in 1162 bytes} [Wed Dec 29 20:35:04 2021] POST /identity/v3/projects => generated 301 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:35:06.253954 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f74e2-78ca-4084-879e-f3f5f729a5f1 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:06.254437 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f74e2-78ca-4084-879e-f3f5f729a5f1 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:06.254437 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f74e2-78ca-4084-879e-f3f5f729a5f1 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:06.256114 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 20/40] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:35:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:35:06.261107 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead25cc-ee69-4c9d-951c-802f39604af9 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:06.261513 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead25cc-ee69-4c9d-951c-802f39604af9 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:06.261694 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead25cc-ee69-4c9d-951c-802f39604af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:06.284628 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-eead25cc-ee69-4c9d-951c-802f39604af9 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:35:06.285773 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-eead25cc-ee69-4c9d-951c-802f39604af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:35:06.348668 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 21/41] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:35:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:35:06.370185 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f74e2-78ca-4084-879e-f3f5f729a5f1 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:06.381682 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f74e2-78ca-4084-879e-f3f5f729a5f1 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:06.385499 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80258dc-49fb-4950-bb20-b0f197ce7408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:06.386076 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80258dc-49fb-4950-bb20-b0f197ce7408 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:06.386368 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80258dc-49fb-4950-bb20-b0f197ce7408 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:06.386678 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80258dc-49fb-4950-bb20-b0f197ce7408 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:06.387369 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80258dc-49fb-4950-bb20-b0f197ce7408 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:06.418191 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING py.warnings [None req-b80258dc-49fb-4950-bb20-b0f197ce7408 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:35:06.418191 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: warnings.warn(msg) Dec 29 20:35:06.418191 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: Dec 29 20:35:06.419116 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80258dc-49fb-4950-bb20-b0f197ce7408 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:06.617988 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 21/42] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:35:06 2021] POST /identity/v3/roles => generated 219 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:35:08.556717 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42aa04-91cd-4d83-8c30-2cb5f02c13c8 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:08.557232 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42aa04-91cd-4d83-8c30-2cb5f02c13c8 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:08.557317 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42aa04-91cd-4d83-8c30-2cb5f02c13c8 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:08.559013 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 22/43] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:35:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:35:08.565141 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009e325-a1b9-4877-a92f-c8a063f32c47 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:08.565547 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009e325-a1b9-4877-a92f-c8a063f32c47 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:08.565711 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009e325-a1b9-4877-a92f-c8a063f32c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:08.588409 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-6009e325-a1b9-4877-a92f-c8a063f32c47 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:35:08.589862 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-6009e325-a1b9-4877-a92f-c8a063f32c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:35:08.596868 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 22/44] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:35:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:35:08.618714 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42aa04-91cd-4d83-8c30-2cb5f02c13c8 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:08.630170 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42aa04-91cd-4d83-8c30-2cb5f02c13c8 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:08.633987 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732e7ac-e97d-40c0-9b64-b6d4437163c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:08.634567 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732e7ac-e97d-40c0-9b64-b6d4437163c3 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:08.634889 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732e7ac-e97d-40c0-9b64-b6d4437163c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:08.635181 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732e7ac-e97d-40c0-9b64-b6d4437163c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:08.635885 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732e7ac-e97d-40c0-9b64-b6d4437163c3 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:08.661690 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING py.warnings [None req-f732e7ac-e97d-40c0-9b64-b6d4437163c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:35:08.661690 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: warnings.warn(msg) Dec 29 20:35:08.661690 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: Dec 29 20:35:08.662605 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732e7ac-e97d-40c0-9b64-b6d4437163c3 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:08.675553 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 23/45] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:35:08 2021] POST /identity/v3/roles => generated 225 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:35:10.610958 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7372b5-8a70-4ea2-830d-69d53b3de0e8 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:10.611648 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7372b5-8a70-4ea2-830d-69d53b3de0e8 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:10.611777 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7372b5-8a70-4ea2-830d-69d53b3de0e8 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:10.613487 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 23/46] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:35:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:35:10.618706 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bad811-34ec-4318-aa14-9136d4e5d548 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:10.619113 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bad811-34ec-4318-aa14-9136d4e5d548 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:10.619286 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bad811-34ec-4318-aa14-9136d4e5d548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:10.641916 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-48bad811-34ec-4318-aa14-9136d4e5d548 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:35:10.643073 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-48bad811-34ec-4318-aa14-9136d4e5d548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:35:10.649639 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 24/47] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:35:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:35:10.671370 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7372b5-8a70-4ea2-830d-69d53b3de0e8 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:10.683463 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7372b5-8a70-4ea2-830d-69d53b3de0e8 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:10.687245 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db8d4a-9759-4d03-a5cf-c9714592fc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:10.687822 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db8d4a-9759-4d03-a5cf-c9714592fc55 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:10.688112 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db8d4a-9759-4d03-a5cf-c9714592fc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:10.688393 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db8d4a-9759-4d03-a5cf-c9714592fc55 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:10.689767 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db8d4a-9759-4d03-a5cf-c9714592fc55 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:10.715303 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db8d4a-9759-4d03-a5cf-c9714592fc55 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:10.727463 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 24/48] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:35:10 2021] POST /identity/v3/roles => generated 223 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:35:12.678553 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0aa7a6-cffe-45bd-8c8c-a4019e254dfa None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:12.679092 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0aa7a6-cffe-45bd-8c8c-a4019e254dfa None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:12.679196 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0aa7a6-cffe-45bd-8c8c-a4019e254dfa None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:12.680836 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 25/49] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:35:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:35:12.685883 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a8d92-4bd3-45d9-b804-dc7b95341234 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:12.686247 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a8d92-4bd3-45d9-b804-dc7b95341234 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:12.686456 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a8d92-4bd3-45d9-b804-dc7b95341234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:12.709752 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-b40a8d92-4bd3-45d9-b804-dc7b95341234 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:35:12.710903 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-b40a8d92-4bd3-45d9-b804-dc7b95341234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:35:12.717420 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 25/50] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:35:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:35:12.738876 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0aa7a6-cffe-45bd-8c8c-a4019e254dfa None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:12.750292 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0aa7a6-cffe-45bd-8c8c-a4019e254dfa None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:12.754576 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6c954-13b4-4da0-a6c5-a65532b4c461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:12.755323 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6c954-13b4-4da0-a6c5-a65532b4c461 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:12.755621 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6c954-13b4-4da0-a6c5-a65532b4c461 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:12.755913 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6c954-13b4-4da0-a6c5-a65532b4c461 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:12.756989 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6c954-13b4-4da0-a6c5-a65532b4c461 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:12.782897 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6c954-13b4-4da0-a6c5-a65532b4c461 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:12.784363 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 26/51] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:35:12 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:12.789372 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a8d92-4bd3-45d9-b804-dc7b95341234 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:12.797764 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a8d92-4bd3-45d9-b804-dc7b95341234 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:12.801852 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1d7ba-9b82-4e0c-abae-d5640b49faa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:12.802425 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1d7ba-9b82-4e0c-abae-d5640b49faa7 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:12.802748 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1d7ba-9b82-4e0c-abae-d5640b49faa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:12.803032 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1d7ba-9b82-4e0c-abae-d5640b49faa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:12.803844 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1d7ba-9b82-4e0c-abae-d5640b49faa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:12.828877 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING py.warnings [None req-f1f1d7ba-9b82-4e0c-abae-d5640b49faa7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:35:12.828877 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: warnings.warn(msg) Dec 29 20:35:12.828877 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: Dec 29 20:35:12.830606 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1d7ba-9b82-4e0c-abae-d5640b49faa7 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:12.858806 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 26/52] 10.222.0.37 () {60 vars in 1162 bytes} [Wed Dec 29 20:35:12 2021] POST /identity/v3/projects => generated 312 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:35:14.816740 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60941baa-a8f9-4c75-af61-b908a7861ede None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:14.817248 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60941baa-a8f9-4c75-af61-b908a7861ede None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:14.817332 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60941baa-a8f9-4c75-af61-b908a7861ede None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:14.819031 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 27/53] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:35:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:35:14.824137 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f61da8-0fb0-464e-8138-2005d1d870ad None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:14.824529 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f61da8-0fb0-464e-8138-2005d1d870ad None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:14.825103 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f61da8-0fb0-464e-8138-2005d1d870ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:14.847157 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-17f61da8-0fb0-464e-8138-2005d1d870ad None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:35:14.848279 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-17f61da8-0fb0-464e-8138-2005d1d870ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:35:14.912858 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 27/54] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:35:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:35:14.935126 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60941baa-a8f9-4c75-af61-b908a7861ede None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:14.946446 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60941baa-a8f9-4c75-af61-b908a7861ede None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:14.950414 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98643c-73a1-4820-8e92-715aca6ae654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:14.951151 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98643c-73a1-4820-8e92-715aca6ae654 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:14.951445 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98643c-73a1-4820-8e92-715aca6ae654 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:14.951732 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98643c-73a1-4820-8e92-715aca6ae654 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:14.952774 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98643c-73a1-4820-8e92-715aca6ae654 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:14.978232 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98643c-73a1-4820-8e92-715aca6ae654 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:14.979674 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 28/55] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:35:14 2021] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:14.984733 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f61da8-0fb0-464e-8138-2005d1d870ad None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:14.993730 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f61da8-0fb0-464e-8138-2005d1d870ad None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:14.997868 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b2bbc-21a9-41fd-b794-60aafee27ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:14.998445 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b2bbc-21a9-41fd-b794-60aafee27ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:14.998771 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b2bbc-21a9-41fd-b794-60aafee27ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:14.999057 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b2bbc-21a9-41fd-b794-60aafee27ef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:14.999712 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b2bbc-21a9-41fd-b794-60aafee27ef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:15.025166 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b2bbc-21a9-41fd-b794-60aafee27ef5 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:15.051798 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 28/56] 10.222.0.37 () {60 vars in 1161 bytes} [Wed Dec 29 20:35:14 2021] POST /identity/v3/projects => generated 298 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:35:16.992613 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386e193-d916-4ef1-8b73-ebc74300ed1b None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:16.993109 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386e193-d916-4ef1-8b73-ebc74300ed1b None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:16.993194 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386e193-d916-4ef1-8b73-ebc74300ed1b None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:16.994867 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 29/57] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:35:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:35:16.999792 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93c9a5-1491-4e95-b871-2a5496391c76 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:17.000204 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93c9a5-1491-4e95-b871-2a5496391c76 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:17.000377 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93c9a5-1491-4e95-b871-2a5496391c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:17.023240 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-6a93c9a5-1491-4e95-b871-2a5496391c76 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:35:17.024377 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-6a93c9a5-1491-4e95-b871-2a5496391c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:35:17.086873 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 29/58] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:35:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:35:17.109748 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386e193-d916-4ef1-8b73-ebc74300ed1b None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:17.121215 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386e193-d916-4ef1-8b73-ebc74300ed1b None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:17.124920 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f25d17-8f37-4d6d-a62f-ffc83eaacdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:17.125628 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f25d17-8f37-4d6d-a62f-ffc83eaacdc4 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:17.126425 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f25d17-8f37-4d6d-a62f-ffc83eaacdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:17.126744 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f25d17-8f37-4d6d-a62f-ffc83eaacdc4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:17.127813 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f25d17-8f37-4d6d-a62f-ffc83eaacdc4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:17.153249 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f25d17-8f37-4d6d-a62f-ffc83eaacdc4 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:17.154697 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 30/59] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:35:17 2021] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:17.159994 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93c9a5-1491-4e95-b871-2a5496391c76 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:17.168460 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93c9a5-1491-4e95-b871-2a5496391c76 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:17.172412 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4637b4b-8700-4c8c-9d30-5f1ca98489e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:17.173124 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4637b4b-8700-4c8c-9d30-5f1ca98489e0 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:17.173424 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4637b4b-8700-4c8c-9d30-5f1ca98489e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:17.173813 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4637b4b-8700-4c8c-9d30-5f1ca98489e0 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:17.174474 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4637b4b-8700-4c8c-9d30-5f1ca98489e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:17.199501 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING py.warnings [None req-e4637b4b-8700-4c8c-9d30-5f1ca98489e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:35:17.199501 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: warnings.warn(msg) Dec 29 20:35:17.199501 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: Dec 29 20:35:17.201041 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4637b4b-8700-4c8c-9d30-5f1ca98489e0 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:17.226133 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 30/60] 10.222.0.37 () {60 vars in 1153 bytes} [Wed Dec 29 20:35:17 2021] POST /identity/v3/users => generated 275 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:35:19.205718 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cc648-c161-4b22-8e27-bc855eb97495 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:19.206201 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cc648-c161-4b22-8e27-bc855eb97495 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:19.206201 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cc648-c161-4b22-8e27-bc855eb97495 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:19.207913 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 31/61] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:35:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:35:19.213018 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82834b-bc3c-438c-8236-39494eebd44d None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:19.213408 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82834b-bc3c-438c-8236-39494eebd44d None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:19.213592 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82834b-bc3c-438c-8236-39494eebd44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:19.235968 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-9c82834b-bc3c-438c-8236-39494eebd44d None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:35:19.237108 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-9c82834b-bc3c-438c-8236-39494eebd44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:35:19.244006 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 31/62] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:35:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:35:19.266031 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891cc648-c161-4b22-8e27-bc855eb97495 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:19.277833 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891cc648-c161-4b22-8e27-bc855eb97495 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:19.281559 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0ea29-09bd-484e-9065-f9a9d97fa671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:19.282294 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0ea29-09bd-484e-9065-f9a9d97fa671 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:19.282586 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0ea29-09bd-484e-9065-f9a9d97fa671 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:19.282898 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0ea29-09bd-484e-9065-f9a9d97fa671 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:19.293737 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0ea29-09bd-484e-9065-f9a9d97fa671 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:35:19.299995 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-acb0ea29-09bd-484e-9065-f9a9d97fa671 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 29 20:35:19.301043 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 32/63] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:35:19 2021] GET /identity/v3/roles/member => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:35:19.306247 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82834b-bc3c-438c-8236-39494eebd44d None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:19.315124 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82834b-bc3c-438c-8236-39494eebd44d None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:19.319013 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f69b27-033c-4418-b543-e808910acfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:19.319597 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f69b27-033c-4418-b543-e808910acfe0 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:19.319891 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f69b27-033c-4418-b543-e808910acfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:19.320209 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f69b27-033c-4418-b543-e808910acfe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:19.320916 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f69b27-033c-4418-b543-e808910acfe0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:19.321214 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f69b27-033c-4418-b543-e808910acfe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:19.347322 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f69b27-033c-4418-b543-e808910acfe0 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:19.355874 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 32/64] 10.222.0.37 () {56 vars in 1122 bytes} [Wed Dec 29 20:35:19 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:35:19.361587 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0ea29-09bd-484e-9065-f9a9d97fa671 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:19.371469 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0ea29-09bd-484e-9065-f9a9d97fa671 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:19.375302 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf087b-27cd-481d-b330-3e1e299d4778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:19.376656 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf087b-27cd-481d-b330-3e1e299d4778 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:19.377084 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf087b-27cd-481d-b330-3e1e299d4778 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:19.377369 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf087b-27cd-481d-b330-3e1e299d4778 admin admin] PATH_INFO: `/v3/users/03328de5575045b39a05fe986384adab` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:19.395865 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf087b-27cd-481d-b330-3e1e299d4778 admin admin] RBAC: Authorizing `identity:get_user(user_id=03328de5575045b39a05fe986384adab)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:19.421120 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf087b-27cd-481d-b330-3e1e299d4778 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:19.422570 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 33/65] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:35:19 2021] GET /identity/v3/users/03328de5575045b39a05fe986384adab => generated 275 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:19.427847 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f69b27-033c-4418-b543-e808910acfe0 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:19.436869 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f69b27-033c-4418-b543-e808910acfe0 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:19.441606 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5fdc4-2eff-4b14-961e-a65fe7622f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:19.442175 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5fdc4-2eff-4b14-961e-a65fe7622f3e admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:19.442470 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5fdc4-2eff-4b14-961e-a65fe7622f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:19.442788 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5fdc4-2eff-4b14-961e-a65fe7622f3e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:19.450792 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5fdc4-2eff-4b14-961e-a65fe7622f3e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:19.476816 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5fdc4-2eff-4b14-961e-a65fe7622f3e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:19.484961 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 33/66] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:35:19 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:35:19.490163 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf087b-27cd-481d-b330-3e1e299d4778 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:19.499263 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf087b-27cd-481d-b330-3e1e299d4778 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:19.503762 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f86b90-8567-44ac-a675-ae11e0e0fe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:19.504529 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f86b90-8567-44ac-a675-ae11e0e0fe8e admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:19.504823 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f86b90-8567-44ac-a675-ae11e0e0fe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:19.505110 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f86b90-8567-44ac-a675-ae11e0e0fe8e admin admin] PATH_INFO: `/v3/projects/10a6996925de4b25877e75bb73e7bd71` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:19.506171 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f86b90-8567-44ac-a675-ae11e0e0fe8e admin admin] RBAC: Authorizing `identity:get_project(project_id=10a6996925de4b25877e75bb73e7bd71)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:19.532103 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f86b90-8567-44ac-a675-ae11e0e0fe8e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:19.533650 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 34/67] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:35:19 2021] GET /identity/v3/projects/10a6996925de4b25877e75bb73e7bd71 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:19.538898 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5fdc4-2eff-4b14-961e-a65fe7622f3e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:19.547357 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5fdc4-2eff-4b14-961e-a65fe7622f3e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:19.551433 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831bc7f-3edd-4404-be3d-cbd385e5fbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:19.551993 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831bc7f-3edd-4404-be3d-cbd385e5fbfd admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:19.552284 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831bc7f-3edd-4404-be3d-cbd385e5fbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:19.552565 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831bc7f-3edd-4404-be3d-cbd385e5fbfd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:19.553329 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831bc7f-3edd-4404-be3d-cbd385e5fbfd admin admin] RBAC: Adding query filter params (role.id=b70e4a80dd884df58c908e9f9512f589, scope.project.id=10a6996925de4b25877e75bb73e7bd71, user.id=03328de5575045b39a05fe986384adab) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:19.553629 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831bc7f-3edd-4404-be3d-cbd385e5fbfd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:19.580262 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831bc7f-3edd-4404-be3d-cbd385e5fbfd admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:19.585359 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 34/68] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:35:19 2021] GET /identity/v3/role_assignments?user.id=03328de5575045b39a05fe986384adab&scope.project.id=10a6996925de4b25877e75bb73e7bd71&role.id=b70e4a80dd884df58c908e9f9512f589 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:21.504921 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51dc18-a67b-4621-8595-13de990b93c4 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:21.505434 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51dc18-a67b-4621-8595-13de990b93c4 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:21.505515 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51dc18-a67b-4621-8595-13de990b93c4 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:21.507204 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 35/69] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:35:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:35:21.512368 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362fd03-f81e-448b-892e-6ca53bc05ac3 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:21.512771 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362fd03-f81e-448b-892e-6ca53bc05ac3 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:21.512943 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362fd03-f81e-448b-892e-6ca53bc05ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:21.535429 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-a362fd03-f81e-448b-892e-6ca53bc05ac3 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:35:21.536556 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-a362fd03-f81e-448b-892e-6ca53bc05ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:35:21.543072 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 35/70] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:35:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:35:21.564510 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51dc18-a67b-4621-8595-13de990b93c4 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:21.575942 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51dc18-a67b-4621-8595-13de990b93c4 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:21.579748 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe360dac-700b-429d-9a64-1937a2fa3fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:21.580445 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe360dac-700b-429d-9a64-1937a2fa3fae admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:21.580734 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe360dac-700b-429d-9a64-1937a2fa3fae admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:21.581015 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe360dac-700b-429d-9a64-1937a2fa3fae admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:21.591780 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe360dac-700b-429d-9a64-1937a2fa3fae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:35:21.598381 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-fe360dac-700b-429d-9a64-1937a2fa3fae admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 29 20:35:21.599448 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 36/71] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:35:21 2021] GET /identity/v3/roles/member => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:35:21.604742 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362fd03-f81e-448b-892e-6ca53bc05ac3 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:21.613863 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362fd03-f81e-448b-892e-6ca53bc05ac3 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:21.617752 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541be002-657d-4752-94f5-9eedeba270fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:21.618337 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541be002-657d-4752-94f5-9eedeba270fd admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:21.618627 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541be002-657d-4752-94f5-9eedeba270fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:21.618939 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541be002-657d-4752-94f5-9eedeba270fd admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:21.619648 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541be002-657d-4752-94f5-9eedeba270fd admin admin] RBAC: Adding query filter params (name=member) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:21.619950 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541be002-657d-4752-94f5-9eedeba270fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:21.645122 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541be002-657d-4752-94f5-9eedeba270fd admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:21.653431 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 36/72] 10.222.0.37 () {56 vars in 1122 bytes} [Wed Dec 29 20:35:21 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:21.659067 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe360dac-700b-429d-9a64-1937a2fa3fae admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:21.670814 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe360dac-700b-429d-9a64-1937a2fa3fae admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:21.675554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea85c3-9103-4925-9935-0ed55d22016b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:21.676325 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea85c3-9103-4925-9935-0ed55d22016b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:21.676614 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea85c3-9103-4925-9935-0ed55d22016b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:21.676896 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea85c3-9103-4925-9935-0ed55d22016b admin admin] PATH_INFO: `/v3/users/03328de5575045b39a05fe986384adab` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:21.677962 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea85c3-9103-4925-9935-0ed55d22016b admin admin] RBAC: Authorizing `identity:get_user(user_id=03328de5575045b39a05fe986384adab)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:21.703705 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea85c3-9103-4925-9935-0ed55d22016b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:21.705261 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 37/73] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:35:21 2021] GET /identity/v3/users/03328de5575045b39a05fe986384adab => generated 275 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:35:21.710184 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541be002-657d-4752-94f5-9eedeba270fd admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:21.719184 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541be002-657d-4752-94f5-9eedeba270fd admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:21.724052 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aea7ce-4478-4302-8e3f-ec04e1a16feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:21.724820 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aea7ce-4478-4302-8e3f-ec04e1a16feb admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:21.725111 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aea7ce-4478-4302-8e3f-ec04e1a16feb admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:21.725398 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aea7ce-4478-4302-8e3f-ec04e1a16feb admin admin] PATH_INFO: `/v3/projects/10a6996925de4b25877e75bb73e7bd71` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:21.726470 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aea7ce-4478-4302-8e3f-ec04e1a16feb admin admin] RBAC: Authorizing `identity:get_project(project_id=10a6996925de4b25877e75bb73e7bd71)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:21.752839 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aea7ce-4478-4302-8e3f-ec04e1a16feb admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:21.754323 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 37/74] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:35:21 2021] GET /identity/v3/projects/10a6996925de4b25877e75bb73e7bd71 => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:21.759452 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea85c3-9103-4925-9935-0ed55d22016b admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:21.768345 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea85c3-9103-4925-9935-0ed55d22016b admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:21.772168 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a485b0-8c55-4289-ac6f-a2a37a5c9436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:21.772944 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a485b0-8c55-4289-ac6f-a2a37a5c9436 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:21.773228 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a485b0-8c55-4289-ac6f-a2a37a5c9436 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:21.773505 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a485b0-8c55-4289-ac6f-a2a37a5c9436 admin admin] PATH_INFO: `/v3/projects/10a6996925de4b25877e75bb73e7bd71/users/03328de5575045b39a05fe986384adab/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:21.775234 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a485b0-8c55-4289-ac6f-a2a37a5c9436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a6996925de4b25877e75bb73e7bd71, user_id=03328de5575045b39a05fe986384adab, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:21.802071 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a485b0-8c55-4289-ac6f-a2a37a5c9436 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:21.813743 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 38/75] 10.222.0.37 () {58 vars in 1460 bytes} [Wed Dec 29 20:35:21 2021] PUT /identity/v3/projects/10a6996925de4b25877e75bb73e7bd71/users/03328de5575045b39a05fe986384adab/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:35:23.733963 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26807165-39bc-4dcf-b05c-5f87e876072c None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:23.734535 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26807165-39bc-4dcf-b05c-5f87e876072c None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:23.734535 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26807165-39bc-4dcf-b05c-5f87e876072c None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:23.736273 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 38/76] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:35:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:35:23.741414 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbf402-68fb-4b11-9cf3-07c235229b79 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:23.741823 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbf402-68fb-4b11-9cf3-07c235229b79 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:23.741990 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbf402-68fb-4b11-9cf3-07c235229b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:23.764128 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-0fbbf402-68fb-4b11-9cf3-07c235229b79 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:35:23.765261 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-0fbbf402-68fb-4b11-9cf3-07c235229b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:35:23.827460 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 39/77] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:35:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:35:23.850078 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26807165-39bc-4dcf-b05c-5f87e876072c None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:23.862036 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26807165-39bc-4dcf-b05c-5f87e876072c None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:23.865894 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb980e63-b9f5-4fab-b85a-c85fd99f4263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:23.866606 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb980e63-b9f5-4fab-b85a-c85fd99f4263 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:23.866935 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb980e63-b9f5-4fab-b85a-c85fd99f4263 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:23.867223 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb980e63-b9f5-4fab-b85a-c85fd99f4263 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:23.880053 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb980e63-b9f5-4fab-b85a-c85fd99f4263 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:35:23.886413 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-cb980e63-b9f5-4fab-b85a-c85fd99f4263 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 29 20:35:23.887559 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 39/78] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:35:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:35:23.893707 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbf402-68fb-4b11-9cf3-07c235229b79 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:23.902223 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbf402-68fb-4b11-9cf3-07c235229b79 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:23.906102 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f29514-d4d2-480d-8e56-1fdd9ec5f9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:23.906722 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f29514-d4d2-480d-8e56-1fdd9ec5f9ce admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:23.907169 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f29514-d4d2-480d-8e56-1fdd9ec5f9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:23.907631 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f29514-d4d2-480d-8e56-1fdd9ec5f9ce admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:23.908346 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f29514-d4d2-480d-8e56-1fdd9ec5f9ce admin admin] RBAC: Adding query filter params (name=member) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:23.908650 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f29514-d4d2-480d-8e56-1fdd9ec5f9ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:23.933955 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f29514-d4d2-480d-8e56-1fdd9ec5f9ce admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:23.942927 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 40/79] 10.222.0.37 () {56 vars in 1122 bytes} [Wed Dec 29 20:35:23 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:23.948166 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb980e63-b9f5-4fab-b85a-c85fd99f4263 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:23.958646 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb980e63-b9f5-4fab-b85a-c85fd99f4263 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:23.962561 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ce25f-344a-4f80-b9a8-d3585d5cc8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:23.963367 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ce25f-344a-4f80-b9a8-d3585d5cc8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:23.963664 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ce25f-344a-4f80-b9a8-d3585d5cc8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:23.963952 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ce25f-344a-4f80-b9a8-d3585d5cc8f2 admin admin] PATH_INFO: `/v3/users/03328de5575045b39a05fe986384adab` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:23.965260 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ce25f-344a-4f80-b9a8-d3585d5cc8f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=03328de5575045b39a05fe986384adab)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:23.991996 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ce25f-344a-4f80-b9a8-d3585d5cc8f2 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:23.993390 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 40/80] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:35:23 2021] GET /identity/v3/users/03328de5575045b39a05fe986384adab => generated 275 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:23.998345 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f29514-d4d2-480d-8e56-1fdd9ec5f9ce admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:24.007904 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f29514-d4d2-480d-8e56-1fdd9ec5f9ce admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:24.011752 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba06abf-790c-4892-9514-24a058731314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:24.012308 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba06abf-790c-4892-9514-24a058731314 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:24.012598 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba06abf-790c-4892-9514-24a058731314 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:24.012905 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba06abf-790c-4892-9514-24a058731314 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:24.021512 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba06abf-790c-4892-9514-24a058731314 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:24.047299 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba06abf-790c-4892-9514-24a058731314 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:24.056283 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 41/81] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:35:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:35:24.061475 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ce25f-344a-4f80-b9a8-d3585d5cc8f2 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:24.071193 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ce25f-344a-4f80-b9a8-d3585d5cc8f2 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:24.075309 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b819e-7ec5-4e25-a19e-9a473b2a2bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:24.076069 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b819e-7ec5-4e25-a19e-9a473b2a2bbb admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:24.076358 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b819e-7ec5-4e25-a19e-9a473b2a2bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:24.076640 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b819e-7ec5-4e25-a19e-9a473b2a2bbb admin admin] PATH_INFO: `/v3/projects/10a6996925de4b25877e75bb73e7bd71` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:24.077710 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b819e-7ec5-4e25-a19e-9a473b2a2bbb admin admin] RBAC: Authorizing `identity:get_project(project_id=10a6996925de4b25877e75bb73e7bd71)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:24.103942 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b819e-7ec5-4e25-a19e-9a473b2a2bbb admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:24.105430 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 41/82] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:35:24 2021] GET /identity/v3/projects/10a6996925de4b25877e75bb73e7bd71 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:24.111173 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba06abf-790c-4892-9514-24a058731314 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:24.119415 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba06abf-790c-4892-9514-24a058731314 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:24.123379 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6176921-e816-4880-ac6e-28f8bb30a4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:24.123937 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6176921-e816-4880-ac6e-28f8bb30a4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:24.124229 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6176921-e816-4880-ac6e-28f8bb30a4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:24.124513 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6176921-e816-4880-ac6e-28f8bb30a4a0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:24.125281 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6176921-e816-4880-ac6e-28f8bb30a4a0 admin admin] RBAC: Adding query filter params (role.id=b70e4a80dd884df58c908e9f9512f589, scope.project.id=10a6996925de4b25877e75bb73e7bd71, user.id=03328de5575045b39a05fe986384adab) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:24.125603 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6176921-e816-4880-ac6e-28f8bb30a4a0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:24.150884 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING py.warnings [None req-f6176921-e816-4880-ac6e-28f8bb30a4a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:35:24.150884 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: warnings.warn(msg) Dec 29 20:35:24.150884 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: Dec 29 20:35:24.152010 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6176921-e816-4880-ac6e-28f8bb30a4a0 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:24.157762 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 42/83] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:35:24 2021] GET /identity/v3/role_assignments?user.id=03328de5575045b39a05fe986384adab&scope.project.id=10a6996925de4b25877e75bb73e7bd71&role.id=b70e4a80dd884df58c908e9f9512f589 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:35:26.214976 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb2cb6-4065-409f-814a-fffeac3e13e3 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:26.215501 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb2cb6-4065-409f-814a-fffeac3e13e3 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:26.215501 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb2cb6-4065-409f-814a-fffeac3e13e3 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:26.217119 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 42/84] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:35:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:35:26.222360 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2cbcb-2bed-4ca2-a1a3-ae02abf08ce8 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:26.222790 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2cbcb-2bed-4ca2-a1a3-ae02abf08ce8 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:26.222975 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2cbcb-2bed-4ca2-a1a3-ae02abf08ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:26.244679 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-9ad2cbcb-2bed-4ca2-a1a3-ae02abf08ce8 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:35:26.245804 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-9ad2cbcb-2bed-4ca2-a1a3-ae02abf08ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:35:26.252935 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 43/85] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:35:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:35:26.275076 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb2cb6-4065-409f-814a-fffeac3e13e3 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:26.286246 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb2cb6-4065-409f-814a-fffeac3e13e3 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:26.289926 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a89e2-fd8e-4771-9fa7-adcee189ed27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:26.290625 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a89e2-fd8e-4771-9fa7-adcee189ed27 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:26.290943 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a89e2-fd8e-4771-9fa7-adcee189ed27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:26.291224 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a89e2-fd8e-4771-9fa7-adcee189ed27 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:26.304315 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a89e2-fd8e-4771-9fa7-adcee189ed27 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:35:26.310507 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-756a89e2-fd8e-4771-9fa7-adcee189ed27 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:35:26.311584 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 43/86] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:35:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:35:26.317508 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2cbcb-2bed-4ca2-a1a3-ae02abf08ce8 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:26.326152 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2cbcb-2bed-4ca2-a1a3-ae02abf08ce8 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:26.330764 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e40bfa-327f-45e7-a60f-ed4d0c14688d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:26.331347 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e40bfa-327f-45e7-a60f-ed4d0c14688d admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:26.331638 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e40bfa-327f-45e7-a60f-ed4d0c14688d admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:26.331922 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e40bfa-327f-45e7-a60f-ed4d0c14688d admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:26.332624 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e40bfa-327f-45e7-a60f-ed4d0c14688d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:26.332922 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e40bfa-327f-45e7-a60f-ed4d0c14688d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:26.357868 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e40bfa-327f-45e7-a60f-ed4d0c14688d admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:26.367200 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 44/87] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:35:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:26.372359 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a89e2-fd8e-4771-9fa7-adcee189ed27 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:26.381901 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a89e2-fd8e-4771-9fa7-adcee189ed27 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:26.385694 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f900c8-4caa-498f-9b9d-2fa8ac607c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:26.386462 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f900c8-4caa-498f-9b9d-2fa8ac607c88 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:26.386782 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f900c8-4caa-498f-9b9d-2fa8ac607c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:26.387067 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f900c8-4caa-498f-9b9d-2fa8ac607c88 admin admin] PATH_INFO: `/v3/users/a36a939159da4f1da66be9e4aad8ddd2` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:26.388139 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f900c8-4caa-498f-9b9d-2fa8ac607c88 admin admin] RBAC: Authorizing `identity:get_user(user_id=a36a939159da4f1da66be9e4aad8ddd2)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:26.413534 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f900c8-4caa-498f-9b9d-2fa8ac607c88 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:26.414968 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 44/88] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:35:26 2021] GET /identity/v3/users/a36a939159da4f1da66be9e4aad8ddd2 => generated 247 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:26.419898 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e40bfa-327f-45e7-a60f-ed4d0c14688d admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:26.429522 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e40bfa-327f-45e7-a60f-ed4d0c14688d admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:26.433436 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628551ee-f370-43ab-8c5d-aa82a36f740d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:26.433997 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628551ee-f370-43ab-8c5d-aa82a36f740d admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:26.434289 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628551ee-f370-43ab-8c5d-aa82a36f740d admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:26.434571 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628551ee-f370-43ab-8c5d-aa82a36f740d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:26.442840 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628551ee-f370-43ab-8c5d-aa82a36f740d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:26.468014 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628551ee-f370-43ab-8c5d-aa82a36f740d admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:26.476233 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 45/89] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:35:26 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:35:26.481449 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f900c8-4caa-498f-9b9d-2fa8ac607c88 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:26.491142 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f900c8-4caa-498f-9b9d-2fa8ac607c88 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:26.495041 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e4d21-cd92-4e24-9e97-54ea70d1ae83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:26.495817 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e4d21-cd92-4e24-9e97-54ea70d1ae83 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:26.496109 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e4d21-cd92-4e24-9e97-54ea70d1ae83 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:26.496393 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e4d21-cd92-4e24-9e97-54ea70d1ae83 admin admin] PATH_INFO: `/v3/projects/10a6996925de4b25877e75bb73e7bd71` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:26.497460 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e4d21-cd92-4e24-9e97-54ea70d1ae83 admin admin] RBAC: Authorizing `identity:get_project(project_id=10a6996925de4b25877e75bb73e7bd71)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:26.523745 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e4d21-cd92-4e24-9e97-54ea70d1ae83 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:26.525297 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 45/90] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:35:26 2021] GET /identity/v3/projects/10a6996925de4b25877e75bb73e7bd71 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:26.530680 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628551ee-f370-43ab-8c5d-aa82a36f740d admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:26.539357 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628551ee-f370-43ab-8c5d-aa82a36f740d admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:26.543319 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd969c-5e5b-4ef5-9832-69fd93de791c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:26.543888 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd969c-5e5b-4ef5-9832-69fd93de791c admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:26.544180 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd969c-5e5b-4ef5-9832-69fd93de791c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:26.544468 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd969c-5e5b-4ef5-9832-69fd93de791c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:26.545244 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd969c-5e5b-4ef5-9832-69fd93de791c admin admin] RBAC: Adding query filter params (role.id=e66e6a94ba014fd193b851ceb92695ae, scope.project.id=10a6996925de4b25877e75bb73e7bd71, user.id=a36a939159da4f1da66be9e4aad8ddd2) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:26.545553 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd969c-5e5b-4ef5-9832-69fd93de791c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:26.571781 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd969c-5e5b-4ef5-9832-69fd93de791c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:26.577170 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 46/91] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:35:26 2021] GET /identity/v3/role_assignments?user.id=a36a939159da4f1da66be9e4aad8ddd2&scope.project.id=10a6996925de4b25877e75bb73e7bd71&role.id=e66e6a94ba014fd193b851ceb92695ae => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:28.480692 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2ce3c-3ff6-4c8a-9de7-cd7ea681fb58 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:28.481182 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2ce3c-3ff6-4c8a-9de7-cd7ea681fb58 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:28.481285 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2ce3c-3ff6-4c8a-9de7-cd7ea681fb58 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:28.482970 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 46/92] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:35:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:35:28.488586 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f62a7b-435a-42e5-afdf-2aba6d07afec None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:28.489010 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f62a7b-435a-42e5-afdf-2aba6d07afec None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:28.489170 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f62a7b-435a-42e5-afdf-2aba6d07afec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:28.521732 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-e8f62a7b-435a-42e5-afdf-2aba6d07afec None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:35:28.522903 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-e8f62a7b-435a-42e5-afdf-2aba6d07afec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:35:28.529441 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 47/93] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:35:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:35:28.550700 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2ce3c-3ff6-4c8a-9de7-cd7ea681fb58 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:28.562041 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2ce3c-3ff6-4c8a-9de7-cd7ea681fb58 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:28.566351 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d853b-6e2a-458e-b5db-7817d02097b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:28.567084 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d853b-6e2a-458e-b5db-7817d02097b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:28.567378 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d853b-6e2a-458e-b5db-7817d02097b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:28.567663 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d853b-6e2a-458e-b5db-7817d02097b9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:28.579419 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d853b-6e2a-458e-b5db-7817d02097b9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:35:28.585619 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-9c2d853b-6e2a-458e-b5db-7817d02097b9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:35:28.586689 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 47/94] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:35:28 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:35:28.591892 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f62a7b-435a-42e5-afdf-2aba6d07afec None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:28.600519 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f62a7b-435a-42e5-afdf-2aba6d07afec None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:28.604408 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693278e-4694-436a-891d-23c7fa99cefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:28.604996 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693278e-4694-436a-891d-23c7fa99cefa admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:28.605290 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693278e-4694-436a-891d-23c7fa99cefa admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:28.605577 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693278e-4694-436a-891d-23c7fa99cefa admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:28.606281 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693278e-4694-436a-891d-23c7fa99cefa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:28.606584 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693278e-4694-436a-891d-23c7fa99cefa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:28.632621 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693278e-4694-436a-891d-23c7fa99cefa admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:28.640913 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 48/95] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:35:28 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:28.645988 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d853b-6e2a-458e-b5db-7817d02097b9 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:28.655931 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d853b-6e2a-458e-b5db-7817d02097b9 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:28.659825 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bfbfd-f3be-424a-9adf-69a8ec4a15cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:28.660595 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bfbfd-f3be-424a-9adf-69a8ec4a15cc admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:28.660882 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bfbfd-f3be-424a-9adf-69a8ec4a15cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:28.661159 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bfbfd-f3be-424a-9adf-69a8ec4a15cc admin admin] PATH_INFO: `/v3/users/a36a939159da4f1da66be9e4aad8ddd2` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:28.662233 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404bfbfd-f3be-424a-9adf-69a8ec4a15cc admin admin] RBAC: Authorizing `identity:get_user(user_id=a36a939159da4f1da66be9e4aad8ddd2)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:28.688049 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404bfbfd-f3be-424a-9adf-69a8ec4a15cc admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:28.689645 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 48/96] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:35:28 2021] GET /identity/v3/users/a36a939159da4f1da66be9e4aad8ddd2 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:28.694761 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693278e-4694-436a-891d-23c7fa99cefa admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:28.705042 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693278e-4694-436a-891d-23c7fa99cefa admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:28.708972 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d38452-0edb-4247-83a8-bd34ca7a0d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:28.709751 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d38452-0edb-4247-83a8-bd34ca7a0d08 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:28.710046 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d38452-0edb-4247-83a8-bd34ca7a0d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:28.710335 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d38452-0edb-4247-83a8-bd34ca7a0d08 admin admin] PATH_INFO: `/v3/projects/10a6996925de4b25877e75bb73e7bd71` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:28.711433 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d38452-0edb-4247-83a8-bd34ca7a0d08 admin admin] RBAC: Authorizing `identity:get_project(project_id=10a6996925de4b25877e75bb73e7bd71)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:28.737680 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d38452-0edb-4247-83a8-bd34ca7a0d08 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:28.739133 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 49/97] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:35:28 2021] GET /identity/v3/projects/10a6996925de4b25877e75bb73e7bd71 => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:28.744141 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bfbfd-f3be-424a-9adf-69a8ec4a15cc admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:28.753356 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bfbfd-f3be-424a-9adf-69a8ec4a15cc admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:28.757171 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfec82e-b1a2-4c41-9597-0df67fe0d1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:28.757959 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfec82e-b1a2-4c41-9597-0df67fe0d1da admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:28.758248 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfec82e-b1a2-4c41-9597-0df67fe0d1da admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:28.758531 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfec82e-b1a2-4c41-9597-0df67fe0d1da admin admin] PATH_INFO: `/v3/projects/10a6996925de4b25877e75bb73e7bd71/users/a36a939159da4f1da66be9e4aad8ddd2/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:28.760273 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfec82e-b1a2-4c41-9597-0df67fe0d1da admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a6996925de4b25877e75bb73e7bd71, user_id=a36a939159da4f1da66be9e4aad8ddd2, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:28.785808 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING py.warnings [None req-fdfec82e-b1a2-4c41-9597-0df67fe0d1da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:35:28.785808 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: warnings.warn(msg) Dec 29 20:35:28.785808 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: Dec 29 20:35:28.787743 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfec82e-b1a2-4c41-9597-0df67fe0d1da admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:28.800177 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 49/98] 10.222.0.37 () {58 vars in 1460 bytes} [Wed Dec 29 20:35:28 2021] PUT /identity/v3/projects/10a6996925de4b25877e75bb73e7bd71/users/a36a939159da4f1da66be9e4aad8ddd2/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:35:30.743332 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d85154-d60d-4f32-b2e0-42f13b68fabe None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:30.743845 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d85154-d60d-4f32-b2e0-42f13b68fabe None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:30.743944 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d85154-d60d-4f32-b2e0-42f13b68fabe None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:30.745581 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 50/99] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:35:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:35:30.750929 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864ed81-905c-45a8-84bc-c96c643782ec None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:30.751342 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864ed81-905c-45a8-84bc-c96c643782ec None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:30.751513 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864ed81-905c-45a8-84bc-c96c643782ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:30.773540 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-0864ed81-905c-45a8-84bc-c96c643782ec None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:35:30.774692 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-0864ed81-905c-45a8-84bc-c96c643782ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:35:30.837404 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 50/100] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:35:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:35:30.859619 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d85154-d60d-4f32-b2e0-42f13b68fabe None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:30.871250 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d85154-d60d-4f32-b2e0-42f13b68fabe None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:30.875007 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a078d4d-c6f5-4612-b4b7-f18819b0e948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:30.875945 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a078d4d-c6f5-4612-b4b7-f18819b0e948 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:30.876384 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a078d4d-c6f5-4612-b4b7-f18819b0e948 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:30.876797 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a078d4d-c6f5-4612-b4b7-f18819b0e948 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:30.888392 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a078d4d-c6f5-4612-b4b7-f18819b0e948 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:35:30.895473 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-7a078d4d-c6f5-4612-b4b7-f18819b0e948 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:35:30.896563 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 51/101] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:35:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:35:30.902139 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864ed81-905c-45a8-84bc-c96c643782ec None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:30.911263 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864ed81-905c-45a8-84bc-c96c643782ec None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:30.915178 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708b9b5-d265-4f53-8c2a-efe96bca61a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:30.915766 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708b9b5-d265-4f53-8c2a-efe96bca61a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:30.916057 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708b9b5-d265-4f53-8c2a-efe96bca61a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:30.916341 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708b9b5-d265-4f53-8c2a-efe96bca61a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:30.917053 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708b9b5-d265-4f53-8c2a-efe96bca61a5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:30.917354 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708b9b5-d265-4f53-8c2a-efe96bca61a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:30.942526 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708b9b5-d265-4f53-8c2a-efe96bca61a5 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:30.951159 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 51/102] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:35:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:35:30.956872 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a078d4d-c6f5-4612-b4b7-f18819b0e948 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:30.965904 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a078d4d-c6f5-4612-b4b7-f18819b0e948 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:30.970367 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d40e5a-dbba-4acf-be1c-51e9ab5451a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:30.971169 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d40e5a-dbba-4acf-be1c-51e9ab5451a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:30.971462 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d40e5a-dbba-4acf-be1c-51e9ab5451a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:30.971745 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d40e5a-dbba-4acf-be1c-51e9ab5451a5 admin admin] PATH_INFO: `/v3/users/a36a939159da4f1da66be9e4aad8ddd2` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:30.972805 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d40e5a-dbba-4acf-be1c-51e9ab5451a5 admin admin] RBAC: Authorizing `identity:get_user(user_id=a36a939159da4f1da66be9e4aad8ddd2)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:30.997988 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d40e5a-dbba-4acf-be1c-51e9ab5451a5 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:30.999428 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 52/103] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:35:30 2021] GET /identity/v3/users/a36a939159da4f1da66be9e4aad8ddd2 => generated 247 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:31.004537 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708b9b5-d265-4f53-8c2a-efe96bca61a5 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:31.013466 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708b9b5-d265-4f53-8c2a-efe96bca61a5 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:31.018041 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fde910-98f1-4f2e-9336-06206e9229f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:31.018596 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fde910-98f1-4f2e-9336-06206e9229f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:31.018916 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fde910-98f1-4f2e-9336-06206e9229f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:31.019199 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fde910-98f1-4f2e-9336-06206e9229f2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:31.026561 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fde910-98f1-4f2e-9336-06206e9229f2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:31.052300 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fde910-98f1-4f2e-9336-06206e9229f2 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:31.060396 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 52/104] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:35:31 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:35:31.065531 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d40e5a-dbba-4acf-be1c-51e9ab5451a5 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:31.074610 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d40e5a-dbba-4acf-be1c-51e9ab5451a5 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:31.079328 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefc521-050d-4fbe-8731-2cb43ff86a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:31.080195 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefc521-050d-4fbe-8731-2cb43ff86a3f admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:31.080494 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefc521-050d-4fbe-8731-2cb43ff86a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:31.080783 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefc521-050d-4fbe-8731-2cb43ff86a3f admin admin] PATH_INFO: `/v3/projects/10a6996925de4b25877e75bb73e7bd71` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:31.081855 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efefc521-050d-4fbe-8731-2cb43ff86a3f admin admin] RBAC: Authorizing `identity:get_project(project_id=10a6996925de4b25877e75bb73e7bd71)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:31.108002 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efefc521-050d-4fbe-8731-2cb43ff86a3f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:31.109497 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 53/105] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:35:31 2021] GET /identity/v3/projects/10a6996925de4b25877e75bb73e7bd71 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:31.114684 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fde910-98f1-4f2e-9336-06206e9229f2 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:31.122868 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fde910-98f1-4f2e-9336-06206e9229f2 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:31.126912 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45dff3-1724-43b1-8428-de9b1de85705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:31.127478 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45dff3-1724-43b1-8428-de9b1de85705 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:31.127772 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45dff3-1724-43b1-8428-de9b1de85705 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:31.128059 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45dff3-1724-43b1-8428-de9b1de85705 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:31.128830 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45dff3-1724-43b1-8428-de9b1de85705 admin admin] RBAC: Adding query filter params (role.id=e66e6a94ba014fd193b851ceb92695ae, scope.project.id=10a6996925de4b25877e75bb73e7bd71, user.id=a36a939159da4f1da66be9e4aad8ddd2) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:31.129136 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45dff3-1724-43b1-8428-de9b1de85705 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:31.154978 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45dff3-1724-43b1-8428-de9b1de85705 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:31.161145 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 53/106] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:35:31 2021] GET /identity/v3/role_assignments?user.id=a36a939159da4f1da66be9e4aad8ddd2&scope.project.id=10a6996925de4b25877e75bb73e7bd71&role.id=e66e6a94ba014fd193b851ceb92695ae => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:33.135608 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd52357-9f76-4f84-92f6-e6d1290af414 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:33.136093 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd52357-9f76-4f84-92f6-e6d1290af414 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:33.136093 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd52357-9f76-4f84-92f6-e6d1290af414 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:33.137774 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 54/107] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:35:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:35:33.143386 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551f24e-3394-4244-bc2b-6afe40349f13 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:33.143766 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551f24e-3394-4244-bc2b-6afe40349f13 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:33.143958 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551f24e-3394-4244-bc2b-6afe40349f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:33.166265 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-c551f24e-3394-4244-bc2b-6afe40349f13 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:35:33.167437 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-c551f24e-3394-4244-bc2b-6afe40349f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:35:33.173932 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 54/108] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:35:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:35:33.196199 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd52357-9f76-4f84-92f6-e6d1290af414 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:33.208705 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd52357-9f76-4f84-92f6-e6d1290af414 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:33.212512 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550bc42-6ecc-42ac-ade6-88c39d3df80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:33.213227 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550bc42-6ecc-42ac-ade6-88c39d3df80d admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:33.213521 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550bc42-6ecc-42ac-ade6-88c39d3df80d admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:33.213809 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550bc42-6ecc-42ac-ade6-88c39d3df80d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:33.225406 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d550bc42-6ecc-42ac-ade6-88c39d3df80d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:35:33.232022 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-d550bc42-6ecc-42ac-ade6-88c39d3df80d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 29 20:35:33.233084 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 55/109] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:35:33 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:35:33.238687 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551f24e-3394-4244-bc2b-6afe40349f13 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:33.247055 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551f24e-3394-4244-bc2b-6afe40349f13 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:33.250912 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65668c04-7a99-4e5c-a0bc-07c9f13a74fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:33.251498 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65668c04-7a99-4e5c-a0bc-07c9f13a74fd admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:33.251792 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65668c04-7a99-4e5c-a0bc-07c9f13a74fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:33.252078 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65668c04-7a99-4e5c-a0bc-07c9f13a74fd admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:33.252785 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65668c04-7a99-4e5c-a0bc-07c9f13a74fd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:33.253084 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65668c04-7a99-4e5c-a0bc-07c9f13a74fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:33.278991 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65668c04-7a99-4e5c-a0bc-07c9f13a74fd admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:33.287644 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 55/110] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:35:33 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:33.292953 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550bc42-6ecc-42ac-ade6-88c39d3df80d admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:33.302866 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550bc42-6ecc-42ac-ade6-88c39d3df80d admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:33.306750 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8a21a-35aa-449b-a20d-03e49811a0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:33.307519 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8a21a-35aa-449b-a20d-03e49811a0cb admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:33.307814 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8a21a-35aa-449b-a20d-03e49811a0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:33.308096 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8a21a-35aa-449b-a20d-03e49811a0cb admin admin] PATH_INFO: `/v3/users/03328de5575045b39a05fe986384adab` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:33.309166 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8a21a-35aa-449b-a20d-03e49811a0cb admin admin] RBAC: Authorizing `identity:get_user(user_id=03328de5575045b39a05fe986384adab)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:33.335421 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8a21a-35aa-449b-a20d-03e49811a0cb admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:33.336837 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 56/111] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:35:33 2021] GET /identity/v3/users/03328de5575045b39a05fe986384adab => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:33.341864 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65668c04-7a99-4e5c-a0bc-07c9f13a74fd admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:33.351585 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65668c04-7a99-4e5c-a0bc-07c9f13a74fd admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:33.355389 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd9ddf-00b5-46a6-8c24-bcfb3c6b6f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:33.355967 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd9ddf-00b5-46a6-8c24-bcfb3c6b6f0d admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:33.356257 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd9ddf-00b5-46a6-8c24-bcfb3c6b6f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:33.356538 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd9ddf-00b5-46a6-8c24-bcfb3c6b6f0d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:33.364058 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd9ddf-00b5-46a6-8c24-bcfb3c6b6f0d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:33.389416 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd9ddf-00b5-46a6-8c24-bcfb3c6b6f0d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:33.397983 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 56/112] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:35:33 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:35:33.402925 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8a21a-35aa-449b-a20d-03e49811a0cb admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:33.412503 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8a21a-35aa-449b-a20d-03e49811a0cb admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:33.416346 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13665cfd-a85f-41bc-b529-034e200a5352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:33.417092 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13665cfd-a85f-41bc-b529-034e200a5352 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:33.417380 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13665cfd-a85f-41bc-b529-034e200a5352 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:33.417661 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13665cfd-a85f-41bc-b529-034e200a5352 admin admin] PATH_INFO: `/v3/projects/10a6996925de4b25877e75bb73e7bd71` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:33.418724 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13665cfd-a85f-41bc-b529-034e200a5352 admin admin] RBAC: Authorizing `identity:get_project(project_id=10a6996925de4b25877e75bb73e7bd71)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:33.444126 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13665cfd-a85f-41bc-b529-034e200a5352 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:33.445591 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 57/113] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:35:33 2021] GET /identity/v3/projects/10a6996925de4b25877e75bb73e7bd71 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:33.451010 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd9ddf-00b5-46a6-8c24-bcfb3c6b6f0d admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:33.459651 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd9ddf-00b5-46a6-8c24-bcfb3c6b6f0d admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:33.463788 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89c84d-5c48-443d-9285-2a6ac8ff2b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:33.464346 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89c84d-5c48-443d-9285-2a6ac8ff2b44 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:33.464637 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89c84d-5c48-443d-9285-2a6ac8ff2b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:33.464920 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89c84d-5c48-443d-9285-2a6ac8ff2b44 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:33.465682 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89c84d-5c48-443d-9285-2a6ac8ff2b44 admin admin] RBAC: Adding query filter params (role.id=5f70396837d2484ca16563634aa8d2a2, scope.project.id=10a6996925de4b25877e75bb73e7bd71, user.id=03328de5575045b39a05fe986384adab) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:33.465982 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89c84d-5c48-443d-9285-2a6ac8ff2b44 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:33.492200 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89c84d-5c48-443d-9285-2a6ac8ff2b44 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:33.497329 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 57/114] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:35:33 2021] GET /identity/v3/role_assignments?user.id=03328de5575045b39a05fe986384adab&scope.project.id=10a6996925de4b25877e75bb73e7bd71&role.id=5f70396837d2484ca16563634aa8d2a2 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:35.424970 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d6a9b-fc1e-494f-8346-fd5f2711010c None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:35.425512 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d6a9b-fc1e-494f-8346-fd5f2711010c None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:35.425601 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d6a9b-fc1e-494f-8346-fd5f2711010c None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:35.427331 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 58/115] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:35:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:35:35.432576 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7737d14-5d1b-4b3b-a8e6-4625aaa86e72 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:35.432937 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7737d14-5d1b-4b3b-a8e6-4625aaa86e72 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:35.433151 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7737d14-5d1b-4b3b-a8e6-4625aaa86e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:35.455899 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-d7737d14-5d1b-4b3b-a8e6-4625aaa86e72 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:35:35.457004 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-d7737d14-5d1b-4b3b-a8e6-4625aaa86e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:35:35.463464 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 58/116] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:35:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:35:35.484372 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d6a9b-fc1e-494f-8346-fd5f2711010c None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:35.496142 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d6a9b-fc1e-494f-8346-fd5f2711010c None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:35.499867 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c094d2-425f-4df2-beb4-772f3785d4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:35.501250 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c094d2-425f-4df2-beb4-772f3785d4ba admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:35.501536 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c094d2-425f-4df2-beb4-772f3785d4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:35.501816 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c094d2-425f-4df2-beb4-772f3785d4ba admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:35.512593 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c094d2-425f-4df2-beb4-772f3785d4ba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:35:35.519504 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-e1c094d2-425f-4df2-beb4-772f3785d4ba admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 29 20:35:35.520559 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 59/117] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:35:35 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:35:35.525800 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7737d14-5d1b-4b3b-a8e6-4625aaa86e72 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:35.534182 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7737d14-5d1b-4b3b-a8e6-4625aaa86e72 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:35.538051 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58096326-ba5c-4ba5-953b-a91144c0a6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:35.538631 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58096326-ba5c-4ba5-953b-a91144c0a6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:35.538958 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58096326-ba5c-4ba5-953b-a91144c0a6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:35.539239 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58096326-ba5c-4ba5-953b-a91144c0a6b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:35.539946 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58096326-ba5c-4ba5-953b-a91144c0a6b3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:35.540253 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58096326-ba5c-4ba5-953b-a91144c0a6b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:35.566595 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58096326-ba5c-4ba5-953b-a91144c0a6b3 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:35.575150 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 59/118] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:35:35 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:35:35.580081 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c094d2-425f-4df2-beb4-772f3785d4ba admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:35.589855 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c094d2-425f-4df2-beb4-772f3785d4ba admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:35.593659 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41717a39-42cb-4cb5-8953-1d8be1ca673a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:35.594420 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41717a39-42cb-4cb5-8953-1d8be1ca673a admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:35.594733 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41717a39-42cb-4cb5-8953-1d8be1ca673a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:35.595013 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41717a39-42cb-4cb5-8953-1d8be1ca673a admin admin] PATH_INFO: `/v3/users/03328de5575045b39a05fe986384adab` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:35.596080 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41717a39-42cb-4cb5-8953-1d8be1ca673a admin admin] RBAC: Authorizing `identity:get_user(user_id=03328de5575045b39a05fe986384adab)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:35.621980 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41717a39-42cb-4cb5-8953-1d8be1ca673a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:35.623424 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 60/119] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:35:35 2021] GET /identity/v3/users/03328de5575045b39a05fe986384adab => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:35:35.628841 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58096326-ba5c-4ba5-953b-a91144c0a6b3 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:35.637811 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58096326-ba5c-4ba5-953b-a91144c0a6b3 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:35.641723 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d3b33-4352-4b58-9c94-e152c96a45ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:35.642491 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d3b33-4352-4b58-9c94-e152c96a45ee admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:35.642811 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d3b33-4352-4b58-9c94-e152c96a45ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:35.643097 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d3b33-4352-4b58-9c94-e152c96a45ee admin admin] PATH_INFO: `/v3/projects/10a6996925de4b25877e75bb73e7bd71` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:35.644174 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d3b33-4352-4b58-9c94-e152c96a45ee admin admin] RBAC: Authorizing `identity:get_project(project_id=10a6996925de4b25877e75bb73e7bd71)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:35.669924 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d3b33-4352-4b58-9c94-e152c96a45ee admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:35.671451 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 60/120] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:35:35 2021] GET /identity/v3/projects/10a6996925de4b25877e75bb73e7bd71 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:35.677253 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41717a39-42cb-4cb5-8953-1d8be1ca673a admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:35.686095 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41717a39-42cb-4cb5-8953-1d8be1ca673a admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:35.690136 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cfe72-c693-49a9-945b-575eab617823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:35.690946 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cfe72-c693-49a9-945b-575eab617823 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:35.691233 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cfe72-c693-49a9-945b-575eab617823 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:35.691511 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cfe72-c693-49a9-945b-575eab617823 admin admin] PATH_INFO: `/v3/projects/10a6996925de4b25877e75bb73e7bd71/users/03328de5575045b39a05fe986384adab/roles/5f70396837d2484ca16563634aa8d2a2` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:35.693424 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cfe72-c693-49a9-945b-575eab617823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a6996925de4b25877e75bb73e7bd71, user_id=03328de5575045b39a05fe986384adab, role_id=5f70396837d2484ca16563634aa8d2a2)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:35.720935 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cfe72-c693-49a9-945b-575eab617823 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:35.732495 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 61/121] 10.222.0.37 () {58 vars in 1460 bytes} [Wed Dec 29 20:35:35 2021] PUT /identity/v3/projects/10a6996925de4b25877e75bb73e7bd71/users/03328de5575045b39a05fe986384adab/roles/5f70396837d2484ca16563634aa8d2a2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:35:37.649037 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225fdcd-fef2-4e07-98a8-db39a0ac35ec None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:37.649554 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225fdcd-fef2-4e07-98a8-db39a0ac35ec None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:37.649663 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225fdcd-fef2-4e07-98a8-db39a0ac35ec None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:37.651273 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 61/122] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:35:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:35:37.656304 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0191c-3523-4678-8e14-c881b32f0d5d None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:37.656725 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0191c-3523-4678-8e14-c881b32f0d5d None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:37.657016 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0191c-3523-4678-8e14-c881b32f0d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:37.679529 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-cfe0191c-3523-4678-8e14-c881b32f0d5d None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:35:37.680670 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-cfe0191c-3523-4678-8e14-c881b32f0d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:35:37.742945 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 62/123] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:35:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:35:37.765201 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225fdcd-fef2-4e07-98a8-db39a0ac35ec None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:37.776507 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225fdcd-fef2-4e07-98a8-db39a0ac35ec None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:37.780274 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bcfd5-e507-40d5-9079-ae09e7730dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:37.780992 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bcfd5-e507-40d5-9079-ae09e7730dfd admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:37.781283 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bcfd5-e507-40d5-9079-ae09e7730dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:37.781685 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bcfd5-e507-40d5-9079-ae09e7730dfd admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:37.793242 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bcfd5-e507-40d5-9079-ae09e7730dfd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:35:37.800380 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-2a4bcfd5-e507-40d5-9079-ae09e7730dfd admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 29 20:35:37.801439 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 62/124] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:35:37 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:35:37.806828 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0191c-3523-4678-8e14-c881b32f0d5d None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:37.815847 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0191c-3523-4678-8e14-c881b32f0d5d None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:37.819769 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec2cd4-23de-4cb5-a85e-6956e7549608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:37.820356 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec2cd4-23de-4cb5-a85e-6956e7549608 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:37.820654 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec2cd4-23de-4cb5-a85e-6956e7549608 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:37.820942 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec2cd4-23de-4cb5-a85e-6956e7549608 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:37.821656 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec2cd4-23de-4cb5-a85e-6956e7549608 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:37.821961 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec2cd4-23de-4cb5-a85e-6956e7549608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:37.847292 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec2cd4-23de-4cb5-a85e-6956e7549608 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:37.855771 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 63/125] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:35:37 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:37.861856 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bcfd5-e507-40d5-9079-ae09e7730dfd admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:37.870987 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bcfd5-e507-40d5-9079-ae09e7730dfd admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:37.874849 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bab70f-9e40-4c44-a2e5-6f743b4cc845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:37.876196 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bab70f-9e40-4c44-a2e5-6f743b4cc845 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:37.876484 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bab70f-9e40-4c44-a2e5-6f743b4cc845 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:37.876769 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bab70f-9e40-4c44-a2e5-6f743b4cc845 admin admin] PATH_INFO: `/v3/users/03328de5575045b39a05fe986384adab` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:37.877854 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bab70f-9e40-4c44-a2e5-6f743b4cc845 admin admin] RBAC: Authorizing `identity:get_user(user_id=03328de5575045b39a05fe986384adab)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:37.903668 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bab70f-9e40-4c44-a2e5-6f743b4cc845 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:37.905042 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 63/126] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:35:37 2021] GET /identity/v3/users/03328de5575045b39a05fe986384adab => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:35:37.910508 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec2cd4-23de-4cb5-a85e-6956e7549608 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:37.919681 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec2cd4-23de-4cb5-a85e-6956e7549608 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:37.924212 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a77331-121d-42af-8052-88264c938e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:37.924776 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a77331-121d-42af-8052-88264c938e82 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:37.925068 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a77331-121d-42af-8052-88264c938e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:37.925353 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a77331-121d-42af-8052-88264c938e82 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:37.932860 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a77331-121d-42af-8052-88264c938e82 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:37.958815 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a77331-121d-42af-8052-88264c938e82 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:37.967071 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 64/127] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:35:37 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:35:37.972914 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bab70f-9e40-4c44-a2e5-6f743b4cc845 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:37.981936 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bab70f-9e40-4c44-a2e5-6f743b4cc845 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:37.987333 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1343c0-b2fe-40bf-a971-af0bd0ba14e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:37.988096 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1343c0-b2fe-40bf-a971-af0bd0ba14e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:37.988391 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1343c0-b2fe-40bf-a971-af0bd0ba14e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:37.988677 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1343c0-b2fe-40bf-a971-af0bd0ba14e7 admin admin] PATH_INFO: `/v3/projects/10a6996925de4b25877e75bb73e7bd71` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:37.989741 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1343c0-b2fe-40bf-a971-af0bd0ba14e7 admin admin] RBAC: Authorizing `identity:get_project(project_id=10a6996925de4b25877e75bb73e7bd71)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:38.015388 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1343c0-b2fe-40bf-a971-af0bd0ba14e7 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:38.016907 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 64/128] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:35:37 2021] GET /identity/v3/projects/10a6996925de4b25877e75bb73e7bd71 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:38.022164 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a77331-121d-42af-8052-88264c938e82 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:38.030492 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a77331-121d-42af-8052-88264c938e82 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:38.035013 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199ccf7-5dff-4605-802e-a385f2bb829f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:38.035577 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199ccf7-5dff-4605-802e-a385f2bb829f admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:38.035869 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199ccf7-5dff-4605-802e-a385f2bb829f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:38.036155 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199ccf7-5dff-4605-802e-a385f2bb829f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:38.036920 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199ccf7-5dff-4605-802e-a385f2bb829f admin admin] RBAC: Adding query filter params (role.id=5f70396837d2484ca16563634aa8d2a2, scope.project.id=10a6996925de4b25877e75bb73e7bd71, user.id=03328de5575045b39a05fe986384adab) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:38.037225 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199ccf7-5dff-4605-802e-a385f2bb829f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:38.063397 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199ccf7-5dff-4605-802e-a385f2bb829f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:38.068971 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 65/129] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:35:38 2021] GET /identity/v3/role_assignments?user.id=03328de5575045b39a05fe986384adab&scope.project.id=10a6996925de4b25877e75bb73e7bd71&role.id=5f70396837d2484ca16563634aa8d2a2 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:40.052766 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0480870-6026-4499-918a-c9bebad42865 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:40.053266 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0480870-6026-4499-918a-c9bebad42865 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:40.053350 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0480870-6026-4499-918a-c9bebad42865 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:40.055042 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 65/130] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:35:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 29 20:35:40.060253 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34ff9d-4aab-4e54-853d-787eeaf039ff None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:40.060642 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34ff9d-4aab-4e54-853d-787eeaf039ff None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:40.060827 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34ff9d-4aab-4e54-853d-787eeaf039ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:40.085041 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-fd34ff9d-4aab-4e54-853d-787eeaf039ff None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:35:40.086172 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-fd34ff9d-4aab-4e54-853d-787eeaf039ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:35:40.092710 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 66/131] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:35:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:35:40.114893 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0480870-6026-4499-918a-c9bebad42865 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:40.126123 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0480870-6026-4499-918a-c9bebad42865 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:40.129898 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3a270-d50d-468c-9c8e-7bc4757dabcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:40.130602 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3a270-d50d-468c-9c8e-7bc4757dabcb admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:40.130919 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3a270-d50d-468c-9c8e-7bc4757dabcb admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:40.131203 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3a270-d50d-468c-9c8e-7bc4757dabcb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:40.142532 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3a270-d50d-468c-9c8e-7bc4757dabcb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:35:40.148749 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-5da3a270-d50d-468c-9c8e-7bc4757dabcb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 29 20:35:40.149799 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 66/132] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:35:40 2021] GET /identity/v3/roles/member => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:35:40.155095 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34ff9d-4aab-4e54-853d-787eeaf039ff None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:40.164367 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34ff9d-4aab-4e54-853d-787eeaf039ff None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:40.168255 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24321051-aa8b-4cf0-8fc6-4ae13ca468b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:40.168843 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24321051-aa8b-4cf0-8fc6-4ae13ca468b1 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:40.169135 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24321051-aa8b-4cf0-8fc6-4ae13ca468b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:40.169421 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24321051-aa8b-4cf0-8fc6-4ae13ca468b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:40.170126 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24321051-aa8b-4cf0-8fc6-4ae13ca468b1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:40.170429 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24321051-aa8b-4cf0-8fc6-4ae13ca468b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:40.196320 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24321051-aa8b-4cf0-8fc6-4ae13ca468b1 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:40.205944 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 67/133] 10.222.0.37 () {56 vars in 1122 bytes} [Wed Dec 29 20:35:40 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:40.211160 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3a270-d50d-468c-9c8e-7bc4757dabcb admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:40.222415 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3a270-d50d-468c-9c8e-7bc4757dabcb admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:40.226347 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881da251-26ea-497d-a3d1-720e3b9aeed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:40.227166 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881da251-26ea-497d-a3d1-720e3b9aeed2 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:40.227462 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881da251-26ea-497d-a3d1-720e3b9aeed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:40.227750 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881da251-26ea-497d-a3d1-720e3b9aeed2 admin admin] PATH_INFO: `/v3/users/03328de5575045b39a05fe986384adab` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:40.228840 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881da251-26ea-497d-a3d1-720e3b9aeed2 admin admin] RBAC: Authorizing `identity:get_user(user_id=03328de5575045b39a05fe986384adab)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:40.256601 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881da251-26ea-497d-a3d1-720e3b9aeed2 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:40.258043 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 67/134] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:35:40 2021] GET /identity/v3/users/03328de5575045b39a05fe986384adab => generated 275 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:40.263193 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24321051-aa8b-4cf0-8fc6-4ae13ca468b1 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:40.273394 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24321051-aa8b-4cf0-8fc6-4ae13ca468b1 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:40.277271 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5713fe5-aeae-4388-9233-44a40ba75702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:40.277833 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5713fe5-aeae-4388-9233-44a40ba75702 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:40.278127 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5713fe5-aeae-4388-9233-44a40ba75702 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:40.278411 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5713fe5-aeae-4388-9233-44a40ba75702 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:40.286445 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5713fe5-aeae-4388-9233-44a40ba75702 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:40.311955 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5713fe5-aeae-4388-9233-44a40ba75702 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:40.321172 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 68/135] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:35:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:35:40.326307 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881da251-26ea-497d-a3d1-720e3b9aeed2 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:40.335884 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881da251-26ea-497d-a3d1-720e3b9aeed2 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:40.339788 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617579a-b918-436d-9d24-66735af1f2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:40.340542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617579a-b918-436d-9d24-66735af1f2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:40.340832 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617579a-b918-436d-9d24-66735af1f2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:40.341114 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617579a-b918-436d-9d24-66735af1f2b8 admin admin] PATH_INFO: `/v3/projects/d597e08c87414635a5cee6f44e4de1ec` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:40.342179 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617579a-b918-436d-9d24-66735af1f2b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=d597e08c87414635a5cee6f44e4de1ec)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:40.367867 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617579a-b918-436d-9d24-66735af1f2b8 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:40.369321 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 68/136] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:35:40 2021] GET /identity/v3/projects/d597e08c87414635a5cee6f44e4de1ec => generated 312 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:40.374623 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5713fe5-aeae-4388-9233-44a40ba75702 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:40.383698 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5713fe5-aeae-4388-9233-44a40ba75702 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:40.387618 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208d0d9-e633-47dd-90b0-145efdddecff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:40.388182 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208d0d9-e633-47dd-90b0-145efdddecff admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:40.388474 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208d0d9-e633-47dd-90b0-145efdddecff admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:40.388757 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208d0d9-e633-47dd-90b0-145efdddecff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:40.389527 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208d0d9-e633-47dd-90b0-145efdddecff admin admin] RBAC: Adding query filter params (role.id=b70e4a80dd884df58c908e9f9512f589, scope.project.id=d597e08c87414635a5cee6f44e4de1ec, user.id=03328de5575045b39a05fe986384adab) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:40.389831 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208d0d9-e633-47dd-90b0-145efdddecff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:40.415796 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208d0d9-e633-47dd-90b0-145efdddecff admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:40.420933 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 69/137] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:35:40 2021] GET /identity/v3/role_assignments?user.id=03328de5575045b39a05fe986384adab&scope.project.id=d597e08c87414635a5cee6f44e4de1ec&role.id=b70e4a80dd884df58c908e9f9512f589 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:42.328765 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2ebb8-5618-46ea-8c95-e0c5ad3efa8f None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:42.329248 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2ebb8-5618-46ea-8c95-e0c5ad3efa8f None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:42.329331 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2ebb8-5618-46ea-8c95-e0c5ad3efa8f None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:42.331030 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 69/138] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:35:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:35:42.336173 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755010d-b6f1-4174-ab49-f60e8e3daa55 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:42.336526 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755010d-b6f1-4174-ab49-f60e8e3daa55 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:42.336735 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755010d-b6f1-4174-ab49-f60e8e3daa55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:42.358262 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-1755010d-b6f1-4174-ab49-f60e8e3daa55 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:35:42.359957 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-1755010d-b6f1-4174-ab49-f60e8e3daa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:35:42.366371 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 70/139] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:35:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:35:42.387984 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2ebb8-5618-46ea-8c95-e0c5ad3efa8f None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:42.399264 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2ebb8-5618-46ea-8c95-e0c5ad3efa8f None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:42.403023 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e4350-7166-40a9-b10e-4bf87ddbcc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:42.403724 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e4350-7166-40a9-b10e-4bf87ddbcc96 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:42.404016 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e4350-7166-40a9-b10e-4bf87ddbcc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:42.404300 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e4350-7166-40a9-b10e-4bf87ddbcc96 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:42.415235 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e4350-7166-40a9-b10e-4bf87ddbcc96 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:35:42.421456 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-719e4350-7166-40a9-b10e-4bf87ddbcc96 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 29 20:35:42.423262 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 70/140] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:35:42 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:35:42.428504 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755010d-b6f1-4174-ab49-f60e8e3daa55 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:42.436774 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755010d-b6f1-4174-ab49-f60e8e3daa55 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:42.441250 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023b4c3-7625-4b14-abe5-7d38c2169989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:42.441829 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023b4c3-7625-4b14-abe5-7d38c2169989 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:42.442117 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023b4c3-7625-4b14-abe5-7d38c2169989 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:42.442398 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023b4c3-7625-4b14-abe5-7d38c2169989 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:42.443136 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023b4c3-7625-4b14-abe5-7d38c2169989 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:42.443435 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023b4c3-7625-4b14-abe5-7d38c2169989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:42.468484 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023b4c3-7625-4b14-abe5-7d38c2169989 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:42.477202 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 71/141] 10.222.0.37 () {56 vars in 1122 bytes} [Wed Dec 29 20:35:42 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:42.482394 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e4350-7166-40a9-b10e-4bf87ddbcc96 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:42.492923 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e4350-7166-40a9-b10e-4bf87ddbcc96 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:42.496757 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25276214-6d4d-483f-941a-2183db5baf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:42.497526 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25276214-6d4d-483f-941a-2183db5baf91 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:42.497821 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25276214-6d4d-483f-941a-2183db5baf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:42.498102 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25276214-6d4d-483f-941a-2183db5baf91 admin admin] PATH_INFO: `/v3/users/03328de5575045b39a05fe986384adab` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:42.499202 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25276214-6d4d-483f-941a-2183db5baf91 admin admin] RBAC: Authorizing `identity:get_user(user_id=03328de5575045b39a05fe986384adab)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:42.524844 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25276214-6d4d-483f-941a-2183db5baf91 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:42.526248 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 71/142] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:35:42 2021] GET /identity/v3/users/03328de5575045b39a05fe986384adab => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:42.531717 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023b4c3-7625-4b14-abe5-7d38c2169989 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:42.541026 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023b4c3-7625-4b14-abe5-7d38c2169989 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:42.544892 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096147b-28e3-4321-896e-4b1ca6f215a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:42.545652 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096147b-28e3-4321-896e-4b1ca6f215a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:42.545947 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096147b-28e3-4321-896e-4b1ca6f215a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:42.546233 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096147b-28e3-4321-896e-4b1ca6f215a3 admin admin] PATH_INFO: `/v3/projects/d597e08c87414635a5cee6f44e4de1ec` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:42.548216 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096147b-28e3-4321-896e-4b1ca6f215a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=d597e08c87414635a5cee6f44e4de1ec)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:42.580228 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096147b-28e3-4321-896e-4b1ca6f215a3 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:42.581698 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 72/143] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:35:42 2021] GET /identity/v3/projects/d597e08c87414635a5cee6f44e4de1ec => generated 312 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:42.586937 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25276214-6d4d-483f-941a-2183db5baf91 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:42.596551 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25276214-6d4d-483f-941a-2183db5baf91 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:42.600451 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244cc2b-49b3-4179-878b-2ba124907b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:42.601239 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244cc2b-49b3-4179-878b-2ba124907b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:42.601525 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244cc2b-49b3-4179-878b-2ba124907b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:42.601803 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244cc2b-49b3-4179-878b-2ba124907b80 admin admin] PATH_INFO: `/v3/projects/d597e08c87414635a5cee6f44e4de1ec/users/03328de5575045b39a05fe986384adab/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:42.603558 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244cc2b-49b3-4179-878b-2ba124907b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d597e08c87414635a5cee6f44e4de1ec, user_id=03328de5575045b39a05fe986384adab, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:42.630559 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244cc2b-49b3-4179-878b-2ba124907b80 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:42.642609 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 72/144] 10.222.0.37 () {58 vars in 1460 bytes} [Wed Dec 29 20:35:42 2021] PUT /identity/v3/projects/d597e08c87414635a5cee6f44e4de1ec/users/03328de5575045b39a05fe986384adab/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:35:44.545271 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15457c37-c4d7-46f7-aa34-b47928f61934 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:44.545783 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15457c37-c4d7-46f7-aa34-b47928f61934 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:44.545894 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15457c37-c4d7-46f7-aa34-b47928f61934 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:44.548260 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 73/145] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:35:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:35:44.553191 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56bdc9-5a3a-4698-8623-0970867a0367 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:44.553584 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56bdc9-5a3a-4698-8623-0970867a0367 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:44.553764 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56bdc9-5a3a-4698-8623-0970867a0367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:44.576256 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-eb56bdc9-5a3a-4698-8623-0970867a0367 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:35:44.577376 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-eb56bdc9-5a3a-4698-8623-0970867a0367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:35:44.641375 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 73/146] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:35:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:35:44.662764 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15457c37-c4d7-46f7-aa34-b47928f61934 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:44.674864 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15457c37-c4d7-46f7-aa34-b47928f61934 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:44.678583 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d9d35-79fa-46a1-9578-4cfd88e2b42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:44.679321 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d9d35-79fa-46a1-9578-4cfd88e2b42e admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:44.679613 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d9d35-79fa-46a1-9578-4cfd88e2b42e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:44.679897 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d9d35-79fa-46a1-9578-4cfd88e2b42e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:44.692029 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d9d35-79fa-46a1-9578-4cfd88e2b42e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:35:44.698499 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-a01d9d35-79fa-46a1-9578-4cfd88e2b42e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 29 20:35:44.699597 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 74/147] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:35:44 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:35:44.705727 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56bdc9-5a3a-4698-8623-0970867a0367 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:44.714216 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56bdc9-5a3a-4698-8623-0970867a0367 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:44.718112 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d372a3-d88b-4cbe-9b9e-2637baf0af20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:44.719339 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d372a3-d88b-4cbe-9b9e-2637baf0af20 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:44.719644 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d372a3-d88b-4cbe-9b9e-2637baf0af20 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:44.719928 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d372a3-d88b-4cbe-9b9e-2637baf0af20 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:44.720637 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d372a3-d88b-4cbe-9b9e-2637baf0af20 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:44.720938 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d372a3-d88b-4cbe-9b9e-2637baf0af20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:44.746360 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d372a3-d88b-4cbe-9b9e-2637baf0af20 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:44.755241 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 74/148] 10.222.0.37 () {56 vars in 1122 bytes} [Wed Dec 29 20:35:44 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:44.760709 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d9d35-79fa-46a1-9578-4cfd88e2b42e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:44.770408 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d9d35-79fa-46a1-9578-4cfd88e2b42e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:44.774376 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb09aa-7b2c-48f2-926d-3aab2e562eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:44.775190 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb09aa-7b2c-48f2-926d-3aab2e562eba admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:44.775482 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb09aa-7b2c-48f2-926d-3aab2e562eba admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:44.775767 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb09aa-7b2c-48f2-926d-3aab2e562eba admin admin] PATH_INFO: `/v3/users/03328de5575045b39a05fe986384adab` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:44.776833 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb09aa-7b2c-48f2-926d-3aab2e562eba admin admin] RBAC: Authorizing `identity:get_user(user_id=03328de5575045b39a05fe986384adab)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:44.802589 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb09aa-7b2c-48f2-926d-3aab2e562eba admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:44.803987 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 75/149] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:35:44 2021] GET /identity/v3/users/03328de5575045b39a05fe986384adab => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:44.809143 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d372a3-d88b-4cbe-9b9e-2637baf0af20 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:44.818855 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d372a3-d88b-4cbe-9b9e-2637baf0af20 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:44.822724 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b96b8-9b70-44f2-93c3-b8eb6a8ab9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:44.823292 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b96b8-9b70-44f2-93c3-b8eb6a8ab9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:44.823585 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b96b8-9b70-44f2-93c3-b8eb6a8ab9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:44.823871 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b96b8-9b70-44f2-93c3-b8eb6a8ab9e5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:44.832353 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b96b8-9b70-44f2-93c3-b8eb6a8ab9e5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:44.857626 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b96b8-9b70-44f2-93c3-b8eb6a8ab9e5 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:44.866325 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 75/150] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:35:44 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:35:44.871715 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb09aa-7b2c-48f2-926d-3aab2e562eba admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:44.881462 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb09aa-7b2c-48f2-926d-3aab2e562eba admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:44.885346 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d35ea-0198-46a7-9cf2-00b8b4fd99d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:44.886113 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d35ea-0198-46a7-9cf2-00b8b4fd99d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:44.886400 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d35ea-0198-46a7-9cf2-00b8b4fd99d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:44.886709 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d35ea-0198-46a7-9cf2-00b8b4fd99d7 admin admin] PATH_INFO: `/v3/projects/d597e08c87414635a5cee6f44e4de1ec` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:44.887762 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d35ea-0198-46a7-9cf2-00b8b4fd99d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=d597e08c87414635a5cee6f44e4de1ec)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:44.914017 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d35ea-0198-46a7-9cf2-00b8b4fd99d7 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:44.915519 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 76/151] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:35:44 2021] GET /identity/v3/projects/d597e08c87414635a5cee6f44e4de1ec => generated 312 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:44.920654 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b96b8-9b70-44f2-93c3-b8eb6a8ab9e5 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:44.929130 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b96b8-9b70-44f2-93c3-b8eb6a8ab9e5 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:44.933064 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b65f49-e204-4dcf-ac00-18dc00178a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:44.933628 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b65f49-e204-4dcf-ac00-18dc00178a1b admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:44.933920 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b65f49-e204-4dcf-ac00-18dc00178a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:44.934208 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b65f49-e204-4dcf-ac00-18dc00178a1b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:44.935019 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b65f49-e204-4dcf-ac00-18dc00178a1b admin admin] RBAC: Adding query filter params (role.id=b70e4a80dd884df58c908e9f9512f589, scope.project.id=d597e08c87414635a5cee6f44e4de1ec, user.id=03328de5575045b39a05fe986384adab) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:44.935325 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b65f49-e204-4dcf-ac00-18dc00178a1b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:44.962231 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b65f49-e204-4dcf-ac00-18dc00178a1b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:44.967735 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 76/152] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:35:44 2021] GET /identity/v3/role_assignments?user.id=03328de5575045b39a05fe986384adab&scope.project.id=d597e08c87414635a5cee6f44e4de1ec&role.id=b70e4a80dd884df58c908e9f9512f589 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:46.950615 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1528f-6e8e-46aa-9fe2-a6fca58ff9e5 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:46.951121 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1528f-6e8e-46aa-9fe2-a6fca58ff9e5 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:46.951202 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1528f-6e8e-46aa-9fe2-a6fca58ff9e5 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:46.952881 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 77/153] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:35:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:35:46.957860 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72ddf5-791f-4ba5-96b2-82d6e90f7c07 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:46.958262 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72ddf5-791f-4ba5-96b2-82d6e90f7c07 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:46.958427 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72ddf5-791f-4ba5-96b2-82d6e90f7c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:46.980585 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-1d72ddf5-791f-4ba5-96b2-82d6e90f7c07 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:35:46.981719 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-1d72ddf5-791f-4ba5-96b2-82d6e90f7c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:35:46.988812 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 77/154] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:35:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:35:47.010796 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1528f-6e8e-46aa-9fe2-a6fca58ff9e5 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:47.022009 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1528f-6e8e-46aa-9fe2-a6fca58ff9e5 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:47.025808 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81f190-b24e-4b24-b8ea-b87aa77a6282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:47.026858 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81f190-b24e-4b24-b8ea-b87aa77a6282 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:47.027150 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81f190-b24e-4b24-b8ea-b87aa77a6282 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:47.027432 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81f190-b24e-4b24-b8ea-b87aa77a6282 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:47.028469 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81f190-b24e-4b24-b8ea-b87aa77a6282 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:47.054673 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81f190-b24e-4b24-b8ea-b87aa77a6282 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:47.056102 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 78/155] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:35:47 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:47.061164 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72ddf5-791f-4ba5-96b2-82d6e90f7c07 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:47.069458 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72ddf5-791f-4ba5-96b2-82d6e90f7c07 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:47.073255 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c958a-a8eb-4b73-9b21-6ff56df4baf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:47.073824 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c958a-a8eb-4b73-9b21-6ff56df4baf6 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:47.074113 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c958a-a8eb-4b73-9b21-6ff56df4baf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:47.074395 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c958a-a8eb-4b73-9b21-6ff56df4baf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:47.075319 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c958a-a8eb-4b73-9b21-6ff56df4baf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:47.101006 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c958a-a8eb-4b73-9b21-6ff56df4baf6 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:47.127657 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 78/156] 10.222.0.37 () {60 vars in 1162 bytes} [Wed Dec 29 20:35:47 2021] POST /identity/v3/projects => generated 302 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:35:49.061146 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b28da-e265-4e53-b63a-7489f18f8fa7 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:49.061656 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b28da-e265-4e53-b63a-7489f18f8fa7 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:49.061744 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b28da-e265-4e53-b63a-7489f18f8fa7 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:49.063494 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 79/157] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:35:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:35:49.068417 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95618ff1-2aad-4a53-a9b7-75c5c72400e5 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:49.068774 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95618ff1-2aad-4a53-a9b7-75c5c72400e5 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:49.068988 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95618ff1-2aad-4a53-a9b7-75c5c72400e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:49.090977 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-95618ff1-2aad-4a53-a9b7-75c5c72400e5 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:35:49.092107 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-95618ff1-2aad-4a53-a9b7-75c5c72400e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:35:49.152995 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 79/158] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:35:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:35:49.176305 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b28da-e265-4e53-b63a-7489f18f8fa7 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:49.188193 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b28da-e265-4e53-b63a-7489f18f8fa7 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:49.192049 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cad397-8043-4297-8378-7f15127639bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:49.192761 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cad397-8043-4297-8378-7f15127639bd admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:49.193054 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cad397-8043-4297-8378-7f15127639bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:49.193336 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cad397-8043-4297-8378-7f15127639bd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:49.194394 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cad397-8043-4297-8378-7f15127639bd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:49.220748 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cad397-8043-4297-8378-7f15127639bd admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:49.222170 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 80/159] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:35:49 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:49.227108 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95618ff1-2aad-4a53-a9b7-75c5c72400e5 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:49.235726 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95618ff1-2aad-4a53-a9b7-75c5c72400e5 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:49.239565 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0af88a-c2ba-4331-b463-9e30e1cd0e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:49.240143 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0af88a-c2ba-4331-b463-9e30e1cd0e80 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:49.240430 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0af88a-c2ba-4331-b463-9e30e1cd0e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:49.240708 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0af88a-c2ba-4331-b463-9e30e1cd0e80 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:49.241350 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0af88a-c2ba-4331-b463-9e30e1cd0e80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:49.267582 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0af88a-c2ba-4331-b463-9e30e1cd0e80 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:49.285495 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 80/160] 10.222.0.37 () {60 vars in 1153 bytes} [Wed Dec 29 20:35:49 2021] POST /identity/v3/users => generated 283 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:35:51.229183 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78851982-5f81-400b-aeec-add95caba40b None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:51.229670 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78851982-5f81-400b-aeec-add95caba40b None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:51.229670 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78851982-5f81-400b-aeec-add95caba40b None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:51.231360 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 81/161] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:35:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:35:51.236356 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1101253-5181-45d9-8fb9-49dd143055ca None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:51.236731 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1101253-5181-45d9-8fb9-49dd143055ca None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:51.236922 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1101253-5181-45d9-8fb9-49dd143055ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:51.258728 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-a1101253-5181-45d9-8fb9-49dd143055ca None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:35:51.259847 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-a1101253-5181-45d9-8fb9-49dd143055ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:35:51.266922 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 81/162] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:35:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:35:51.289486 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78851982-5f81-400b-aeec-add95caba40b None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:51.300858 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78851982-5f81-400b-aeec-add95caba40b None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:51.304630 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c15b52-d87e-4795-8f8e-dd09d7cec79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:51.305328 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c15b52-d87e-4795-8f8e-dd09d7cec79c admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:51.305616 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c15b52-d87e-4795-8f8e-dd09d7cec79c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:51.305899 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c15b52-d87e-4795-8f8e-dd09d7cec79c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:51.317554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c15b52-d87e-4795-8f8e-dd09d7cec79c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:35:51.323860 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-62c15b52-d87e-4795-8f8e-dd09d7cec79c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 29 20:35:51.325174 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 82/163] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:35:51 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:35:51.331217 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1101253-5181-45d9-8fb9-49dd143055ca None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:51.339545 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1101253-5181-45d9-8fb9-49dd143055ca None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:51.343391 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8ee57-b982-45d5-84e7-bfbebf7d5b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:51.344956 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8ee57-b982-45d5-84e7-bfbebf7d5b28 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:51.345241 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8ee57-b982-45d5-84e7-bfbebf7d5b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:51.345524 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8ee57-b982-45d5-84e7-bfbebf7d5b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:51.346223 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8ee57-b982-45d5-84e7-bfbebf7d5b28 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:51.346512 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8ee57-b982-45d5-84e7-bfbebf7d5b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:51.371858 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8ee57-b982-45d5-84e7-bfbebf7d5b28 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:51.380157 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 82/164] 10.222.0.37 () {56 vars in 1122 bytes} [Wed Dec 29 20:35:51 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:51.385459 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c15b52-d87e-4795-8f8e-dd09d7cec79c admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:51.394947 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c15b52-d87e-4795-8f8e-dd09d7cec79c admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:51.398797 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa190f-34d2-4203-8daf-7bb2b199db06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:51.399561 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa190f-34d2-4203-8daf-7bb2b199db06 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:51.399845 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa190f-34d2-4203-8daf-7bb2b199db06 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:51.400123 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa190f-34d2-4203-8daf-7bb2b199db06 admin admin] PATH_INFO: `/v3/users/c1dc0b7952b54de1b266b6801d6b597d` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:51.418382 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa190f-34d2-4203-8daf-7bb2b199db06 admin admin] RBAC: Authorizing `identity:get_user(user_id=c1dc0b7952b54de1b266b6801d6b597d)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:51.444092 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa190f-34d2-4203-8daf-7bb2b199db06 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:51.445548 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 83/165] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:35:51 2021] GET /identity/v3/users/c1dc0b7952b54de1b266b6801d6b597d => generated 283 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:51.450809 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8ee57-b982-45d5-84e7-bfbebf7d5b28 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:51.460649 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8ee57-b982-45d5-84e7-bfbebf7d5b28 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:51.464493 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d40b7e-d49b-48ef-8098-dd2b953d47ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:51.465056 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d40b7e-d49b-48ef-8098-dd2b953d47ef admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:51.465346 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d40b7e-d49b-48ef-8098-dd2b953d47ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:51.465626 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d40b7e-d49b-48ef-8098-dd2b953d47ef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:51.473648 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d40b7e-d49b-48ef-8098-dd2b953d47ef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:51.498856 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d40b7e-d49b-48ef-8098-dd2b953d47ef admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:51.507703 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 83/166] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:35:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:35:51.512688 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa190f-34d2-4203-8daf-7bb2b199db06 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:51.522310 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa190f-34d2-4203-8daf-7bb2b199db06 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:51.526098 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088e2c1-a135-4570-a86d-6ad922351e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:51.526887 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088e2c1-a135-4570-a86d-6ad922351e99 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:51.527176 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088e2c1-a135-4570-a86d-6ad922351e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:51.527454 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088e2c1-a135-4570-a86d-6ad922351e99 admin admin] PATH_INFO: `/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:51.528503 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088e2c1-a135-4570-a86d-6ad922351e99 admin admin] RBAC: Authorizing `identity:get_project(project_id=ec6ddf70badd4a05b97ea6835eaebc90)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:51.553972 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088e2c1-a135-4570-a86d-6ad922351e99 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:51.555482 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 84/167] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:35:51 2021] GET /identity/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:51.560838 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d40b7e-d49b-48ef-8098-dd2b953d47ef admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:51.569747 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d40b7e-d49b-48ef-8098-dd2b953d47ef admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:51.573577 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5216db-ec23-4f3f-86f0-4b4ef7181426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:51.574134 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5216db-ec23-4f3f-86f0-4b4ef7181426 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:51.574424 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5216db-ec23-4f3f-86f0-4b4ef7181426 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:51.574988 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5216db-ec23-4f3f-86f0-4b4ef7181426 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:51.575760 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5216db-ec23-4f3f-86f0-4b4ef7181426 admin admin] RBAC: Adding query filter params (role.id=b70e4a80dd884df58c908e9f9512f589, scope.project.id=ec6ddf70badd4a05b97ea6835eaebc90, user.id=c1dc0b7952b54de1b266b6801d6b597d) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:51.576066 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5216db-ec23-4f3f-86f0-4b4ef7181426 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:51.602484 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5216db-ec23-4f3f-86f0-4b4ef7181426 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:51.610236 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 84/168] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:35:51 2021] GET /identity/v3/role_assignments?user.id=c1dc0b7952b54de1b266b6801d6b597d&scope.project.id=ec6ddf70badd4a05b97ea6835eaebc90&role.id=b70e4a80dd884df58c908e9f9512f589 => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:53.514918 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1950a49-dbae-49a0-84ee-ce8d11f2626f None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:53.515538 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1950a49-dbae-49a0-84ee-ce8d11f2626f None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:53.515538 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1950a49-dbae-49a0-84ee-ce8d11f2626f None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:53.517160 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 85/169] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:35:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:35:53.522329 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8a288-7bd5-4a6f-b8a8-ed568a387df8 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:53.522737 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8a288-7bd5-4a6f-b8a8-ed568a387df8 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:53.522919 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8a288-7bd5-4a6f-b8a8-ed568a387df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:53.544787 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-59a8a288-7bd5-4a6f-b8a8-ed568a387df8 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:35:53.545919 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-59a8a288-7bd5-4a6f-b8a8-ed568a387df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:35:53.553115 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 85/170] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:35:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:35:53.574523 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1950a49-dbae-49a0-84ee-ce8d11f2626f None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:53.586015 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1950a49-dbae-49a0-84ee-ce8d11f2626f None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:53.589790 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1419a-d2e7-41be-8058-8a60b87f84a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:53.590487 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1419a-d2e7-41be-8058-8a60b87f84a8 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:53.590817 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1419a-d2e7-41be-8058-8a60b87f84a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:53.591101 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1419a-d2e7-41be-8058-8a60b87f84a8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:53.601997 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1419a-d2e7-41be-8058-8a60b87f84a8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:35:53.608282 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-2cd1419a-d2e7-41be-8058-8a60b87f84a8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 29 20:35:53.609824 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 86/171] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:35:53 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:35:53.615143 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8a288-7bd5-4a6f-b8a8-ed568a387df8 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:53.623492 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8a288-7bd5-4a6f-b8a8-ed568a387df8 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:53.627888 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3eafc-fa24-4eac-96f1-83fea7ce2c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:53.628467 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3eafc-fa24-4eac-96f1-83fea7ce2c15 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:53.628753 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3eafc-fa24-4eac-96f1-83fea7ce2c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:53.629033 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3eafc-fa24-4eac-96f1-83fea7ce2c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:53.629735 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3eafc-fa24-4eac-96f1-83fea7ce2c15 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:53.630030 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3eafc-fa24-4eac-96f1-83fea7ce2c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:53.655028 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3eafc-fa24-4eac-96f1-83fea7ce2c15 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:53.663686 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 86/172] 10.222.0.37 () {56 vars in 1122 bytes} [Wed Dec 29 20:35:53 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:53.669038 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1419a-d2e7-41be-8058-8a60b87f84a8 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:53.680129 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1419a-d2e7-41be-8058-8a60b87f84a8 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:53.683938 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031a16e-6400-4d98-8db9-fc403d6badea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:53.684702 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031a16e-6400-4d98-8db9-fc403d6badea admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:53.684987 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031a16e-6400-4d98-8db9-fc403d6badea admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:53.685262 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031a16e-6400-4d98-8db9-fc403d6badea admin admin] PATH_INFO: `/v3/users/c1dc0b7952b54de1b266b6801d6b597d` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:53.686319 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031a16e-6400-4d98-8db9-fc403d6badea admin admin] RBAC: Authorizing `identity:get_user(user_id=c1dc0b7952b54de1b266b6801d6b597d)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:53.712644 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031a16e-6400-4d98-8db9-fc403d6badea admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:53.714059 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 87/173] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:35:53 2021] GET /identity/v3/users/c1dc0b7952b54de1b266b6801d6b597d => generated 283 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:53.719755 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3eafc-fa24-4eac-96f1-83fea7ce2c15 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:53.728694 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3eafc-fa24-4eac-96f1-83fea7ce2c15 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:53.732491 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c47171-9429-4497-881a-db6da10b6738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:53.733261 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c47171-9429-4497-881a-db6da10b6738 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:53.733550 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c47171-9429-4497-881a-db6da10b6738 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:53.733831 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c47171-9429-4497-881a-db6da10b6738 admin admin] PATH_INFO: `/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:53.735490 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c47171-9429-4497-881a-db6da10b6738 admin admin] RBAC: Authorizing `identity:get_project(project_id=ec6ddf70badd4a05b97ea6835eaebc90)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:53.761153 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c47171-9429-4497-881a-db6da10b6738 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:53.762617 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 87/174] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:35:53 2021] GET /identity/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:53.767763 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031a16e-6400-4d98-8db9-fc403d6badea admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:53.776589 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031a16e-6400-4d98-8db9-fc403d6badea admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:53.780362 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8365a6-b505-4710-b0cb-0f0b920c897d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:53.781702 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8365a6-b505-4710-b0cb-0f0b920c897d admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:53.781983 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8365a6-b505-4710-b0cb-0f0b920c897d admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:53.782257 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8365a6-b505-4710-b0cb-0f0b920c897d admin admin] PATH_INFO: `/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90/users/c1dc0b7952b54de1b266b6801d6b597d/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:53.783997 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8365a6-b505-4710-b0cb-0f0b920c897d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec6ddf70badd4a05b97ea6835eaebc90, user_id=c1dc0b7952b54de1b266b6801d6b597d, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:53.810244 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8365a6-b505-4710-b0cb-0f0b920c897d admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:53.822705 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 88/175] 10.222.0.37 () {58 vars in 1460 bytes} [Wed Dec 29 20:35:53 2021] PUT /identity/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90/users/c1dc0b7952b54de1b266b6801d6b597d/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:35:55.761508 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23722a40-58f4-47e8-9a7d-efa13b71f745 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:55.762044 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23722a40-58f4-47e8-9a7d-efa13b71f745 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:55.762044 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23722a40-58f4-47e8-9a7d-efa13b71f745 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:55.763752 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 88/176] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:35:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:35:55.769378 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de1c67-48c5-4438-a95b-6ebbdfd524bc None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:55.769777 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de1c67-48c5-4438-a95b-6ebbdfd524bc None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:55.769941 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de1c67-48c5-4438-a95b-6ebbdfd524bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:55.792199 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-39de1c67-48c5-4438-a95b-6ebbdfd524bc None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:35:55.793323 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-39de1c67-48c5-4438-a95b-6ebbdfd524bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:35:55.854811 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 89/177] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:35:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:35:55.876907 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23722a40-58f4-47e8-9a7d-efa13b71f745 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:55.888203 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23722a40-58f4-47e8-9a7d-efa13b71f745 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:55.892480 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fa54e-206c-4b51-8f06-5df79e386180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:55.893180 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fa54e-206c-4b51-8f06-5df79e386180 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:55.893470 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fa54e-206c-4b51-8f06-5df79e386180 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:55.893750 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fa54e-206c-4b51-8f06-5df79e386180 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:55.905346 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791fa54e-206c-4b51-8f06-5df79e386180 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:35:55.912467 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-791fa54e-206c-4b51-8f06-5df79e386180 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 29 20:35:55.913615 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 89/178] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:35:55 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:35:55.919055 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de1c67-48c5-4438-a95b-6ebbdfd524bc None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:55.927572 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de1c67-48c5-4438-a95b-6ebbdfd524bc None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:55.931393 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1334660-1692-4d4d-8563-e94ada11390f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:55.931975 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1334660-1692-4d4d-8563-e94ada11390f admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:55.932265 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1334660-1692-4d4d-8563-e94ada11390f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:55.932546 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1334660-1692-4d4d-8563-e94ada11390f admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:55.933251 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1334660-1692-4d4d-8563-e94ada11390f admin admin] RBAC: Adding query filter params (name=member) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:55.933549 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1334660-1692-4d4d-8563-e94ada11390f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:55.959740 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1334660-1692-4d4d-8563-e94ada11390f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:55.968064 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 90/179] 10.222.0.37 () {56 vars in 1122 bytes} [Wed Dec 29 20:35:55 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:55.974006 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fa54e-206c-4b51-8f06-5df79e386180 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:55.983053 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fa54e-206c-4b51-8f06-5df79e386180 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:55.986903 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f924af-874e-47e5-876f-e3783bc41920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:55.987668 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f924af-874e-47e5-876f-e3783bc41920 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:55.987956 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f924af-874e-47e5-876f-e3783bc41920 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:55.988236 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f924af-874e-47e5-876f-e3783bc41920 admin admin] PATH_INFO: `/v3/users/c1dc0b7952b54de1b266b6801d6b597d` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:55.989317 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f924af-874e-47e5-876f-e3783bc41920 admin admin] RBAC: Authorizing `identity:get_user(user_id=c1dc0b7952b54de1b266b6801d6b597d)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:56.016813 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f924af-874e-47e5-876f-e3783bc41920 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:56.018182 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 90/180] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:35:55 2021] GET /identity/v3/users/c1dc0b7952b54de1b266b6801d6b597d => generated 283 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:56.023068 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1334660-1692-4d4d-8563-e94ada11390f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:56.032234 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1334660-1692-4d4d-8563-e94ada11390f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:56.036023 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f8dc7-0919-4afe-b6fb-d4015d9fbd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:56.036604 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f8dc7-0919-4afe-b6fb-d4015d9fbd05 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:56.036889 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f8dc7-0919-4afe-b6fb-d4015d9fbd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:56.037169 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f8dc7-0919-4afe-b6fb-d4015d9fbd05 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:56.044572 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f8dc7-0919-4afe-b6fb-d4015d9fbd05 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:56.070230 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f8dc7-0919-4afe-b6fb-d4015d9fbd05 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:56.079254 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 91/181] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:35:56 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:35:56.084368 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f924af-874e-47e5-876f-e3783bc41920 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:56.093368 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f924af-874e-47e5-876f-e3783bc41920 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:56.097091 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6454ca4-3647-46a7-b3ad-17eb22282fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:56.097848 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6454ca4-3647-46a7-b3ad-17eb22282fbf admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:56.098135 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6454ca4-3647-46a7-b3ad-17eb22282fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:56.098413 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6454ca4-3647-46a7-b3ad-17eb22282fbf admin admin] PATH_INFO: `/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:56.099498 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6454ca4-3647-46a7-b3ad-17eb22282fbf admin admin] RBAC: Authorizing `identity:get_project(project_id=ec6ddf70badd4a05b97ea6835eaebc90)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:56.126609 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6454ca4-3647-46a7-b3ad-17eb22282fbf admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:56.128110 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 91/182] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:35:56 2021] GET /identity/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:56.133779 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f8dc7-0919-4afe-b6fb-d4015d9fbd05 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:56.142835 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f8dc7-0919-4afe-b6fb-d4015d9fbd05 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:56.146635 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907b72d-938e-49c5-9a5e-edc0233b7e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:56.147219 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907b72d-938e-49c5-9a5e-edc0233b7e7d admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:56.147507 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907b72d-938e-49c5-9a5e-edc0233b7e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:56.147787 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907b72d-938e-49c5-9a5e-edc0233b7e7d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:56.148551 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907b72d-938e-49c5-9a5e-edc0233b7e7d admin admin] RBAC: Adding query filter params (role.id=b70e4a80dd884df58c908e9f9512f589, scope.project.id=ec6ddf70badd4a05b97ea6835eaebc90, user.id=c1dc0b7952b54de1b266b6801d6b597d) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:56.148853 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907b72d-938e-49c5-9a5e-edc0233b7e7d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:56.174153 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907b72d-938e-49c5-9a5e-edc0233b7e7d admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:56.179725 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 92/183] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:35:56 2021] GET /identity/v3/role_assignments?user.id=c1dc0b7952b54de1b266b6801d6b597d&scope.project.id=ec6ddf70badd4a05b97ea6835eaebc90&role.id=b70e4a80dd884df58c908e9f9512f589 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:58.161958 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbea54-86f1-472b-9751-dc751b2ea7bd None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:58.162452 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbea54-86f1-472b-9751-dc751b2ea7bd None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:58.162452 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbea54-86f1-472b-9751-dc751b2ea7bd None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:58.164136 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 92/184] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:35:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:35:58.169151 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376747f-d08f-40f8-b3cd-1b54e87a2c0f None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:58.169566 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376747f-d08f-40f8-b3cd-1b54e87a2c0f None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:58.169721 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376747f-d08f-40f8-b3cd-1b54e87a2c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:58.192676 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-1376747f-d08f-40f8-b3cd-1b54e87a2c0f None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:35:58.193805 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-1376747f-d08f-40f8-b3cd-1b54e87a2c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:35:58.200685 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 93/185] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:35:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:35:58.222737 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbea54-86f1-472b-9751-dc751b2ea7bd None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:58.234545 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbea54-86f1-472b-9751-dc751b2ea7bd None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:58.238309 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ebb05-55c7-47bc-8e23-68c6be21f37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:58.239054 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ebb05-55c7-47bc-8e23-68c6be21f37e admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:58.239346 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ebb05-55c7-47bc-8e23-68c6be21f37e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:58.239633 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ebb05-55c7-47bc-8e23-68c6be21f37e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:58.250702 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ebb05-55c7-47bc-8e23-68c6be21f37e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:35:58.256879 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-b96ebb05-55c7-47bc-8e23-68c6be21f37e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:35:58.257937 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 93/186] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:35:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:35:58.263096 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376747f-d08f-40f8-b3cd-1b54e87a2c0f None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:58.271736 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376747f-d08f-40f8-b3cd-1b54e87a2c0f None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:58.275542 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1dabb1-a900-4aaf-a733-7416413b5cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:58.276120 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dabb1-a900-4aaf-a733-7416413b5cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:58.276406 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dabb1-a900-4aaf-a733-7416413b5cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:58.276688 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dabb1-a900-4aaf-a733-7416413b5cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:58.277385 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1dabb1-a900-4aaf-a733-7416413b5cc8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:58.277681 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1dabb1-a900-4aaf-a733-7416413b5cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:58.303849 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1dabb1-a900-4aaf-a733-7416413b5cc8 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:58.312230 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 94/187] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:35:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:58.317557 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ebb05-55c7-47bc-8e23-68c6be21f37e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:58.327672 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ebb05-55c7-47bc-8e23-68c6be21f37e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:58.331422 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26a7ea-f7cf-4207-8920-48f93410532c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:58.332181 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26a7ea-f7cf-4207-8920-48f93410532c admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:58.332463 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26a7ea-f7cf-4207-8920-48f93410532c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:58.332738 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26a7ea-f7cf-4207-8920-48f93410532c admin admin] PATH_INFO: `/v3/users/a36a939159da4f1da66be9e4aad8ddd2` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:58.333795 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26a7ea-f7cf-4207-8920-48f93410532c admin admin] RBAC: Authorizing `identity:get_user(user_id=a36a939159da4f1da66be9e4aad8ddd2)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:58.360427 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26a7ea-f7cf-4207-8920-48f93410532c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:58.361833 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 94/188] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:35:58 2021] GET /identity/v3/users/a36a939159da4f1da66be9e4aad8ddd2 => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:58.366754 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1dabb1-a900-4aaf-a733-7416413b5cc8 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:58.375878 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1dabb1-a900-4aaf-a733-7416413b5cc8 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:58.379643 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2631f1-91a6-415e-8fe5-b8d1f7ab16f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:58.380199 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2631f1-91a6-415e-8fe5-b8d1f7ab16f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:58.380487 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2631f1-91a6-415e-8fe5-b8d1f7ab16f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:58.380769 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2631f1-91a6-415e-8fe5-b8d1f7ab16f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:58.388217 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2631f1-91a6-415e-8fe5-b8d1f7ab16f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:58.413780 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2631f1-91a6-415e-8fe5-b8d1f7ab16f7 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:58.422538 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 95/189] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:35:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:35:58.427475 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26a7ea-f7cf-4207-8920-48f93410532c admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:58.436271 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26a7ea-f7cf-4207-8920-48f93410532c admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:58.440041 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce99a07-8b41-49e3-afcd-c879ca642075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:58.440787 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce99a07-8b41-49e3-afcd-c879ca642075 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:58.441068 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce99a07-8b41-49e3-afcd-c879ca642075 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:58.441343 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce99a07-8b41-49e3-afcd-c879ca642075 admin admin] PATH_INFO: `/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:58.442382 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce99a07-8b41-49e3-afcd-c879ca642075 admin admin] RBAC: Authorizing `identity:get_project(project_id=ec6ddf70badd4a05b97ea6835eaebc90)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:58.468665 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce99a07-8b41-49e3-afcd-c879ca642075 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:58.470122 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 95/190] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:35:58 2021] GET /identity/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:35:58.475224 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2631f1-91a6-415e-8fe5-b8d1f7ab16f7 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:35:58.483334 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2631f1-91a6-415e-8fe5-b8d1f7ab16f7 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:35:58.487771 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492a584-1f4b-4dbd-bef6-7c3d6a0bbba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:35:58.488333 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492a584-1f4b-4dbd-bef6-7c3d6a0bbba6 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:35:58.488620 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492a584-1f4b-4dbd-bef6-7c3d6a0bbba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:35:58.488905 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492a584-1f4b-4dbd-bef6-7c3d6a0bbba6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:35:58.489675 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492a584-1f4b-4dbd-bef6-7c3d6a0bbba6 admin admin] RBAC: Adding query filter params (role.id=e66e6a94ba014fd193b851ceb92695ae, scope.project.id=ec6ddf70badd4a05b97ea6835eaebc90, user.id=a36a939159da4f1da66be9e4aad8ddd2) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:35:58.489980 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492a584-1f4b-4dbd-bef6-7c3d6a0bbba6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:35:58.515115 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492a584-1f4b-4dbd-bef6-7c3d6a0bbba6 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:35:58.520396 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 96/191] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:35:58 2021] GET /identity/v3/role_assignments?user.id=a36a939159da4f1da66be9e4aad8ddd2&scope.project.id=ec6ddf70badd4a05b97ea6835eaebc90&role.id=e66e6a94ba014fd193b851ceb92695ae => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:00.442493 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78007d85-3230-4b28-b7dc-195fe970270e None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:00.443093 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78007d85-3230-4b28-b7dc-195fe970270e None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:00.443093 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78007d85-3230-4b28-b7dc-195fe970270e None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:00.444755 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 96/192] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:36:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:36:00.450338 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775da4e-f38d-40ab-888f-2b31ae267f49 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:00.450767 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775da4e-f38d-40ab-888f-2b31ae267f49 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:00.451056 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775da4e-f38d-40ab-888f-2b31ae267f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:00.473402 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-2775da4e-f38d-40ab-888f-2b31ae267f49 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:36:00.474533 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-2775da4e-f38d-40ab-888f-2b31ae267f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:36:00.481022 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 97/193] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:36:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:36:00.501825 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78007d85-3230-4b28-b7dc-195fe970270e None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:00.513049 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78007d85-3230-4b28-b7dc-195fe970270e None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:00.516846 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8da4c-263f-4549-8623-590f6a3be87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:00.517537 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8da4c-263f-4549-8623-590f6a3be87f admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:00.517823 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8da4c-263f-4549-8623-590f6a3be87f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:00.518103 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8da4c-263f-4549-8623-590f6a3be87f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:00.528856 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8da4c-263f-4549-8623-590f6a3be87f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:36:00.535661 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-f5e8da4c-263f-4549-8623-590f6a3be87f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:36:00.536707 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 97/194] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:36:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:00.542040 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775da4e-f38d-40ab-888f-2b31ae267f49 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:00.550972 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775da4e-f38d-40ab-888f-2b31ae267f49 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:00.554791 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01947903-2951-4772-9e18-48ab0174587b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:00.555371 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01947903-2951-4772-9e18-48ab0174587b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:00.555658 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01947903-2951-4772-9e18-48ab0174587b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:00.555939 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01947903-2951-4772-9e18-48ab0174587b admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:00.556638 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01947903-2951-4772-9e18-48ab0174587b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:00.556934 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01947903-2951-4772-9e18-48ab0174587b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:00.582420 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01947903-2951-4772-9e18-48ab0174587b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:00.590735 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 98/195] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:36:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:00.596365 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8da4c-263f-4549-8623-590f6a3be87f admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:00.606296 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8da4c-263f-4549-8623-590f6a3be87f admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:00.610781 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405de85-9dbc-4180-b244-4f140d1a0a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:00.611546 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405de85-9dbc-4180-b244-4f140d1a0a26 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:00.611833 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405de85-9dbc-4180-b244-4f140d1a0a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:00.612115 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405de85-9dbc-4180-b244-4f140d1a0a26 admin admin] PATH_INFO: `/v3/users/a36a939159da4f1da66be9e4aad8ddd2` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:00.613179 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405de85-9dbc-4180-b244-4f140d1a0a26 admin admin] RBAC: Authorizing `identity:get_user(user_id=a36a939159da4f1da66be9e4aad8ddd2)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:00.638428 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405de85-9dbc-4180-b244-4f140d1a0a26 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:00.639906 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 98/196] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:36:00 2021] GET /identity/v3/users/a36a939159da4f1da66be9e4aad8ddd2 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:00.644712 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01947903-2951-4772-9e18-48ab0174587b admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:00.653641 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01947903-2951-4772-9e18-48ab0174587b admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:00.657938 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e8b01-96dc-47fb-9d4a-bba1b67f37b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:00.658728 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e8b01-96dc-47fb-9d4a-bba1b67f37b2 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:00.659021 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e8b01-96dc-47fb-9d4a-bba1b67f37b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:00.659304 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e8b01-96dc-47fb-9d4a-bba1b67f37b2 admin admin] PATH_INFO: `/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:00.660354 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e8b01-96dc-47fb-9d4a-bba1b67f37b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=ec6ddf70badd4a05b97ea6835eaebc90)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:00.686447 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e8b01-96dc-47fb-9d4a-bba1b67f37b2 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:00.688023 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 99/197] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:36:00 2021] GET /identity/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:00.693270 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405de85-9dbc-4180-b244-4f140d1a0a26 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:00.702754 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405de85-9dbc-4180-b244-4f140d1a0a26 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:00.706531 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b62d1-c787-48b6-aa41-835e602d2ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:00.707361 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b62d1-c787-48b6-aa41-835e602d2ca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:00.707647 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b62d1-c787-48b6-aa41-835e602d2ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:00.707927 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b62d1-c787-48b6-aa41-835e602d2ca0 admin admin] PATH_INFO: `/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90/users/a36a939159da4f1da66be9e4aad8ddd2/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:00.710012 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b62d1-c787-48b6-aa41-835e602d2ca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec6ddf70badd4a05b97ea6835eaebc90, user_id=a36a939159da4f1da66be9e4aad8ddd2, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:00.742309 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b62d1-c787-48b6-aa41-835e602d2ca0 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:00.754510 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 99/198] 10.222.0.37 () {58 vars in 1460 bytes} [Wed Dec 29 20:36:00 2021] PUT /identity/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90/users/a36a939159da4f1da66be9e4aad8ddd2/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:36:02.746740 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34745e9-0841-4cc2-8472-9f66498ef13a None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:02.747254 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34745e9-0841-4cc2-8472-9f66498ef13a None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:02.747359 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34745e9-0841-4cc2-8472-9f66498ef13a None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:02.748985 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 100/199] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:36:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:36:02.754728 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad864e-bcee-4280-bec2-c18886eb01fb None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:02.755125 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad864e-bcee-4280-bec2-c18886eb01fb None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:02.755309 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad864e-bcee-4280-bec2-c18886eb01fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:02.777703 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-4cad864e-bcee-4280-bec2-c18886eb01fb None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:36:02.778867 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-4cad864e-bcee-4280-bec2-c18886eb01fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:36:02.843556 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 100/200] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:36:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:36:02.865157 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34745e9-0841-4cc2-8472-9f66498ef13a None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:02.877015 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34745e9-0841-4cc2-8472-9f66498ef13a None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:02.880760 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d653a-feb7-461e-9771-16c7daac67dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:02.881461 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d653a-feb7-461e-9771-16c7daac67dc admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:02.881743 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d653a-feb7-461e-9771-16c7daac67dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:02.882016 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d653a-feb7-461e-9771-16c7daac67dc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:02.894556 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d653a-feb7-461e-9771-16c7daac67dc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:36:02.900694 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-1d1d653a-feb7-461e-9771-16c7daac67dc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:36:02.901755 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 101/201] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:36:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:02.907146 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad864e-bcee-4280-bec2-c18886eb01fb None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:02.915492 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad864e-bcee-4280-bec2-c18886eb01fb None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:02.919281 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ec83a-4598-40fc-b06e-33fcfaf54fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:02.919857 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ec83a-4598-40fc-b06e-33fcfaf54fda admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:02.920140 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ec83a-4598-40fc-b06e-33fcfaf54fda admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:02.920418 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ec83a-4598-40fc-b06e-33fcfaf54fda admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:02.921127 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ec83a-4598-40fc-b06e-33fcfaf54fda admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:02.921419 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ec83a-4598-40fc-b06e-33fcfaf54fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:02.947144 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ec83a-4598-40fc-b06e-33fcfaf54fda admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:02.956329 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 101/202] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:36:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:02.961477 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d653a-feb7-461e-9771-16c7daac67dc admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:02.970396 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d653a-feb7-461e-9771-16c7daac67dc admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:02.974193 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106e3c9-8501-4f90-816d-9b33528bb91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:02.974993 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106e3c9-8501-4f90-816d-9b33528bb91e admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:02.975281 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106e3c9-8501-4f90-816d-9b33528bb91e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:02.975560 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106e3c9-8501-4f90-816d-9b33528bb91e admin admin] PATH_INFO: `/v3/users/a36a939159da4f1da66be9e4aad8ddd2` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:02.976611 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106e3c9-8501-4f90-816d-9b33528bb91e admin admin] RBAC: Authorizing `identity:get_user(user_id=a36a939159da4f1da66be9e4aad8ddd2)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:03.002463 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106e3c9-8501-4f90-816d-9b33528bb91e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:03.003840 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 102/203] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:36:02 2021] GET /identity/v3/users/a36a939159da4f1da66be9e4aad8ddd2 => generated 247 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:03.008625 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ec83a-4598-40fc-b06e-33fcfaf54fda admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:03.018053 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ec83a-4598-40fc-b06e-33fcfaf54fda admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:03.021794 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb85d43-42a7-49b4-aed6-8dcd9f1d487e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:03.022342 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb85d43-42a7-49b4-aed6-8dcd9f1d487e admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:03.022629 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb85d43-42a7-49b4-aed6-8dcd9f1d487e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:03.022937 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb85d43-42a7-49b4-aed6-8dcd9f1d487e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:03.030232 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb85d43-42a7-49b4-aed6-8dcd9f1d487e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:03.055349 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb85d43-42a7-49b4-aed6-8dcd9f1d487e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:03.064158 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 102/204] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:36:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:36:03.069261 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106e3c9-8501-4f90-816d-9b33528bb91e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:03.079177 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106e3c9-8501-4f90-816d-9b33528bb91e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:03.082908 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57044f-8096-459b-a31b-0d63ce176692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:03.083655 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57044f-8096-459b-a31b-0d63ce176692 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:03.083940 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57044f-8096-459b-a31b-0d63ce176692 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:03.084217 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57044f-8096-459b-a31b-0d63ce176692 admin admin] PATH_INFO: `/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:03.085525 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57044f-8096-459b-a31b-0d63ce176692 admin admin] RBAC: Authorizing `identity:get_project(project_id=ec6ddf70badd4a05b97ea6835eaebc90)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:03.111297 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57044f-8096-459b-a31b-0d63ce176692 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:03.112766 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 103/205] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:36:03 2021] GET /identity/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:03.117827 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb85d43-42a7-49b4-aed6-8dcd9f1d487e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:03.126009 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb85d43-42a7-49b4-aed6-8dcd9f1d487e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:03.130263 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932b330-b287-4df0-b954-dcc3b11eb0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:03.130844 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932b330-b287-4df0-b954-dcc3b11eb0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:03.131130 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932b330-b287-4df0-b954-dcc3b11eb0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:03.131406 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932b330-b287-4df0-b954-dcc3b11eb0d7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:03.132159 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932b330-b287-4df0-b954-dcc3b11eb0d7 admin admin] RBAC: Adding query filter params (role.id=e66e6a94ba014fd193b851ceb92695ae, scope.project.id=ec6ddf70badd4a05b97ea6835eaebc90, user.id=a36a939159da4f1da66be9e4aad8ddd2) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:03.132455 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932b330-b287-4df0-b954-dcc3b11eb0d7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:03.157655 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932b330-b287-4df0-b954-dcc3b11eb0d7 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:03.163174 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 103/206] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:36:03 2021] GET /identity/v3/role_assignments?user.id=a36a939159da4f1da66be9e4aad8ddd2&scope.project.id=ec6ddf70badd4a05b97ea6835eaebc90&role.id=e66e6a94ba014fd193b851ceb92695ae => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:05.116490 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1f08e-1403-4616-9375-1570723ba028 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:05.116985 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1f08e-1403-4616-9375-1570723ba028 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:05.116985 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1f08e-1403-4616-9375-1570723ba028 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:05.118625 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 104/207] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:36:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:36:05.123908 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbca11d-9529-4994-a010-7114128ccad0 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:05.124866 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbca11d-9529-4994-a010-7114128ccad0 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:05.124998 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbca11d-9529-4994-a010-7114128ccad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:05.147272 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-bfbca11d-9529-4994-a010-7114128ccad0 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:36:05.148406 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-bfbca11d-9529-4994-a010-7114128ccad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:36:05.155013 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 104/208] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:36:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:36:05.177056 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1f08e-1403-4616-9375-1570723ba028 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:05.189208 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1f08e-1403-4616-9375-1570723ba028 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:05.192968 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada174c-b562-44ce-8c96-654e4e7e312e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:05.193677 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada174c-b562-44ce-8c96-654e4e7e312e admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:05.193962 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada174c-b562-44ce-8c96-654e4e7e312e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:05.194240 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada174c-b562-44ce-8c96-654e4e7e312e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:05.205930 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada174c-b562-44ce-8c96-654e4e7e312e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:36:05.212412 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-5ada174c-b562-44ce-8c96-654e4e7e312e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 29 20:36:05.213460 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 105/209] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:36:05 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:05.219059 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbca11d-9529-4994-a010-7114128ccad0 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:05.227425 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbca11d-9529-4994-a010-7114128ccad0 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:05.231265 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306d0c9-6e6e-4367-93c6-eb41b1fc2fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:05.231849 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306d0c9-6e6e-4367-93c6-eb41b1fc2fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:05.232138 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306d0c9-6e6e-4367-93c6-eb41b1fc2fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:05.232417 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306d0c9-6e6e-4367-93c6-eb41b1fc2fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:05.233124 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306d0c9-6e6e-4367-93c6-eb41b1fc2fd8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:05.233666 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306d0c9-6e6e-4367-93c6-eb41b1fc2fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:05.259870 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306d0c9-6e6e-4367-93c6-eb41b1fc2fd8 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:05.268788 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 105/210] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:36:05 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:05.273945 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada174c-b562-44ce-8c96-654e4e7e312e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:05.285341 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada174c-b562-44ce-8c96-654e4e7e312e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:05.289125 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34701b33-7764-49ea-b0d6-05a82cb5d578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:05.289887 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34701b33-7764-49ea-b0d6-05a82cb5d578 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:05.290170 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34701b33-7764-49ea-b0d6-05a82cb5d578 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:05.290451 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34701b33-7764-49ea-b0d6-05a82cb5d578 admin admin] PATH_INFO: `/v3/users/c1dc0b7952b54de1b266b6801d6b597d` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:05.291532 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34701b33-7764-49ea-b0d6-05a82cb5d578 admin admin] RBAC: Authorizing `identity:get_user(user_id=c1dc0b7952b54de1b266b6801d6b597d)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:05.317306 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34701b33-7764-49ea-b0d6-05a82cb5d578 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:05.318865 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 106/211] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:36:05 2021] GET /identity/v3/users/c1dc0b7952b54de1b266b6801d6b597d => generated 283 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:05.323797 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306d0c9-6e6e-4367-93c6-eb41b1fc2fd8 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:05.333732 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306d0c9-6e6e-4367-93c6-eb41b1fc2fd8 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:05.337527 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194bd82-3035-4f7e-98ec-fbe27422949c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:05.338155 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194bd82-3035-4f7e-98ec-fbe27422949c admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:05.338444 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194bd82-3035-4f7e-98ec-fbe27422949c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:05.338761 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194bd82-3035-4f7e-98ec-fbe27422949c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:05.346262 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194bd82-3035-4f7e-98ec-fbe27422949c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:05.371974 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194bd82-3035-4f7e-98ec-fbe27422949c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:05.380946 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 106/212] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:36:05 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:36:05.385839 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34701b33-7764-49ea-b0d6-05a82cb5d578 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:05.394733 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34701b33-7764-49ea-b0d6-05a82cb5d578 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:05.398422 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258c5ce-ce37-4d40-a00b-f37c42353fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:05.399196 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258c5ce-ce37-4d40-a00b-f37c42353fbc admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:05.399477 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258c5ce-ce37-4d40-a00b-f37c42353fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:05.399753 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258c5ce-ce37-4d40-a00b-f37c42353fbc admin admin] PATH_INFO: `/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:05.400780 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258c5ce-ce37-4d40-a00b-f37c42353fbc admin admin] RBAC: Authorizing `identity:get_project(project_id=ec6ddf70badd4a05b97ea6835eaebc90)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:05.426439 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258c5ce-ce37-4d40-a00b-f37c42353fbc admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:05.427920 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 107/213] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:36:05 2021] GET /identity/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90 => generated 302 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:05.432967 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194bd82-3035-4f7e-98ec-fbe27422949c admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:05.441704 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194bd82-3035-4f7e-98ec-fbe27422949c admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:05.445534 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34bc8e-64df-4e6d-9d53-147e1c9850de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:05.446091 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34bc8e-64df-4e6d-9d53-147e1c9850de admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:05.446380 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34bc8e-64df-4e6d-9d53-147e1c9850de admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:05.446676 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34bc8e-64df-4e6d-9d53-147e1c9850de admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:05.447457 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34bc8e-64df-4e6d-9d53-147e1c9850de admin admin] RBAC: Adding query filter params (role.id=5f70396837d2484ca16563634aa8d2a2, scope.project.id=ec6ddf70badd4a05b97ea6835eaebc90, user.id=c1dc0b7952b54de1b266b6801d6b597d) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:05.447760 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34bc8e-64df-4e6d-9d53-147e1c9850de admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:05.473398 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34bc8e-64df-4e6d-9d53-147e1c9850de admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:05.478497 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 107/214] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:36:05 2021] GET /identity/v3/role_assignments?user.id=c1dc0b7952b54de1b266b6801d6b597d&scope.project.id=ec6ddf70badd4a05b97ea6835eaebc90&role.id=5f70396837d2484ca16563634aa8d2a2 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:07.393714 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090e328-1422-481d-bf2d-b51441da91a2 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:07.394218 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090e328-1422-481d-bf2d-b51441da91a2 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:07.394299 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090e328-1422-481d-bf2d-b51441da91a2 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:07.395965 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 108/215] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:36:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:36:07.401074 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ea609-02a9-4b3b-8523-259afe3d3bc6 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:07.401481 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ea609-02a9-4b3b-8523-259afe3d3bc6 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:07.401627 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ea609-02a9-4b3b-8523-259afe3d3bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:07.424837 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-b16ea609-02a9-4b3b-8523-259afe3d3bc6 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:36:07.425978 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-b16ea609-02a9-4b3b-8523-259afe3d3bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:36:07.432398 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 108/216] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:36:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:36:07.453553 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090e328-1422-481d-bf2d-b51441da91a2 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:07.464805 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090e328-1422-481d-bf2d-b51441da91a2 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:07.469305 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c1067-b650-4c5a-8654-0bac452abdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:07.470008 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c1067-b650-4c5a-8654-0bac452abdb6 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:07.470295 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c1067-b650-4c5a-8654-0bac452abdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:07.470573 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c1067-b650-4c5a-8654-0bac452abdb6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:07.481382 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c1067-b650-4c5a-8654-0bac452abdb6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:36:07.488753 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-637c1067-b650-4c5a-8654-0bac452abdb6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 29 20:36:07.489805 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 109/217] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:36:07 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:07.495119 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ea609-02a9-4b3b-8523-259afe3d3bc6 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:07.503529 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ea609-02a9-4b3b-8523-259afe3d3bc6 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:07.507345 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d221755-e32c-422e-8be7-7b65bb3384c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:07.507920 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d221755-e32c-422e-8be7-7b65bb3384c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:07.508206 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d221755-e32c-422e-8be7-7b65bb3384c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:07.508484 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d221755-e32c-422e-8be7-7b65bb3384c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:07.509178 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d221755-e32c-422e-8be7-7b65bb3384c4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:07.509471 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d221755-e32c-422e-8be7-7b65bb3384c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:07.534940 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d221755-e32c-422e-8be7-7b65bb3384c4 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:07.543042 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 109/218] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:36:07 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:07.548267 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c1067-b650-4c5a-8654-0bac452abdb6 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:07.558216 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c1067-b650-4c5a-8654-0bac452abdb6 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:07.562513 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba39dfd-70c1-4581-b1d9-de1ed7a26c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:07.563340 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba39dfd-70c1-4581-b1d9-de1ed7a26c89 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:07.563801 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba39dfd-70c1-4581-b1d9-de1ed7a26c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:07.564082 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba39dfd-70c1-4581-b1d9-de1ed7a26c89 admin admin] PATH_INFO: `/v3/users/c1dc0b7952b54de1b266b6801d6b597d` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:07.565145 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba39dfd-70c1-4581-b1d9-de1ed7a26c89 admin admin] RBAC: Authorizing `identity:get_user(user_id=c1dc0b7952b54de1b266b6801d6b597d)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:07.591236 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba39dfd-70c1-4581-b1d9-de1ed7a26c89 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:07.592655 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 110/219] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:36:07 2021] GET /identity/v3/users/c1dc0b7952b54de1b266b6801d6b597d => generated 283 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:07.597828 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d221755-e32c-422e-8be7-7b65bb3384c4 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:07.606841 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d221755-e32c-422e-8be7-7b65bb3384c4 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:07.611155 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0b94a-b0f7-44a0-ad65-f6f0da2f9f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:07.611923 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0b94a-b0f7-44a0-ad65-f6f0da2f9f16 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:07.612213 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0b94a-b0f7-44a0-ad65-f6f0da2f9f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:07.612495 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0b94a-b0f7-44a0-ad65-f6f0da2f9f16 admin admin] PATH_INFO: `/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:07.613567 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0b94a-b0f7-44a0-ad65-f6f0da2f9f16 admin admin] RBAC: Authorizing `identity:get_project(project_id=ec6ddf70badd4a05b97ea6835eaebc90)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:07.639637 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0b94a-b0f7-44a0-ad65-f6f0da2f9f16 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:07.641260 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 110/220] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:36:07 2021] GET /identity/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:07.646222 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba39dfd-70c1-4581-b1d9-de1ed7a26c89 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:07.655238 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba39dfd-70c1-4581-b1d9-de1ed7a26c89 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:07.659215 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90087555-0166-4023-b176-ffe4cfc9b20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:07.659998 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90087555-0166-4023-b176-ffe4cfc9b20c admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:07.660284 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90087555-0166-4023-b176-ffe4cfc9b20c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:07.660562 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90087555-0166-4023-b176-ffe4cfc9b20c admin admin] PATH_INFO: `/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90/users/c1dc0b7952b54de1b266b6801d6b597d/roles/5f70396837d2484ca16563634aa8d2a2` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:07.662493 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90087555-0166-4023-b176-ffe4cfc9b20c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec6ddf70badd4a05b97ea6835eaebc90, user_id=c1dc0b7952b54de1b266b6801d6b597d, role_id=5f70396837d2484ca16563634aa8d2a2)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:07.689730 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90087555-0166-4023-b176-ffe4cfc9b20c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:07.703174 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 111/221] 10.222.0.37 () {58 vars in 1460 bytes} [Wed Dec 29 20:36:07 2021] PUT /identity/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90/users/c1dc0b7952b54de1b266b6801d6b597d/roles/5f70396837d2484ca16563634aa8d2a2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:36:09.616715 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f627d-3b85-4f7e-afe2-3264e33ee59e None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:09.617258 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f627d-3b85-4f7e-afe2-3264e33ee59e None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:09.617258 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f627d-3b85-4f7e-afe2-3264e33ee59e None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:09.618969 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 111/222] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:36:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:36:09.624576 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a5f74-1532-4c09-877d-c924d2e2181f None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:09.624945 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a5f74-1532-4c09-877d-c924d2e2181f None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:09.625180 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a5f74-1532-4c09-877d-c924d2e2181f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:09.647210 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-4c3a5f74-1532-4c09-877d-c924d2e2181f None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:36:09.648326 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-4c3a5f74-1532-4c09-877d-c924d2e2181f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:36:09.709418 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 112/223] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:36:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:36:09.730787 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f627d-3b85-4f7e-afe2-3264e33ee59e None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:09.742144 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f627d-3b85-4f7e-afe2-3264e33ee59e None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:09.745842 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68105f3a-d030-47b2-b2b5-ceffb4c28d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:09.746557 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68105f3a-d030-47b2-b2b5-ceffb4c28d9f admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:09.746896 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68105f3a-d030-47b2-b2b5-ceffb4c28d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:09.747177 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68105f3a-d030-47b2-b2b5-ceffb4c28d9f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:09.759772 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68105f3a-d030-47b2-b2b5-ceffb4c28d9f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:36:09.767103 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-68105f3a-d030-47b2-b2b5-ceffb4c28d9f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 29 20:36:09.768162 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 112/224] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:36:09 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:09.773441 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a5f74-1532-4c09-877d-c924d2e2181f None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:09.781915 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a5f74-1532-4c09-877d-c924d2e2181f None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:09.785756 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab42c7a-2212-4bd9-b6f8-394eb8c3d22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:09.786332 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab42c7a-2212-4bd9-b6f8-394eb8c3d22c admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:09.786616 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab42c7a-2212-4bd9-b6f8-394eb8c3d22c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:09.786945 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab42c7a-2212-4bd9-b6f8-394eb8c3d22c admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:09.787645 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab42c7a-2212-4bd9-b6f8-394eb8c3d22c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:09.787941 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab42c7a-2212-4bd9-b6f8-394eb8c3d22c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:09.813464 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab42c7a-2212-4bd9-b6f8-394eb8c3d22c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:09.821604 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 113/225] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:36:09 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:09.827096 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68105f3a-d030-47b2-b2b5-ceffb4c28d9f admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:09.836699 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68105f3a-d030-47b2-b2b5-ceffb4c28d9f admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:09.840644 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2d1ec-9780-4175-9194-32b776354bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:09.841493 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2d1ec-9780-4175-9194-32b776354bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:09.841848 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2d1ec-9780-4175-9194-32b776354bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:09.842192 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2d1ec-9780-4175-9194-32b776354bb6 admin admin] PATH_INFO: `/v3/users/c1dc0b7952b54de1b266b6801d6b597d` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:09.843432 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2d1ec-9780-4175-9194-32b776354bb6 admin admin] RBAC: Authorizing `identity:get_user(user_id=c1dc0b7952b54de1b266b6801d6b597d)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:09.869798 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2d1ec-9780-4175-9194-32b776354bb6 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:09.871253 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 113/226] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:36:09 2021] GET /identity/v3/users/c1dc0b7952b54de1b266b6801d6b597d => generated 283 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:09.877071 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab42c7a-2212-4bd9-b6f8-394eb8c3d22c admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:09.886268 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab42c7a-2212-4bd9-b6f8-394eb8c3d22c admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:09.890109 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ffbea-2679-4f67-bfcb-807d01d29757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:09.890684 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ffbea-2679-4f67-bfcb-807d01d29757 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:09.890985 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ffbea-2679-4f67-bfcb-807d01d29757 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:09.891268 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ffbea-2679-4f67-bfcb-807d01d29757 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:09.898711 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ffbea-2679-4f67-bfcb-807d01d29757 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:09.924306 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ffbea-2679-4f67-bfcb-807d01d29757 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:09.932505 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 114/227] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:36:09 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:36:09.938319 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2d1ec-9780-4175-9194-32b776354bb6 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:09.947293 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2d1ec-9780-4175-9194-32b776354bb6 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:09.951392 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb58d94-b084-458c-9b0f-29ba295d6d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:09.952369 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb58d94-b084-458c-9b0f-29ba295d6d51 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:09.952663 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb58d94-b084-458c-9b0f-29ba295d6d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:09.953234 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb58d94-b084-458c-9b0f-29ba295d6d51 admin admin] PATH_INFO: `/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:09.954304 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb58d94-b084-458c-9b0f-29ba295d6d51 admin admin] RBAC: Authorizing `identity:get_project(project_id=ec6ddf70badd4a05b97ea6835eaebc90)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:09.980113 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb58d94-b084-458c-9b0f-29ba295d6d51 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:09.981587 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 114/228] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:36:09 2021] GET /identity/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:09.987330 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ffbea-2679-4f67-bfcb-807d01d29757 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:09.995552 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ffbea-2679-4f67-bfcb-807d01d29757 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:10.000273 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa828e-bbd7-455e-97ba-798ee36b0502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:10.000827 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa828e-bbd7-455e-97ba-798ee36b0502 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:10.001119 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa828e-bbd7-455e-97ba-798ee36b0502 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:10.001398 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa828e-bbd7-455e-97ba-798ee36b0502 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:10.002163 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa828e-bbd7-455e-97ba-798ee36b0502 admin admin] RBAC: Adding query filter params (role.id=5f70396837d2484ca16563634aa8d2a2, scope.project.id=ec6ddf70badd4a05b97ea6835eaebc90, user.id=c1dc0b7952b54de1b266b6801d6b597d) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:10.002465 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa828e-bbd7-455e-97ba-798ee36b0502 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:10.027604 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa828e-bbd7-455e-97ba-798ee36b0502 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:10.033424 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 115/229] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:36:09 2021] GET /identity/v3/role_assignments?user.id=c1dc0b7952b54de1b266b6801d6b597d&scope.project.id=ec6ddf70badd4a05b97ea6835eaebc90&role.id=5f70396837d2484ca16563634aa8d2a2 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:12.003484 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8614117-85cc-4e55-925f-dd78826aa601 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:12.004010 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8614117-85cc-4e55-925f-dd78826aa601 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:12.004098 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8614117-85cc-4e55-925f-dd78826aa601 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:12.005689 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 115/230] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:36:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:36:12.010671 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db347e67-1a0d-45a3-b6f3-8d25ed60aaaf None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:12.011055 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db347e67-1a0d-45a3-b6f3-8d25ed60aaaf None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:12.011254 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db347e67-1a0d-45a3-b6f3-8d25ed60aaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:12.033687 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-db347e67-1a0d-45a3-b6f3-8d25ed60aaaf None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:36:12.034843 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-db347e67-1a0d-45a3-b6f3-8d25ed60aaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:36:12.041359 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 116/231] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:36:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:36:12.063684 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8614117-85cc-4e55-925f-dd78826aa601 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:12.075162 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8614117-85cc-4e55-925f-dd78826aa601 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:12.079469 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9042cb-f27a-40de-9679-91a9a66c803c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:12.080161 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9042cb-f27a-40de-9679-91a9a66c803c admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:12.080444 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9042cb-f27a-40de-9679-91a9a66c803c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:12.080719 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9042cb-f27a-40de-9679-91a9a66c803c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:12.081755 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9042cb-f27a-40de-9679-91a9a66c803c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:12.107445 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9042cb-f27a-40de-9679-91a9a66c803c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:12.109091 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 116/232] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:36:12 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:12.114182 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db347e67-1a0d-45a3-b6f3-8d25ed60aaaf None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:12.122569 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db347e67-1a0d-45a3-b6f3-8d25ed60aaaf None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:12.126468 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111dec7-8b58-40ea-ac44-c594aebb65e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:12.127081 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111dec7-8b58-40ea-ac44-c594aebb65e1 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:12.127372 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111dec7-8b58-40ea-ac44-c594aebb65e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:12.127654 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111dec7-8b58-40ea-ac44-c594aebb65e1 admin admin] PATH_INFO: `/v3/groups` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:12.128277 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111dec7-8b58-40ea-ac44-c594aebb65e1 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:12.153058 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING py.warnings [None req-f111dec7-8b58-40ea-ac44-c594aebb65e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:36:12.153058 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: warnings.warn(msg) Dec 29 20:36:12.153058 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: Dec 29 20:36:12.154216 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111dec7-8b58-40ea-ac44-c594aebb65e1 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:12.167982 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 117/233] 10.222.0.37 () {60 vars in 1155 bytes} [Wed Dec 29 20:36:12 2021] POST /identity/v3/groups => generated 229 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:36:14.123371 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f42d8a-7742-454c-8b5c-735d7cf17b25 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:14.123860 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f42d8a-7742-454c-8b5c-735d7cf17b25 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:14.123860 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f42d8a-7742-454c-8b5c-735d7cf17b25 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:14.125516 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 117/234] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:36:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:36:14.130720 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17002f8-6197-4d85-9993-0fbdc6bf097b None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:14.131135 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17002f8-6197-4d85-9993-0fbdc6bf097b None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:14.131288 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17002f8-6197-4d85-9993-0fbdc6bf097b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:14.153065 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-f17002f8-6197-4d85-9993-0fbdc6bf097b None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:36:14.154186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-f17002f8-6197-4d85-9993-0fbdc6bf097b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:36:14.161534 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 118/235] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:36:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:36:14.183664 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f42d8a-7742-454c-8b5c-735d7cf17b25 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:14.195066 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f42d8a-7742-454c-8b5c-735d7cf17b25 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:14.198797 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392246c-b017-40dd-bd14-f3b6ae9ddff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:14.199495 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392246c-b017-40dd-bd14-f3b6ae9ddff3 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:14.200036 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392246c-b017-40dd-bd14-f3b6ae9ddff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:14.200316 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392246c-b017-40dd-bd14-f3b6ae9ddff3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:14.201357 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392246c-b017-40dd-bd14-f3b6ae9ddff3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:14.227249 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392246c-b017-40dd-bd14-f3b6ae9ddff3 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:14.228653 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 118/236] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:36:14 2021] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:14.234345 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17002f8-6197-4d85-9993-0fbdc6bf097b None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:14.242789 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17002f8-6197-4d85-9993-0fbdc6bf097b None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:14.246612 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4dd9c-afbb-4d06-978d-ff8ba57559c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:14.247214 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4dd9c-afbb-4d06-978d-ff8ba57559c0 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:14.247500 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4dd9c-afbb-4d06-978d-ff8ba57559c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:14.247780 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4dd9c-afbb-4d06-978d-ff8ba57559c0 admin admin] PATH_INFO: `/v3/groups` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:14.248397 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4dd9c-afbb-4d06-978d-ff8ba57559c0 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:14.273969 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4dd9c-afbb-4d06-978d-ff8ba57559c0 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:14.288514 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 119/237] 10.222.0.37 () {60 vars in 1155 bytes} [Wed Dec 29 20:36:14 2021] POST /identity/v3/groups => generated 226 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:36:16.216850 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dd11c-58d1-40ba-b9e2-1f4088c4da76 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:16.217363 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dd11c-58d1-40ba-b9e2-1f4088c4da76 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:16.217363 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dd11c-58d1-40ba-b9e2-1f4088c4da76 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:16.219573 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 119/238] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:36:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:36:16.224536 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43373a49-0a58-4446-b16b-130f6a40bb41 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:16.224904 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43373a49-0a58-4446-b16b-130f6a40bb41 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:16.225103 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43373a49-0a58-4446-b16b-130f6a40bb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:16.246740 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-43373a49-0a58-4446-b16b-130f6a40bb41 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:36:16.247850 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-43373a49-0a58-4446-b16b-130f6a40bb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:36:16.254924 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 120/239] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:36:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:36:16.277108 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935dd11c-58d1-40ba-b9e2-1f4088c4da76 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:16.289054 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935dd11c-58d1-40ba-b9e2-1f4088c4da76 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:16.292719 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5715c1d-0bfd-4185-8c5b-e1f3fa1a1a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:16.293415 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5715c1d-0bfd-4185-8c5b-e1f3fa1a1a38 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:16.293697 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5715c1d-0bfd-4185-8c5b-e1f3fa1a1a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:16.293974 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5715c1d-0bfd-4185-8c5b-e1f3fa1a1a38 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:16.305728 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5715c1d-0bfd-4185-8c5b-e1f3fa1a1a38 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:36:16.312734 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-d5715c1d-0bfd-4185-8c5b-e1f3fa1a1a38 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 29 20:36:16.313786 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 120/240] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:36:16 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:16.319104 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43373a49-0a58-4446-b16b-130f6a40bb41 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:16.328426 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43373a49-0a58-4446-b16b-130f6a40bb41 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:16.332183 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac3dcc-83e7-4620-818f-a9a83622af28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:16.332760 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac3dcc-83e7-4620-818f-a9a83622af28 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:16.333045 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac3dcc-83e7-4620-818f-a9a83622af28 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:16.333323 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac3dcc-83e7-4620-818f-a9a83622af28 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:16.334017 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac3dcc-83e7-4620-818f-a9a83622af28 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:16.334309 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac3dcc-83e7-4620-818f-a9a83622af28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:16.359453 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac3dcc-83e7-4620-818f-a9a83622af28 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:16.367708 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 121/241] 10.222.0.37 () {56 vars in 1122 bytes} [Wed Dec 29 20:36:16 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:16.372857 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5715c1d-0bfd-4185-8c5b-e1f3fa1a1a38 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:16.382396 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5715c1d-0bfd-4185-8c5b-e1f3fa1a1a38 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:16.386122 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938c0a4-b762-4058-b93c-2602d002af31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:16.386696 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938c0a4-b762-4058-b93c-2602d002af31 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:16.386986 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938c0a4-b762-4058-b93c-2602d002af31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:16.387265 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938c0a4-b762-4058-b93c-2602d002af31 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:16.394893 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938c0a4-b762-4058-b93c-2602d002af31 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:16.421197 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938c0a4-b762-4058-b93c-2602d002af31 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:16.429303 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 121/242] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:36:16 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:36:16.434222 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac3dcc-83e7-4620-818f-a9a83622af28 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:16.443180 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac3dcc-83e7-4620-818f-a9a83622af28 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:16.447151 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81821718-0789-4a25-ab93-bce072f8108e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:16.447924 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81821718-0789-4a25-ab93-bce072f8108e admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:16.448220 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81821718-0789-4a25-ab93-bce072f8108e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:16.448503 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81821718-0789-4a25-ab93-bce072f8108e admin admin] PATH_INFO: `/v3/projects/10a6996925de4b25877e75bb73e7bd71` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:16.449821 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81821718-0789-4a25-ab93-bce072f8108e admin admin] RBAC: Authorizing `identity:get_project(project_id=10a6996925de4b25877e75bb73e7bd71)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:16.476251 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81821718-0789-4a25-ab93-bce072f8108e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:16.477686 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 122/243] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:36:16 2021] GET /identity/v3/projects/10a6996925de4b25877e75bb73e7bd71 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:16.482450 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938c0a4-b762-4058-b93c-2602d002af31 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:16.491360 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938c0a4-b762-4058-b93c-2602d002af31 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:16.495146 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa987f-fc23-49c4-9d32-24bca39f9bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:16.495888 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa987f-fc23-49c4-9d32-24bca39f9bcf admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:16.496168 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa987f-fc23-49c4-9d32-24bca39f9bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:16.496439 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa987f-fc23-49c4-9d32-24bca39f9bcf admin admin] PATH_INFO: `/v3/groups/a021b04f8412475ebc928368825f381d` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:16.501323 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa987f-fc23-49c4-9d32-24bca39f9bcf admin admin] RBAC: Authorizing `identity:get_group(group_id=a021b04f8412475ebc928368825f381d)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:16.526197 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING py.warnings [None req-59aa987f-fc23-49c4-9d32-24bca39f9bcf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:36:16.526197 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: warnings.warn(msg) Dec 29 20:36:16.526197 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: Dec 29 20:36:16.527370 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa987f-fc23-49c4-9d32-24bca39f9bcf admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:16.528780 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 122/244] 10.222.0.37 () {56 vars in 1201 bytes} [Wed Dec 29 20:36:16 2021] GET /identity/v3/groups/a021b04f8412475ebc928368825f381d => generated 226 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:36:16.534384 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81821718-0789-4a25-ab93-bce072f8108e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:16.543337 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81821718-0789-4a25-ab93-bce072f8108e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:16.547850 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54487e-95b9-4f8d-a4e3-ea801b8d5b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:16.548406 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54487e-95b9-4f8d-a4e3-ea801b8d5b19 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:16.548699 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54487e-95b9-4f8d-a4e3-ea801b8d5b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:16.548982 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54487e-95b9-4f8d-a4e3-ea801b8d5b19 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:16.549747 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54487e-95b9-4f8d-a4e3-ea801b8d5b19 admin admin] RBAC: Adding query filter params (group.id=a021b04f8412475ebc928368825f381d, role.id=b70e4a80dd884df58c908e9f9512f589, scope.project.id=10a6996925de4b25877e75bb73e7bd71) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:16.550049 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54487e-95b9-4f8d-a4e3-ea801b8d5b19 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:16.575417 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54487e-95b9-4f8d-a4e3-ea801b8d5b19 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:16.581066 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 123/245] 10.222.0.37 () {56 vars in 1397 bytes} [Wed Dec 29 20:36:16 2021] GET /identity/v3/role_assignments?group.id=a021b04f8412475ebc928368825f381d&scope.project.id=10a6996925de4b25877e75bb73e7bd71&role.id=b70e4a80dd884df58c908e9f9512f589 => generated 260 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:18.511225 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ba1e8-b81f-4b87-a520-86d0dd840cd5 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:18.511725 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ba1e8-b81f-4b87-a520-86d0dd840cd5 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:18.511805 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ba1e8-b81f-4b87-a520-86d0dd840cd5 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:18.513455 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 123/246] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:36:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:36:18.519221 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa058f47-f478-4628-a14a-31389fe97bd9 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:18.519648 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa058f47-f478-4628-a14a-31389fe97bd9 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:18.519782 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa058f47-f478-4628-a14a-31389fe97bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:18.541475 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-fa058f47-f478-4628-a14a-31389fe97bd9 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:36:18.542584 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-fa058f47-f478-4628-a14a-31389fe97bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:36:18.549297 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 124/247] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:36:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:36:18.570770 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ba1e8-b81f-4b87-a520-86d0dd840cd5 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:18.582970 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ba1e8-b81f-4b87-a520-86d0dd840cd5 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:18.586679 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126da43-cf18-49ac-9b2d-54221a43c6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:18.587391 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126da43-cf18-49ac-9b2d-54221a43c6fb admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:18.587679 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126da43-cf18-49ac-9b2d-54221a43c6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:18.587961 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126da43-cf18-49ac-9b2d-54221a43c6fb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:18.599055 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126da43-cf18-49ac-9b2d-54221a43c6fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:36:18.605302 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-d126da43-cf18-49ac-9b2d-54221a43c6fb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 29 20:36:18.606358 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 124/248] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:36:18 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:18.611656 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa058f47-f478-4628-a14a-31389fe97bd9 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:18.620014 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa058f47-f478-4628-a14a-31389fe97bd9 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:18.624345 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45fbe9-6700-4ac6-aa5d-80e60a00dd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:18.624944 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45fbe9-6700-4ac6-aa5d-80e60a00dd67 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:18.625229 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45fbe9-6700-4ac6-aa5d-80e60a00dd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:18.625505 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45fbe9-6700-4ac6-aa5d-80e60a00dd67 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:18.626201 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45fbe9-6700-4ac6-aa5d-80e60a00dd67 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:18.626494 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45fbe9-6700-4ac6-aa5d-80e60a00dd67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:18.652278 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45fbe9-6700-4ac6-aa5d-80e60a00dd67 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:18.660903 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 125/249] 10.222.0.37 () {56 vars in 1122 bytes} [Wed Dec 29 20:36:18 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:18.666017 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126da43-cf18-49ac-9b2d-54221a43c6fb admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:18.676227 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126da43-cf18-49ac-9b2d-54221a43c6fb admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:18.680117 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3605afd-d64d-4d30-acbc-40f1ff1604e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:18.680877 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3605afd-d64d-4d30-acbc-40f1ff1604e4 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:18.681171 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3605afd-d64d-4d30-acbc-40f1ff1604e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:18.681452 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3605afd-d64d-4d30-acbc-40f1ff1604e4 admin admin] PATH_INFO: `/v3/groups/a021b04f8412475ebc928368825f381d` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:18.682507 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3605afd-d64d-4d30-acbc-40f1ff1604e4 admin admin] RBAC: Authorizing `identity:get_group(group_id=a021b04f8412475ebc928368825f381d)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:18.709767 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3605afd-d64d-4d30-acbc-40f1ff1604e4 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:18.711291 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 125/250] 10.222.0.37 () {56 vars in 1201 bytes} [Wed Dec 29 20:36:18 2021] GET /identity/v3/groups/a021b04f8412475ebc928368825f381d => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:18.716305 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45fbe9-6700-4ac6-aa5d-80e60a00dd67 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:18.725457 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45fbe9-6700-4ac6-aa5d-80e60a00dd67 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:18.729210 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f026834-439a-4223-bedc-1e8dd0c11a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:18.729972 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f026834-439a-4223-bedc-1e8dd0c11a3c admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:18.730257 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f026834-439a-4223-bedc-1e8dd0c11a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:18.730534 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f026834-439a-4223-bedc-1e8dd0c11a3c admin admin] PATH_INFO: `/v3/projects/10a6996925de4b25877e75bb73e7bd71` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:18.731610 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f026834-439a-4223-bedc-1e8dd0c11a3c admin admin] RBAC: Authorizing `identity:get_project(project_id=10a6996925de4b25877e75bb73e7bd71)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:18.762720 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f026834-439a-4223-bedc-1e8dd0c11a3c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:18.764167 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 126/251] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:36:18 2021] GET /identity/v3/projects/10a6996925de4b25877e75bb73e7bd71 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:18.770167 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3605afd-d64d-4d30-acbc-40f1ff1604e4 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:18.782455 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3605afd-d64d-4d30-acbc-40f1ff1604e4 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:18.786253 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6020335-10b9-4a7b-aae5-23922f568703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:18.787096 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6020335-10b9-4a7b-aae5-23922f568703 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:18.787384 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6020335-10b9-4a7b-aae5-23922f568703 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:18.787662 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6020335-10b9-4a7b-aae5-23922f568703 admin admin] PATH_INFO: `/v3/projects/10a6996925de4b25877e75bb73e7bd71/groups/a021b04f8412475ebc928368825f381d/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:18.789386 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6020335-10b9-4a7b-aae5-23922f568703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a6996925de4b25877e75bb73e7bd71, group_id=a021b04f8412475ebc928368825f381d, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:18.816036 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6020335-10b9-4a7b-aae5-23922f568703 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:18.832278 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 126/252] 10.222.0.37 () {58 vars in 1463 bytes} [Wed Dec 29 20:36:18 2021] PUT /identity/v3/projects/10a6996925de4b25877e75bb73e7bd71/groups/a021b04f8412475ebc928368825f381d/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:36:20.755686 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea41714-1d56-4f83-b03a-a4a93d6d9a6e None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:20.756198 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea41714-1d56-4f83-b03a-a4a93d6d9a6e None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:20.756279 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea41714-1d56-4f83-b03a-a4a93d6d9a6e None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:20.757925 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 127/253] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:36:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:36:20.762923 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318e835-7dc7-42bb-9ab6-542425795bc9 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:20.763311 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318e835-7dc7-42bb-9ab6-542425795bc9 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:20.763488 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318e835-7dc7-42bb-9ab6-542425795bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:20.785981 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-0318e835-7dc7-42bb-9ab6-542425795bc9 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:36:20.787137 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-0318e835-7dc7-42bb-9ab6-542425795bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:36:20.850179 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 127/254] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:36:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:36:20.872614 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea41714-1d56-4f83-b03a-a4a93d6d9a6e None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:20.884016 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea41714-1d56-4f83-b03a-a4a93d6d9a6e None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:20.887790 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a0446-c9c7-440c-8b45-299b07863134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:20.888496 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a0446-c9c7-440c-8b45-299b07863134 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:20.888785 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a0446-c9c7-440c-8b45-299b07863134 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:20.889069 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a0446-c9c7-440c-8b45-299b07863134 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:20.900750 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a0446-c9c7-440c-8b45-299b07863134 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:36:20.907927 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-a55a0446-c9c7-440c-8b45-299b07863134 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 29 20:36:20.909009 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 128/255] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:36:20 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:20.914421 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318e835-7dc7-42bb-9ab6-542425795bc9 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:20.923781 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318e835-7dc7-42bb-9ab6-542425795bc9 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:20.927623 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d886d1-f6e9-4257-bf11-77ea3351cd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:20.928214 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d886d1-f6e9-4257-bf11-77ea3351cd2e admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:20.928511 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d886d1-f6e9-4257-bf11-77ea3351cd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:20.928797 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d886d1-f6e9-4257-bf11-77ea3351cd2e admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:20.929510 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d886d1-f6e9-4257-bf11-77ea3351cd2e admin admin] RBAC: Adding query filter params (name=member) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:20.929812 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d886d1-f6e9-4257-bf11-77ea3351cd2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:20.955336 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d886d1-f6e9-4257-bf11-77ea3351cd2e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:20.963837 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 128/256] 10.222.0.37 () {56 vars in 1122 bytes} [Wed Dec 29 20:36:20 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:20.969605 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a0446-c9c7-440c-8b45-299b07863134 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:20.978673 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a0446-c9c7-440c-8b45-299b07863134 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:20.982450 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d9256-bcf4-4950-9c61-841adfac31e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:20.983698 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d9256-bcf4-4950-9c61-841adfac31e1 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:20.983989 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d9256-bcf4-4950-9c61-841adfac31e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:20.984271 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d9256-bcf4-4950-9c61-841adfac31e1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:20.991817 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d9256-bcf4-4950-9c61-841adfac31e1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:21.017041 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d9256-bcf4-4950-9c61-841adfac31e1 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:21.025245 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 129/257] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:36:20 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:36:21.030829 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d886d1-f6e9-4257-bf11-77ea3351cd2e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:21.039749 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d886d1-f6e9-4257-bf11-77ea3351cd2e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:21.043566 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8909f9b-93d3-40ab-820b-61be4a0b8feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:21.044333 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8909f9b-93d3-40ab-820b-61be4a0b8feb admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:21.044623 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8909f9b-93d3-40ab-820b-61be4a0b8feb admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:21.044906 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8909f9b-93d3-40ab-820b-61be4a0b8feb admin admin] PATH_INFO: `/v3/projects/10a6996925de4b25877e75bb73e7bd71` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:21.046603 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8909f9b-93d3-40ab-820b-61be4a0b8feb admin admin] RBAC: Authorizing `identity:get_project(project_id=10a6996925de4b25877e75bb73e7bd71)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:21.072480 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8909f9b-93d3-40ab-820b-61be4a0b8feb admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:21.073964 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 129/258] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:36:21 2021] GET /identity/v3/projects/10a6996925de4b25877e75bb73e7bd71 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:36:21.079725 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d9256-bcf4-4950-9c61-841adfac31e1 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:21.087961 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d9256-bcf4-4950-9c61-841adfac31e1 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:21.091781 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39719152-0aa7-44f7-9ff7-4681770332d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:21.093137 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39719152-0aa7-44f7-9ff7-4681770332d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:21.093421 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39719152-0aa7-44f7-9ff7-4681770332d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:21.093702 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39719152-0aa7-44f7-9ff7-4681770332d7 admin admin] PATH_INFO: `/v3/groups/a021b04f8412475ebc928368825f381d` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:21.094754 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39719152-0aa7-44f7-9ff7-4681770332d7 admin admin] RBAC: Authorizing `identity:get_group(group_id=a021b04f8412475ebc928368825f381d)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:21.119147 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING py.warnings [None req-39719152-0aa7-44f7-9ff7-4681770332d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:36:21.119147 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: warnings.warn(msg) Dec 29 20:36:21.119147 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: Dec 29 20:36:21.120295 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39719152-0aa7-44f7-9ff7-4681770332d7 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:21.121714 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 130/259] 10.222.0.37 () {56 vars in 1201 bytes} [Wed Dec 29 20:36:21 2021] GET /identity/v3/groups/a021b04f8412475ebc928368825f381d => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:21.126833 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8909f9b-93d3-40ab-820b-61be4a0b8feb admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:21.135753 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8909f9b-93d3-40ab-820b-61be4a0b8feb admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:21.140269 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77edc3-4ca7-447f-a896-d19d937ce3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:21.140828 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77edc3-4ca7-447f-a896-d19d937ce3bb admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:21.141120 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77edc3-4ca7-447f-a896-d19d937ce3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:21.141407 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77edc3-4ca7-447f-a896-d19d937ce3bb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:21.142171 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77edc3-4ca7-447f-a896-d19d937ce3bb admin admin] RBAC: Adding query filter params (group.id=a021b04f8412475ebc928368825f381d, role.id=b70e4a80dd884df58c908e9f9512f589, scope.project.id=10a6996925de4b25877e75bb73e7bd71) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:21.142475 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77edc3-4ca7-447f-a896-d19d937ce3bb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:21.168421 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77edc3-4ca7-447f-a896-d19d937ce3bb admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:21.174084 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 130/260] 10.222.0.37 () {56 vars in 1397 bytes} [Wed Dec 29 20:36:21 2021] GET /identity/v3/role_assignments?group.id=a021b04f8412475ebc928368825f381d&scope.project.id=10a6996925de4b25877e75bb73e7bd71&role.id=b70e4a80dd884df58c908e9f9512f589 => generated 611 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:36:23.117341 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd8e19-db48-4b29-8cf4-30de023b4324 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:23.117825 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd8e19-db48-4b29-8cf4-30de023b4324 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:23.117825 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd8e19-db48-4b29-8cf4-30de023b4324 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:23.119515 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 131/261] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:36:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:36:23.124495 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd10b4-a183-4509-9b17-b30c6291d083 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:23.124883 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd10b4-a183-4509-9b17-b30c6291d083 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:23.125066 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd10b4-a183-4509-9b17-b30c6291d083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:23.146956 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-a0fd10b4-a183-4509-9b17-b30c6291d083 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:36:23.148087 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-a0fd10b4-a183-4509-9b17-b30c6291d083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:36:23.155312 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 131/262] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:36:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:36:23.177056 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd8e19-db48-4b29-8cf4-30de023b4324 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:23.188323 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd8e19-db48-4b29-8cf4-30de023b4324 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:23.192028 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d07ee-f6ea-426c-9a6b-0e977b0013b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:23.192737 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d07ee-f6ea-426c-9a6b-0e977b0013b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:23.193018 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d07ee-f6ea-426c-9a6b-0e977b0013b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:23.193292 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d07ee-f6ea-426c-9a6b-0e977b0013b4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:23.204493 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d07ee-f6ea-426c-9a6b-0e977b0013b4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:36:23.210952 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-906d07ee-f6ea-426c-9a6b-0e977b0013b4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 29 20:36:23.211993 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 132/263] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:36:23 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:23.217804 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd10b4-a183-4509-9b17-b30c6291d083 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:23.226236 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd10b4-a183-4509-9b17-b30c6291d083 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:23.230114 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404be6a2-4060-43df-9082-6a83dbf8a3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:23.230728 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404be6a2-4060-43df-9082-6a83dbf8a3df admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:23.231020 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404be6a2-4060-43df-9082-6a83dbf8a3df admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:23.231302 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404be6a2-4060-43df-9082-6a83dbf8a3df admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:23.232009 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404be6a2-4060-43df-9082-6a83dbf8a3df admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:23.232308 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404be6a2-4060-43df-9082-6a83dbf8a3df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:23.258176 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404be6a2-4060-43df-9082-6a83dbf8a3df admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:23.266504 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 132/264] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:36:23 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:23.271659 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d07ee-f6ea-426c-9a6b-0e977b0013b4 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:23.282605 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d07ee-f6ea-426c-9a6b-0e977b0013b4 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:23.286365 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f85b0-0967-42e2-a77d-2e7dab9811d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:23.286953 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f85b0-0967-42e2-a77d-2e7dab9811d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:23.287237 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f85b0-0967-42e2-a77d-2e7dab9811d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:23.287514 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f85b0-0967-42e2-a77d-2e7dab9811d7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:23.294935 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f85b0-0967-42e2-a77d-2e7dab9811d7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:23.320422 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f85b0-0967-42e2-a77d-2e7dab9811d7 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:23.329407 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 133/265] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:36:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:36:23.334417 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404be6a2-4060-43df-9082-6a83dbf8a3df admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:23.343909 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404be6a2-4060-43df-9082-6a83dbf8a3df admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:23.347757 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3200b0e-f68c-40ad-aaf0-8a3e4e8c9020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:23.348524 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3200b0e-f68c-40ad-aaf0-8a3e4e8c9020 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:23.348815 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3200b0e-f68c-40ad-aaf0-8a3e4e8c9020 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:23.349097 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3200b0e-f68c-40ad-aaf0-8a3e4e8c9020 admin admin] PATH_INFO: `/v3/projects/10a6996925de4b25877e75bb73e7bd71` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:23.350162 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3200b0e-f68c-40ad-aaf0-8a3e4e8c9020 admin admin] RBAC: Authorizing `identity:get_project(project_id=10a6996925de4b25877e75bb73e7bd71)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:23.375880 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3200b0e-f68c-40ad-aaf0-8a3e4e8c9020 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:23.377305 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 133/266] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:36:23 2021] GET /identity/v3/projects/10a6996925de4b25877e75bb73e7bd71 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:23.382030 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f85b0-0967-42e2-a77d-2e7dab9811d7 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:23.390842 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f85b0-0967-42e2-a77d-2e7dab9811d7 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:23.394608 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74840577-7c91-48fc-a134-9946ef77e27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:23.395381 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74840577-7c91-48fc-a134-9946ef77e27b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:23.395664 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74840577-7c91-48fc-a134-9946ef77e27b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:23.395940 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74840577-7c91-48fc-a134-9946ef77e27b admin admin] PATH_INFO: `/v3/groups/a021b04f8412475ebc928368825f381d` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:23.396981 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74840577-7c91-48fc-a134-9946ef77e27b admin admin] RBAC: Authorizing `identity:get_group(group_id=a021b04f8412475ebc928368825f381d)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:23.422636 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74840577-7c91-48fc-a134-9946ef77e27b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:23.424049 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 134/267] 10.222.0.37 () {56 vars in 1201 bytes} [Wed Dec 29 20:36:23 2021] GET /identity/v3/groups/a021b04f8412475ebc928368825f381d => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:23.429089 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3200b0e-f68c-40ad-aaf0-8a3e4e8c9020 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:23.438017 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3200b0e-f68c-40ad-aaf0-8a3e4e8c9020 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:23.441859 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f05b5-4cbb-4b38-9b6f-622c16f42347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:23.442407 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f05b5-4cbb-4b38-9b6f-622c16f42347 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:23.442727 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f05b5-4cbb-4b38-9b6f-622c16f42347 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:23.443011 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f05b5-4cbb-4b38-9b6f-622c16f42347 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:23.443777 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f05b5-4cbb-4b38-9b6f-622c16f42347 admin admin] RBAC: Adding query filter params (group.id=a021b04f8412475ebc928368825f381d, role.id=5f70396837d2484ca16563634aa8d2a2, scope.project.id=10a6996925de4b25877e75bb73e7bd71) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:23.444077 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f05b5-4cbb-4b38-9b6f-622c16f42347 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:23.470270 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f05b5-4cbb-4b38-9b6f-622c16f42347 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:23.475457 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 134/268] 10.222.0.37 () {56 vars in 1397 bytes} [Wed Dec 29 20:36:23 2021] GET /identity/v3/role_assignments?group.id=a021b04f8412475ebc928368825f381d&scope.project.id=10a6996925de4b25877e75bb73e7bd71&role.id=5f70396837d2484ca16563634aa8d2a2 => generated 260 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:25.379215 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a921ad-ea6f-4a73-a8f0-d8e5e9e839fd None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:25.379772 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a921ad-ea6f-4a73-a8f0-d8e5e9e839fd None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:25.379772 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a921ad-ea6f-4a73-a8f0-d8e5e9e839fd None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:25.381443 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 135/269] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:36:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:36:25.386488 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146578fb-d704-46ca-8f1b-9a71222317b9 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:25.386953 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146578fb-d704-46ca-8f1b-9a71222317b9 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:25.387093 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146578fb-d704-46ca-8f1b-9a71222317b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:25.410000 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-146578fb-d704-46ca-8f1b-9a71222317b9 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:36:25.411141 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-146578fb-d704-46ca-8f1b-9a71222317b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:36:25.417614 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 135/270] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:36:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:36:25.438763 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a921ad-ea6f-4a73-a8f0-d8e5e9e839fd None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:25.450271 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a921ad-ea6f-4a73-a8f0-d8e5e9e839fd None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:25.454625 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e85cd-d713-4db7-83e7-451d4fd3376b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:25.455361 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e85cd-d713-4db7-83e7-451d4fd3376b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:25.455649 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e85cd-d713-4db7-83e7-451d4fd3376b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:25.455929 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e85cd-d713-4db7-83e7-451d4fd3376b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:25.466788 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e85cd-d713-4db7-83e7-451d4fd3376b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:36:25.473358 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-730e85cd-d713-4db7-83e7-451d4fd3376b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 29 20:36:25.474414 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 136/271] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:36:25 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:25.479724 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146578fb-d704-46ca-8f1b-9a71222317b9 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:25.487998 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146578fb-d704-46ca-8f1b-9a71222317b9 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:25.491885 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c487b-48be-40d9-ac21-6151e9fe32e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:25.492458 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c487b-48be-40d9-ac21-6151e9fe32e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:25.492742 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c487b-48be-40d9-ac21-6151e9fe32e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:25.493017 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c487b-48be-40d9-ac21-6151e9fe32e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:25.493711 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c487b-48be-40d9-ac21-6151e9fe32e2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:25.494004 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c487b-48be-40d9-ac21-6151e9fe32e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:25.520207 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c487b-48be-40d9-ac21-6151e9fe32e2 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:25.528270 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 136/272] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:36:25 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:25.533366 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e85cd-d713-4db7-83e7-451d4fd3376b admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:25.543379 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e85cd-d713-4db7-83e7-451d4fd3376b admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:25.547340 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7cff3-365e-4fa2-a93d-227c7a0722d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:25.548094 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7cff3-365e-4fa2-a93d-227c7a0722d2 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:25.548378 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7cff3-365e-4fa2-a93d-227c7a0722d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:25.548657 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7cff3-365e-4fa2-a93d-227c7a0722d2 admin admin] PATH_INFO: `/v3/groups/a021b04f8412475ebc928368825f381d` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:25.549691 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7cff3-365e-4fa2-a93d-227c7a0722d2 admin admin] RBAC: Authorizing `identity:get_group(group_id=a021b04f8412475ebc928368825f381d)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:25.575699 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7cff3-365e-4fa2-a93d-227c7a0722d2 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:25.577939 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 137/273] 10.222.0.37 () {56 vars in 1201 bytes} [Wed Dec 29 20:36:25 2021] GET /identity/v3/groups/a021b04f8412475ebc928368825f381d => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:25.582844 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c487b-48be-40d9-ac21-6151e9fe32e2 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:25.591937 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c487b-48be-40d9-ac21-6151e9fe32e2 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:25.595849 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211687dd-2909-496a-9929-65d1972c7576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:25.596609 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211687dd-2909-496a-9929-65d1972c7576 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:25.596894 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211687dd-2909-496a-9929-65d1972c7576 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:25.597171 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211687dd-2909-496a-9929-65d1972c7576 admin admin] PATH_INFO: `/v3/projects/10a6996925de4b25877e75bb73e7bd71` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:25.598224 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211687dd-2909-496a-9929-65d1972c7576 admin admin] RBAC: Authorizing `identity:get_project(project_id=10a6996925de4b25877e75bb73e7bd71)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:25.624920 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211687dd-2909-496a-9929-65d1972c7576 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:25.626389 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 137/274] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:36:25 2021] GET /identity/v3/projects/10a6996925de4b25877e75bb73e7bd71 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:25.631380 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7cff3-365e-4fa2-a93d-227c7a0722d2 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:25.640426 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7cff3-365e-4fa2-a93d-227c7a0722d2 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:25.644213 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f785bc-71c6-40b3-a11e-df9625932779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:25.644988 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f785bc-71c6-40b3-a11e-df9625932779 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:25.645275 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f785bc-71c6-40b3-a11e-df9625932779 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:25.645554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f785bc-71c6-40b3-a11e-df9625932779 admin admin] PATH_INFO: `/v3/projects/10a6996925de4b25877e75bb73e7bd71/groups/a021b04f8412475ebc928368825f381d/roles/5f70396837d2484ca16563634aa8d2a2` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:25.647479 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f785bc-71c6-40b3-a11e-df9625932779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a6996925de4b25877e75bb73e7bd71, group_id=a021b04f8412475ebc928368825f381d, role_id=5f70396837d2484ca16563634aa8d2a2)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:25.673815 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f785bc-71c6-40b3-a11e-df9625932779 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:25.685429 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 138/275] 10.222.0.37 () {58 vars in 1463 bytes} [Wed Dec 29 20:36:25 2021] PUT /identity/v3/projects/10a6996925de4b25877e75bb73e7bd71/groups/a021b04f8412475ebc928368825f381d/roles/5f70396837d2484ca16563634aa8d2a2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:36:27.636822 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab1123-3eec-45fc-831d-75616087eca9 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:27.637367 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab1123-3eec-45fc-831d-75616087eca9 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:27.637463 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab1123-3eec-45fc-831d-75616087eca9 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:27.639122 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 138/276] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:36:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:36:27.644531 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c916633-2247-4358-ba8f-c541507533cf None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:27.644954 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c916633-2247-4358-ba8f-c541507533cf None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:27.645100 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c916633-2247-4358-ba8f-c541507533cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:27.673861 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-1c916633-2247-4358-ba8f-c541507533cf None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:36:27.675060 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-1c916633-2247-4358-ba8f-c541507533cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:36:27.759199 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 139/277] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:36:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:36:27.787133 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab1123-3eec-45fc-831d-75616087eca9 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:27.799363 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab1123-3eec-45fc-831d-75616087eca9 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:27.803102 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32345f22-cc48-49fa-8dcb-86ff84405597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:27.803826 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32345f22-cc48-49fa-8dcb-86ff84405597 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:27.804108 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32345f22-cc48-49fa-8dcb-86ff84405597 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:27.804380 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32345f22-cc48-49fa-8dcb-86ff84405597 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:27.819274 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32345f22-cc48-49fa-8dcb-86ff84405597 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:36:27.827199 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-32345f22-cc48-49fa-8dcb-86ff84405597 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 29 20:36:27.828475 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 139/278] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:36:27 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:27.834714 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c916633-2247-4358-ba8f-c541507533cf None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:27.847145 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c916633-2247-4358-ba8f-c541507533cf None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:27.852730 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09152ede-c61f-40fe-82a1-ab9475f01b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:27.853689 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09152ede-c61f-40fe-82a1-ab9475f01b55 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:27.854160 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09152ede-c61f-40fe-82a1-ab9475f01b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:27.854621 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09152ede-c61f-40fe-82a1-ab9475f01b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:27.855834 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09152ede-c61f-40fe-82a1-ab9475f01b55 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:27.856331 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09152ede-c61f-40fe-82a1-ab9475f01b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:27.882436 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09152ede-c61f-40fe-82a1-ab9475f01b55 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:27.894839 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 140/279] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:36:27 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:27.900128 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32345f22-cc48-49fa-8dcb-86ff84405597 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:27.910995 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32345f22-cc48-49fa-8dcb-86ff84405597 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:27.914809 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acbc6d-e1f4-47af-acfc-83a49516f6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:27.915381 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acbc6d-e1f4-47af-acfc-83a49516f6ad admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:27.915667 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acbc6d-e1f4-47af-acfc-83a49516f6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:27.915945 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acbc6d-e1f4-47af-acfc-83a49516f6ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:27.923869 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acbc6d-e1f4-47af-acfc-83a49516f6ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:27.950363 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acbc6d-e1f4-47af-acfc-83a49516f6ad admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:27.959453 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 140/280] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:36:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:36:27.964945 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09152ede-c61f-40fe-82a1-ab9475f01b55 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:27.974802 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09152ede-c61f-40fe-82a1-ab9475f01b55 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:27.978645 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721501d8-71e3-4a18-84e1-1f100d36279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:27.979444 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721501d8-71e3-4a18-84e1-1f100d36279b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:27.979734 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721501d8-71e3-4a18-84e1-1f100d36279b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:27.980015 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721501d8-71e3-4a18-84e1-1f100d36279b admin admin] PATH_INFO: `/v3/projects/10a6996925de4b25877e75bb73e7bd71` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:27.981065 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721501d8-71e3-4a18-84e1-1f100d36279b admin admin] RBAC: Authorizing `identity:get_project(project_id=10a6996925de4b25877e75bb73e7bd71)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:28.006847 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721501d8-71e3-4a18-84e1-1f100d36279b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:28.008366 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 141/281] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:36:27 2021] GET /identity/v3/projects/10a6996925de4b25877e75bb73e7bd71 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:28.014089 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acbc6d-e1f4-47af-acfc-83a49516f6ad admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:28.022542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acbc6d-e1f4-47af-acfc-83a49516f6ad admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:28.026361 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16fdf8-0aed-4777-bcdd-25305b110be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:28.027163 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16fdf8-0aed-4777-bcdd-25305b110be7 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:28.027449 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16fdf8-0aed-4777-bcdd-25305b110be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:28.027724 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16fdf8-0aed-4777-bcdd-25305b110be7 admin admin] PATH_INFO: `/v3/groups/a021b04f8412475ebc928368825f381d` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:28.028755 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16fdf8-0aed-4777-bcdd-25305b110be7 admin admin] RBAC: Authorizing `identity:get_group(group_id=a021b04f8412475ebc928368825f381d)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:28.054596 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16fdf8-0aed-4777-bcdd-25305b110be7 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:28.056029 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 141/282] 10.222.0.37 () {56 vars in 1201 bytes} [Wed Dec 29 20:36:28 2021] GET /identity/v3/groups/a021b04f8412475ebc928368825f381d => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:28.061424 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721501d8-71e3-4a18-84e1-1f100d36279b admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:28.070592 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721501d8-71e3-4a18-84e1-1f100d36279b admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:28.074634 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64302337-ec10-4e12-a05d-700fe5e69480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:28.075233 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64302337-ec10-4e12-a05d-700fe5e69480 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:28.075518 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64302337-ec10-4e12-a05d-700fe5e69480 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:28.075797 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64302337-ec10-4e12-a05d-700fe5e69480 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:28.077089 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64302337-ec10-4e12-a05d-700fe5e69480 admin admin] RBAC: Adding query filter params (group.id=a021b04f8412475ebc928368825f381d, role.id=5f70396837d2484ca16563634aa8d2a2, scope.project.id=10a6996925de4b25877e75bb73e7bd71) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:28.077389 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64302337-ec10-4e12-a05d-700fe5e69480 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:28.103258 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64302337-ec10-4e12-a05d-700fe5e69480 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:28.109338 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 142/283] 10.222.0.37 () {56 vars in 1397 bytes} [Wed Dec 29 20:36:28 2021] GET /identity/v3/role_assignments?group.id=a021b04f8412475ebc928368825f381d&scope.project.id=10a6996925de4b25877e75bb73e7bd71&role.id=5f70396837d2484ca16563634aa8d2a2 => generated 611 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:30.046221 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4ca69-ba9f-436e-8417-d0ac93276ecf None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:30.046794 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4ca69-ba9f-436e-8417-d0ac93276ecf None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:30.046891 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4ca69-ba9f-436e-8417-d0ac93276ecf None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:30.048466 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 142/284] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:36:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:36:30.053404 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67728fea-4c15-44ee-843c-4933f231847c None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:30.053766 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67728fea-4c15-44ee-843c-4933f231847c None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:30.053971 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67728fea-4c15-44ee-843c-4933f231847c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:30.076981 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-67728fea-4c15-44ee-843c-4933f231847c None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:36:30.078102 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-67728fea-4c15-44ee-843c-4933f231847c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:36:30.084602 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 143/285] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:36:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:36:30.106216 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4ca69-ba9f-436e-8417-d0ac93276ecf None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:30.118057 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4ca69-ba9f-436e-8417-d0ac93276ecf None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:30.121731 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bf49f-9a79-431e-a5de-95eb975c4166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:30.122430 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bf49f-9a79-431e-a5de-95eb975c4166 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:30.122744 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bf49f-9a79-431e-a5de-95eb975c4166 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:30.123613 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bf49f-9a79-431e-a5de-95eb975c4166 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:30.134282 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992bf49f-9a79-431e-a5de-95eb975c4166 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:36:30.140897 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-992bf49f-9a79-431e-a5de-95eb975c4166 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 29 20:36:30.141944 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 143/286] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:36:30 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:30.147188 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67728fea-4c15-44ee-843c-4933f231847c None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:30.155833 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67728fea-4c15-44ee-843c-4933f231847c None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:30.159689 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d78ce-0085-4880-b2dc-29845ce6b52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:30.160270 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d78ce-0085-4880-b2dc-29845ce6b52d admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:30.160561 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d78ce-0085-4880-b2dc-29845ce6b52d admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:30.160838 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d78ce-0085-4880-b2dc-29845ce6b52d admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:30.161533 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d78ce-0085-4880-b2dc-29845ce6b52d admin admin] RBAC: Adding query filter params (name=member) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:30.161828 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d78ce-0085-4880-b2dc-29845ce6b52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:30.187947 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d78ce-0085-4880-b2dc-29845ce6b52d admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:30.196224 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 144/287] 10.222.0.37 () {56 vars in 1122 bytes} [Wed Dec 29 20:36:30 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:30.201624 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bf49f-9a79-431e-a5de-95eb975c4166 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:30.211567 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bf49f-9a79-431e-a5de-95eb975c4166 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:30.215346 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe748a-5466-4923-b281-d8d43dd2cdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:30.215894 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe748a-5466-4923-b281-d8d43dd2cdb3 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:30.216179 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe748a-5466-4923-b281-d8d43dd2cdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:30.216457 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe748a-5466-4923-b281-d8d43dd2cdb3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:30.223980 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe748a-5466-4923-b281-d8d43dd2cdb3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:30.249886 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe748a-5466-4923-b281-d8d43dd2cdb3 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:30.257941 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 144/288] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:36:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:36:30.262883 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d78ce-0085-4880-b2dc-29845ce6b52d admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:30.271996 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d78ce-0085-4880-b2dc-29845ce6b52d admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:30.275789 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a3d07-f594-4f0d-b0b3-5d56c0b93123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:30.276552 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a3d07-f594-4f0d-b0b3-5d56c0b93123 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:30.276838 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a3d07-f594-4f0d-b0b3-5d56c0b93123 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:30.277115 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a3d07-f594-4f0d-b0b3-5d56c0b93123 admin admin] PATH_INFO: `/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:30.278156 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a3d07-f594-4f0d-b0b3-5d56c0b93123 admin admin] RBAC: Authorizing `identity:get_project(project_id=ec6ddf70badd4a05b97ea6835eaebc90)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:30.304452 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a3d07-f594-4f0d-b0b3-5d56c0b93123 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:30.305916 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 145/289] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:36:30 2021] GET /identity/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:30.311107 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe748a-5466-4923-b281-d8d43dd2cdb3 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:30.319163 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe748a-5466-4923-b281-d8d43dd2cdb3 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:30.322909 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd92da-6360-4c7c-9455-8986fb1d5764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:30.323654 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd92da-6360-4c7c-9455-8986fb1d5764 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:30.323935 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd92da-6360-4c7c-9455-8986fb1d5764 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:30.324206 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd92da-6360-4c7c-9455-8986fb1d5764 admin admin] PATH_INFO: `/v3/groups/a021b04f8412475ebc928368825f381d` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:30.325500 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd92da-6360-4c7c-9455-8986fb1d5764 admin admin] RBAC: Authorizing `identity:get_group(group_id=a021b04f8412475ebc928368825f381d)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:30.351937 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd92da-6360-4c7c-9455-8986fb1d5764 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:30.353319 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 145/290] 10.222.0.37 () {56 vars in 1201 bytes} [Wed Dec 29 20:36:30 2021] GET /identity/v3/groups/a021b04f8412475ebc928368825f381d => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:30.358356 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a3d07-f594-4f0d-b0b3-5d56c0b93123 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:30.367273 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a3d07-f594-4f0d-b0b3-5d56c0b93123 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:30.371130 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa46ad-ad8f-42b3-8693-ecd7ab2024c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:30.371629 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa46ad-ad8f-42b3-8693-ecd7ab2024c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:30.371914 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa46ad-ad8f-42b3-8693-ecd7ab2024c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:30.372193 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa46ad-ad8f-42b3-8693-ecd7ab2024c7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:30.372954 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa46ad-ad8f-42b3-8693-ecd7ab2024c7 admin admin] RBAC: Adding query filter params (group.id=a021b04f8412475ebc928368825f381d, role.id=b70e4a80dd884df58c908e9f9512f589, scope.project.id=ec6ddf70badd4a05b97ea6835eaebc90) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:30.373255 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa46ad-ad8f-42b3-8693-ecd7ab2024c7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:30.398965 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa46ad-ad8f-42b3-8693-ecd7ab2024c7 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:30.405679 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 146/291] 10.222.0.37 () {56 vars in 1397 bytes} [Wed Dec 29 20:36:30 2021] GET /identity/v3/role_assignments?group.id=a021b04f8412475ebc928368825f381d&scope.project.id=ec6ddf70badd4a05b97ea6835eaebc90&role.id=b70e4a80dd884df58c908e9f9512f589 => generated 260 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:32.300200 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543a663-0ba8-4b6d-809b-5515d7a370a3 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:32.300704 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543a663-0ba8-4b6d-809b-5515d7a370a3 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:32.300704 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543a663-0ba8-4b6d-809b-5515d7a370a3 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:32.302334 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 146/292] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:36:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:36:32.307351 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b74ae-e48b-49d1-8c62-f51a859f6b0b None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:32.307766 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b74ae-e48b-49d1-8c62-f51a859f6b0b None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:32.307924 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b74ae-e48b-49d1-8c62-f51a859f6b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:32.331087 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-105b74ae-e48b-49d1-8c62-f51a859f6b0b None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:36:32.332207 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-105b74ae-e48b-49d1-8c62-f51a859f6b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:36:32.338671 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 147/293] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:36:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:36:32.360014 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543a663-0ba8-4b6d-809b-5515d7a370a3 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:32.371129 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543a663-0ba8-4b6d-809b-5515d7a370a3 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:32.375576 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa09e9-0e45-46d5-8a74-53f6e1f0be9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:32.376272 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa09e9-0e45-46d5-8a74-53f6e1f0be9d admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:32.376553 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa09e9-0e45-46d5-8a74-53f6e1f0be9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:32.376825 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa09e9-0e45-46d5-8a74-53f6e1f0be9d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:32.387508 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa09e9-0e45-46d5-8a74-53f6e1f0be9d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:36:32.393837 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-1afa09e9-0e45-46d5-8a74-53f6e1f0be9d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 29 20:36:32.394905 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 147/294] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:36:32 2021] GET /identity/v3/roles/member => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:32.400069 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b74ae-e48b-49d1-8c62-f51a859f6b0b None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:32.408573 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b74ae-e48b-49d1-8c62-f51a859f6b0b None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:32.412429 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb61669-0624-40fd-b5e6-2412c51e025f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:32.413010 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb61669-0624-40fd-b5e6-2412c51e025f admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:32.413295 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb61669-0624-40fd-b5e6-2412c51e025f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:32.413604 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb61669-0624-40fd-b5e6-2412c51e025f admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:32.414300 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb61669-0624-40fd-b5e6-2412c51e025f admin admin] RBAC: Adding query filter params (name=member) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:32.414597 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb61669-0624-40fd-b5e6-2412c51e025f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:32.440870 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb61669-0624-40fd-b5e6-2412c51e025f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:32.449174 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 148/295] 10.222.0.37 () {56 vars in 1122 bytes} [Wed Dec 29 20:36:32 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:32.454409 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa09e9-0e45-46d5-8a74-53f6e1f0be9d admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:32.464778 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa09e9-0e45-46d5-8a74-53f6e1f0be9d admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:32.468627 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6f3bf-99cb-4b6a-8126-319b5f0b523b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:32.469379 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6f3bf-99cb-4b6a-8126-319b5f0b523b admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:32.469662 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6f3bf-99cb-4b6a-8126-319b5f0b523b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:32.469936 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6f3bf-99cb-4b6a-8126-319b5f0b523b admin admin] PATH_INFO: `/v3/groups/a021b04f8412475ebc928368825f381d` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:32.471018 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6f3bf-99cb-4b6a-8126-319b5f0b523b admin admin] RBAC: Authorizing `identity:get_group(group_id=a021b04f8412475ebc928368825f381d)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:32.496745 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6f3bf-99cb-4b6a-8126-319b5f0b523b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:32.498904 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 148/296] 10.222.0.37 () {56 vars in 1201 bytes} [Wed Dec 29 20:36:32 2021] GET /identity/v3/groups/a021b04f8412475ebc928368825f381d => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:32.503972 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb61669-0624-40fd-b5e6-2412c51e025f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:32.513032 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb61669-0624-40fd-b5e6-2412c51e025f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:32.516985 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664273b-9db3-48fb-88eb-f87753735d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:32.517755 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664273b-9db3-48fb-88eb-f87753735d8c admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:32.518042 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664273b-9db3-48fb-88eb-f87753735d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:32.518318 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664273b-9db3-48fb-88eb-f87753735d8c admin admin] PATH_INFO: `/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:32.519398 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664273b-9db3-48fb-88eb-f87753735d8c admin admin] RBAC: Authorizing `identity:get_project(project_id=ec6ddf70badd4a05b97ea6835eaebc90)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:32.545611 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664273b-9db3-48fb-88eb-f87753735d8c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:32.547125 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 149/297] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:36:32 2021] GET /identity/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:32.552068 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6f3bf-99cb-4b6a-8126-319b5f0b523b admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:32.561672 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6f3bf-99cb-4b6a-8126-319b5f0b523b admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:32.565414 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ac4d6-0f6e-40d6-9c77-d24cc79eda25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:32.566191 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ac4d6-0f6e-40d6-9c77-d24cc79eda25 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:32.566475 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ac4d6-0f6e-40d6-9c77-d24cc79eda25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:32.566789 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ac4d6-0f6e-40d6-9c77-d24cc79eda25 admin admin] PATH_INFO: `/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90/groups/a021b04f8412475ebc928368825f381d/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:32.568468 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ac4d6-0f6e-40d6-9c77-d24cc79eda25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec6ddf70badd4a05b97ea6835eaebc90, group_id=a021b04f8412475ebc928368825f381d, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:32.594548 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ac4d6-0f6e-40d6-9c77-d24cc79eda25 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:32.606545 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 149/298] 10.222.0.37 () {58 vars in 1463 bytes} [Wed Dec 29 20:36:32 2021] PUT /identity/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90/groups/a021b04f8412475ebc928368825f381d/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:36:34.509884 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af23c38-12d4-4f7a-a487-eab62c19533b None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:34.510438 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af23c38-12d4-4f7a-a487-eab62c19533b None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:34.510438 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af23c38-12d4-4f7a-a487-eab62c19533b None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:34.512134 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 150/299] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:36:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:36:34.517669 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd031594-4c3b-4d5e-a87f-3ae6b2f2b486 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:34.518049 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd031594-4c3b-4d5e-a87f-3ae6b2f2b486 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:34.518226 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd031594-4c3b-4d5e-a87f-3ae6b2f2b486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:34.540162 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-fd031594-4c3b-4d5e-a87f-3ae6b2f2b486 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:36:34.541275 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-fd031594-4c3b-4d5e-a87f-3ae6b2f2b486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:36:34.602627 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 150/300] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:36:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:36:34.624702 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af23c38-12d4-4f7a-a487-eab62c19533b None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:34.636032 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af23c38-12d4-4f7a-a487-eab62c19533b None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:34.640550 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd125e-17b4-4833-9921-7abb009b5bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:34.641253 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd125e-17b4-4833-9921-7abb009b5bef admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:34.641545 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd125e-17b4-4833-9921-7abb009b5bef admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:34.641828 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd125e-17b4-4833-9921-7abb009b5bef admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:34.653493 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd125e-17b4-4833-9921-7abb009b5bef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:36:34.660340 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-c4bd125e-17b4-4833-9921-7abb009b5bef admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 29 20:36:34.661404 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 151/301] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:36:34 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:34.666641 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd031594-4c3b-4d5e-a87f-3ae6b2f2b486 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:34.675018 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd031594-4c3b-4d5e-a87f-3ae6b2f2b486 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:34.678820 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10cc27-08f9-4504-8c23-67294c86ed1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:34.679399 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10cc27-08f9-4504-8c23-67294c86ed1c admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:34.679685 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10cc27-08f9-4504-8c23-67294c86ed1c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:34.679965 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10cc27-08f9-4504-8c23-67294c86ed1c admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:34.680664 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10cc27-08f9-4504-8c23-67294c86ed1c admin admin] RBAC: Adding query filter params (name=member) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:34.680958 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10cc27-08f9-4504-8c23-67294c86ed1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:34.707151 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10cc27-08f9-4504-8c23-67294c86ed1c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:34.715373 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 151/302] 10.222.0.37 () {56 vars in 1122 bytes} [Wed Dec 29 20:36:34 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:34.721362 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd125e-17b4-4833-9921-7abb009b5bef admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:34.730259 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd125e-17b4-4833-9921-7abb009b5bef admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:34.734028 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261c7d3-7184-4dd7-8c73-92e498ff40b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:34.734579 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261c7d3-7184-4dd7-8c73-92e498ff40b0 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:34.734893 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261c7d3-7184-4dd7-8c73-92e498ff40b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:34.735169 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261c7d3-7184-4dd7-8c73-92e498ff40b0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:34.742568 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261c7d3-7184-4dd7-8c73-92e498ff40b0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:34.768152 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261c7d3-7184-4dd7-8c73-92e498ff40b0 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:34.776250 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 152/303] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:36:34 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:36:34.782128 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10cc27-08f9-4504-8c23-67294c86ed1c admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:34.791005 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10cc27-08f9-4504-8c23-67294c86ed1c admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:34.794783 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe28e8d-6b04-4051-899b-5dca36b78d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:34.795551 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe28e8d-6b04-4051-899b-5dca36b78d1d admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:34.795831 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe28e8d-6b04-4051-899b-5dca36b78d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:34.796106 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe28e8d-6b04-4051-899b-5dca36b78d1d admin admin] PATH_INFO: `/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:34.797159 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe28e8d-6b04-4051-899b-5dca36b78d1d admin admin] RBAC: Authorizing `identity:get_project(project_id=ec6ddf70badd4a05b97ea6835eaebc90)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:34.822624 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe28e8d-6b04-4051-899b-5dca36b78d1d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:34.824120 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 152/304] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:36:34 2021] GET /identity/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90 => generated 302 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:36:34.829958 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261c7d3-7184-4dd7-8c73-92e498ff40b0 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:34.838629 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261c7d3-7184-4dd7-8c73-92e498ff40b0 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:34.843335 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df029fb8-bde1-4fa6-98d4-08fb9f9d1d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:34.844088 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df029fb8-bde1-4fa6-98d4-08fb9f9d1d1b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:34.844372 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df029fb8-bde1-4fa6-98d4-08fb9f9d1d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:34.844650 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df029fb8-bde1-4fa6-98d4-08fb9f9d1d1b admin admin] PATH_INFO: `/v3/groups/a021b04f8412475ebc928368825f381d` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:34.845684 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df029fb8-bde1-4fa6-98d4-08fb9f9d1d1b admin admin] RBAC: Authorizing `identity:get_group(group_id=a021b04f8412475ebc928368825f381d)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:34.870757 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df029fb8-bde1-4fa6-98d4-08fb9f9d1d1b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:34.872210 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 153/305] 10.222.0.37 () {56 vars in 1201 bytes} [Wed Dec 29 20:36:34 2021] GET /identity/v3/groups/a021b04f8412475ebc928368825f381d => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:34.877925 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe28e8d-6b04-4051-899b-5dca36b78d1d admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:34.887477 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe28e8d-6b04-4051-899b-5dca36b78d1d admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:34.891886 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892410e-1fb8-48f9-8d7f-dc1fe048a079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:34.892455 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892410e-1fb8-48f9-8d7f-dc1fe048a079 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:34.892743 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892410e-1fb8-48f9-8d7f-dc1fe048a079 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:34.893025 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892410e-1fb8-48f9-8d7f-dc1fe048a079 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:34.893797 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892410e-1fb8-48f9-8d7f-dc1fe048a079 admin admin] RBAC: Adding query filter params (group.id=a021b04f8412475ebc928368825f381d, role.id=b70e4a80dd884df58c908e9f9512f589, scope.project.id=ec6ddf70badd4a05b97ea6835eaebc90) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:34.894101 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892410e-1fb8-48f9-8d7f-dc1fe048a079 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:34.920260 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892410e-1fb8-48f9-8d7f-dc1fe048a079 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:34.925891 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 153/306] 10.222.0.37 () {56 vars in 1397 bytes} [Wed Dec 29 20:36:34 2021] GET /identity/v3/role_assignments?group.id=a021b04f8412475ebc928368825f381d&scope.project.id=ec6ddf70badd4a05b97ea6835eaebc90&role.id=b70e4a80dd884df58c908e9f9512f589 => generated 611 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:36:36.839412 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e7cd2-93fc-4fe4-80f4-21ac70b813fe None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:36.839929 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e7cd2-93fc-4fe4-80f4-21ac70b813fe None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:36.840016 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e7cd2-93fc-4fe4-80f4-21ac70b813fe None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:36.842214 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 154/307] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:36:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:36:36.847196 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec76785-c600-4cf6-b442-0a39845e6c28 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:36.847607 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec76785-c600-4cf6-b442-0a39845e6c28 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:36.847769 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec76785-c600-4cf6-b442-0a39845e6c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:36.869981 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-2ec76785-c600-4cf6-b442-0a39845e6c28 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:36:36.871150 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-2ec76785-c600-4cf6-b442-0a39845e6c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:36:36.877737 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 154/308] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:36:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:36:36.900348 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e7cd2-93fc-4fe4-80f4-21ac70b813fe None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:36.912202 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e7cd2-93fc-4fe4-80f4-21ac70b813fe None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:36.915917 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99d586-1080-434a-a779-07ea1b184b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:36.916623 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99d586-1080-434a-a779-07ea1b184b48 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:36.916906 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99d586-1080-434a-a779-07ea1b184b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:36.917181 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99d586-1080-434a-a779-07ea1b184b48 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:36.927886 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99d586-1080-434a-a779-07ea1b184b48 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:36:36.934377 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-fa99d586-1080-434a-a779-07ea1b184b48 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 29 20:36:36.935579 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 155/309] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:36:36 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:36.941059 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec76785-c600-4cf6-b442-0a39845e6c28 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:36.949735 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec76785-c600-4cf6-b442-0a39845e6c28 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:36.954134 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5101cdf-5d11-4535-92db-b89d992fef62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:36.954747 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5101cdf-5d11-4535-92db-b89d992fef62 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:36.955039 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5101cdf-5d11-4535-92db-b89d992fef62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:36.955321 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5101cdf-5d11-4535-92db-b89d992fef62 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:36.956021 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5101cdf-5d11-4535-92db-b89d992fef62 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:36.956316 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5101cdf-5d11-4535-92db-b89d992fef62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:36.981896 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5101cdf-5d11-4535-92db-b89d992fef62 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:36.990004 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 155/310] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:36:36 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:36.995418 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99d586-1080-434a-a779-07ea1b184b48 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:37.005357 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99d586-1080-434a-a779-07ea1b184b48 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:37.009089 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4c480-7b53-4e96-a5f9-6cc32ee7766e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:37.009642 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4c480-7b53-4e96-a5f9-6cc32ee7766e admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:37.009926 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4c480-7b53-4e96-a5f9-6cc32ee7766e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:37.010203 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4c480-7b53-4e96-a5f9-6cc32ee7766e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:37.018340 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4c480-7b53-4e96-a5f9-6cc32ee7766e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:37.043872 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4c480-7b53-4e96-a5f9-6cc32ee7766e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:37.052220 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 156/311] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:36:36 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:36:37.057253 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5101cdf-5d11-4535-92db-b89d992fef62 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:37.066414 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5101cdf-5d11-4535-92db-b89d992fef62 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:37.070213 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09c965-8901-4a15-8b69-813a67af7e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:37.071011 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09c965-8901-4a15-8b69-813a67af7e3e admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:37.071298 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09c965-8901-4a15-8b69-813a67af7e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:37.071573 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09c965-8901-4a15-8b69-813a67af7e3e admin admin] PATH_INFO: `/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:37.072631 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09c965-8901-4a15-8b69-813a67af7e3e admin admin] RBAC: Authorizing `identity:get_project(project_id=ec6ddf70badd4a05b97ea6835eaebc90)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:37.099958 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09c965-8901-4a15-8b69-813a67af7e3e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:37.101383 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 156/312] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:36:37 2021] GET /identity/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:37.106283 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4c480-7b53-4e96-a5f9-6cc32ee7766e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:37.114538 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4c480-7b53-4e96-a5f9-6cc32ee7766e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:37.118295 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce17d4-874f-4c17-ba79-5d2f0d7249cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:37.119082 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce17d4-874f-4c17-ba79-5d2f0d7249cf admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:37.119365 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce17d4-874f-4c17-ba79-5d2f0d7249cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:37.119634 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce17d4-874f-4c17-ba79-5d2f0d7249cf admin admin] PATH_INFO: `/v3/groups/a021b04f8412475ebc928368825f381d` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:37.120658 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce17d4-874f-4c17-ba79-5d2f0d7249cf admin admin] RBAC: Authorizing `identity:get_group(group_id=a021b04f8412475ebc928368825f381d)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:37.146186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce17d4-874f-4c17-ba79-5d2f0d7249cf admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:37.147602 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 157/313] 10.222.0.37 () {56 vars in 1201 bytes} [Wed Dec 29 20:36:37 2021] GET /identity/v3/groups/a021b04f8412475ebc928368825f381d => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:37.152717 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09c965-8901-4a15-8b69-813a67af7e3e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:37.162333 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09c965-8901-4a15-8b69-813a67af7e3e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:37.166111 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567e4ae-0939-4e7f-a717-dca424a3b29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:37.166698 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567e4ae-0939-4e7f-a717-dca424a3b29a admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:37.166993 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567e4ae-0939-4e7f-a717-dca424a3b29a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:37.167275 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567e4ae-0939-4e7f-a717-dca424a3b29a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:37.168043 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567e4ae-0939-4e7f-a717-dca424a3b29a admin admin] RBAC: Adding query filter params (group.id=a021b04f8412475ebc928368825f381d, role.id=5f70396837d2484ca16563634aa8d2a2, scope.project.id=ec6ddf70badd4a05b97ea6835eaebc90) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:37.168344 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567e4ae-0939-4e7f-a717-dca424a3b29a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:37.193958 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567e4ae-0939-4e7f-a717-dca424a3b29a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:37.199106 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 157/314] 10.222.0.37 () {56 vars in 1397 bytes} [Wed Dec 29 20:36:37 2021] GET /identity/v3/role_assignments?group.id=a021b04f8412475ebc928368825f381d&scope.project.id=ec6ddf70badd4a05b97ea6835eaebc90&role.id=5f70396837d2484ca16563634aa8d2a2 => generated 260 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:39.124265 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41c78a-940c-41ef-a5fa-6c13e0eb6f69 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:39.124765 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41c78a-940c-41ef-a5fa-6c13e0eb6f69 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:39.124765 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41c78a-940c-41ef-a5fa-6c13e0eb6f69 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:39.126384 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 158/315] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:36:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:36:39.131466 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03c5a8-1d85-45a2-ae38-59a549c55a78 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:39.131875 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03c5a8-1d85-45a2-ae38-59a549c55a78 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:39.132035 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03c5a8-1d85-45a2-ae38-59a549c55a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:39.155466 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-8d03c5a8-1d85-45a2-ae38-59a549c55a78 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:36:39.156595 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-8d03c5a8-1d85-45a2-ae38-59a549c55a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:36:39.163152 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 158/316] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:36:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:36:39.184257 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41c78a-940c-41ef-a5fa-6c13e0eb6f69 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:39.195455 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41c78a-940c-41ef-a5fa-6c13e0eb6f69 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:39.199118 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4e8a7-743f-44d9-bdb8-8bc2b15da4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:39.200080 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4e8a7-743f-44d9-bdb8-8bc2b15da4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:39.200360 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4e8a7-743f-44d9-bdb8-8bc2b15da4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:39.201142 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4e8a7-743f-44d9-bdb8-8bc2b15da4f9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:39.212062 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4e8a7-743f-44d9-bdb8-8bc2b15da4f9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:36:39.219320 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-58f4e8a7-743f-44d9-bdb8-8bc2b15da4f9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 29 20:36:39.220369 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 159/317] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:36:39 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:39.225826 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03c5a8-1d85-45a2-ae38-59a549c55a78 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:39.234268 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03c5a8-1d85-45a2-ae38-59a549c55a78 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:39.238096 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a1a66-7f50-462c-b702-4738d547e4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:39.238703 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a1a66-7f50-462c-b702-4738d547e4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:39.238996 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a1a66-7f50-462c-b702-4738d547e4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:39.239278 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a1a66-7f50-462c-b702-4738d547e4e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:39.239977 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a1a66-7f50-462c-b702-4738d547e4e0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:39.240273 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a1a66-7f50-462c-b702-4738d547e4e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:39.266208 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a1a66-7f50-462c-b702-4738d547e4e0 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:39.274416 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 159/318] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:36:39 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:39.280090 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4e8a7-743f-44d9-bdb8-8bc2b15da4f9 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:39.289857 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4e8a7-743f-44d9-bdb8-8bc2b15da4f9 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:39.293601 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093fbe1-fa74-4505-97c2-230ef63ddbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:39.294391 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093fbe1-fa74-4505-97c2-230ef63ddbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:39.294728 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093fbe1-fa74-4505-97c2-230ef63ddbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:39.294975 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093fbe1-fa74-4505-97c2-230ef63ddbd9 admin admin] PATH_INFO: `/v3/groups/a021b04f8412475ebc928368825f381d` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:39.296001 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093fbe1-fa74-4505-97c2-230ef63ddbd9 admin admin] RBAC: Authorizing `identity:get_group(group_id=a021b04f8412475ebc928368825f381d)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:39.321151 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093fbe1-fa74-4505-97c2-230ef63ddbd9 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:39.322559 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 160/319] 10.222.0.37 () {56 vars in 1201 bytes} [Wed Dec 29 20:36:39 2021] GET /identity/v3/groups/a021b04f8412475ebc928368825f381d => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:39.328356 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a1a66-7f50-462c-b702-4738d547e4e0 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:39.337373 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a1a66-7f50-462c-b702-4738d547e4e0 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:39.341189 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af7a57-7bb7-4b19-a82b-62e60c873ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:39.342609 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af7a57-7bb7-4b19-a82b-62e60c873ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:39.342921 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af7a57-7bb7-4b19-a82b-62e60c873ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:39.343200 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af7a57-7bb7-4b19-a82b-62e60c873ec9 admin admin] PATH_INFO: `/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:39.344268 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af7a57-7bb7-4b19-a82b-62e60c873ec9 admin admin] RBAC: Authorizing `identity:get_project(project_id=ec6ddf70badd4a05b97ea6835eaebc90)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:39.370356 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af7a57-7bb7-4b19-a82b-62e60c873ec9 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:39.371865 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 160/320] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:36:39 2021] GET /identity/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:39.377611 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093fbe1-fa74-4505-97c2-230ef63ddbd9 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:39.386621 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093fbe1-fa74-4505-97c2-230ef63ddbd9 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:39.390435 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2abb8-3c7a-41ef-b839-a13a77f1fa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:39.391259 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2abb8-3c7a-41ef-b839-a13a77f1fa15 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:39.391549 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2abb8-3c7a-41ef-b839-a13a77f1fa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:39.391833 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2abb8-3c7a-41ef-b839-a13a77f1fa15 admin admin] PATH_INFO: `/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90/groups/a021b04f8412475ebc928368825f381d/roles/5f70396837d2484ca16563634aa8d2a2` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:39.393737 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2abb8-3c7a-41ef-b839-a13a77f1fa15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec6ddf70badd4a05b97ea6835eaebc90, group_id=a021b04f8412475ebc928368825f381d, role_id=5f70396837d2484ca16563634aa8d2a2)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:39.421000 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2abb8-3c7a-41ef-b839-a13a77f1fa15 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:39.432423 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 161/321] 10.222.0.37 () {58 vars in 1463 bytes} [Wed Dec 29 20:36:39 2021] PUT /identity/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90/groups/a021b04f8412475ebc928368825f381d/roles/5f70396837d2484ca16563634aa8d2a2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:36:41.352978 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f48d90-9323-46de-811e-c6949eeb59a0 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:41.353524 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f48d90-9323-46de-811e-c6949eeb59a0 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:41.353524 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f48d90-9323-46de-811e-c6949eeb59a0 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:41.355275 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 161/322] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:36:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:36:41.360774 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879e094-9c56-47cf-bc8e-674dc5d37547 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:41.361194 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879e094-9c56-47cf-bc8e-674dc5d37547 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:41.361335 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879e094-9c56-47cf-bc8e-674dc5d37547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:41.383497 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-b879e094-9c56-47cf-bc8e-674dc5d37547 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:36:41.384618 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-b879e094-9c56-47cf-bc8e-674dc5d37547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:36:41.444983 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 162/323] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:36:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:36:41.468098 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f48d90-9323-46de-811e-c6949eeb59a0 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:41.479381 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f48d90-9323-46de-811e-c6949eeb59a0 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:41.483274 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2389677-8f3e-401c-88a9-401c6afc660d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:41.483987 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389677-8f3e-401c-88a9-401c6afc660d admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:41.484277 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389677-8f3e-401c-88a9-401c6afc660d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:41.484559 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389677-8f3e-401c-88a9-401c6afc660d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:41.496139 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2389677-8f3e-401c-88a9-401c6afc660d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:36:41.502809 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-b2389677-8f3e-401c-88a9-401c6afc660d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 29 20:36:41.503865 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 162/324] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:36:41 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:41.509066 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879e094-9c56-47cf-bc8e-674dc5d37547 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:41.518001 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879e094-9c56-47cf-bc8e-674dc5d37547 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:41.521780 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2fe48-5d4e-4467-a7cd-30ec8f13d5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:41.522354 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2fe48-5d4e-4467-a7cd-30ec8f13d5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:41.522640 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2fe48-5d4e-4467-a7cd-30ec8f13d5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:41.522946 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2fe48-5d4e-4467-a7cd-30ec8f13d5b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:41.523642 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2fe48-5d4e-4467-a7cd-30ec8f13d5b7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:41.523935 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2fe48-5d4e-4467-a7cd-30ec8f13d5b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:41.549775 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2fe48-5d4e-4467-a7cd-30ec8f13d5b7 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:41.557859 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 163/325] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:36:41 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:41.563049 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2389677-8f3e-401c-88a9-401c6afc660d admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:41.571979 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2389677-8f3e-401c-88a9-401c6afc660d admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:41.576624 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6e624-5e6b-4ad8-a1f0-fbad178f91e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:41.577175 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6e624-5e6b-4ad8-a1f0-fbad178f91e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:41.577462 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6e624-5e6b-4ad8-a1f0-fbad178f91e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:41.577744 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6e624-5e6b-4ad8-a1f0-fbad178f91e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:41.585180 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6e624-5e6b-4ad8-a1f0-fbad178f91e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:41.610927 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6e624-5e6b-4ad8-a1f0-fbad178f91e6 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:41.619051 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 163/326] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:36:41 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:36:41.624190 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2fe48-5d4e-4467-a7cd-30ec8f13d5b7 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:41.633228 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2fe48-5d4e-4467-a7cd-30ec8f13d5b7 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:41.636968 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ef61e-fa61-4007-b0ef-633b064a6585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:41.637730 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ef61e-fa61-4007-b0ef-633b064a6585 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:41.638548 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ef61e-fa61-4007-b0ef-633b064a6585 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:41.638853 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ef61e-fa61-4007-b0ef-633b064a6585 admin admin] PATH_INFO: `/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:41.639959 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ef61e-fa61-4007-b0ef-633b064a6585 admin admin] RBAC: Authorizing `identity:get_project(project_id=ec6ddf70badd4a05b97ea6835eaebc90)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:41.665761 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ef61e-fa61-4007-b0ef-633b064a6585 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:41.667270 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 164/327] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:36:41 2021] GET /identity/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:41.672358 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6e624-5e6b-4ad8-a1f0-fbad178f91e6 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:41.680705 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6e624-5e6b-4ad8-a1f0-fbad178f91e6 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:41.684552 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8d1a5-2d92-4695-8fae-219120e590f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:41.685573 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8d1a5-2d92-4695-8fae-219120e590f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:41.685862 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8d1a5-2d92-4695-8fae-219120e590f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:41.686143 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8d1a5-2d92-4695-8fae-219120e590f7 admin admin] PATH_INFO: `/v3/groups/a021b04f8412475ebc928368825f381d` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:41.687232 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8d1a5-2d92-4695-8fae-219120e590f7 admin admin] RBAC: Authorizing `identity:get_group(group_id=a021b04f8412475ebc928368825f381d)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:41.713280 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8d1a5-2d92-4695-8fae-219120e590f7 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:41.714708 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 164/328] 10.222.0.37 () {56 vars in 1201 bytes} [Wed Dec 29 20:36:41 2021] GET /identity/v3/groups/a021b04f8412475ebc928368825f381d => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:41.720387 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ef61e-fa61-4007-b0ef-633b064a6585 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:41.729303 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ef61e-fa61-4007-b0ef-633b064a6585 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:41.733209 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376535f-ee79-4c30-aceb-d82dbc72f966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:41.733760 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376535f-ee79-4c30-aceb-d82dbc72f966 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:41.734041 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376535f-ee79-4c30-aceb-d82dbc72f966 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:41.734316 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376535f-ee79-4c30-aceb-d82dbc72f966 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:41.735107 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376535f-ee79-4c30-aceb-d82dbc72f966 admin admin] RBAC: Adding query filter params (group.id=a021b04f8412475ebc928368825f381d, role.id=5f70396837d2484ca16563634aa8d2a2, scope.project.id=ec6ddf70badd4a05b97ea6835eaebc90) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:41.735406 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376535f-ee79-4c30-aceb-d82dbc72f966 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:41.761095 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376535f-ee79-4c30-aceb-d82dbc72f966 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:41.767305 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 165/329] 10.222.0.37 () {56 vars in 1397 bytes} [Wed Dec 29 20:36:41 2021] GET /identity/v3/role_assignments?group.id=a021b04f8412475ebc928368825f381d&scope.project.id=ec6ddf70badd4a05b97ea6835eaebc90&role.id=5f70396837d2484ca16563634aa8d2a2 => generated 611 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:43.699120 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89df75-73d5-4a66-bea7-f9317ae610b1 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:43.699935 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89df75-73d5-4a66-bea7-f9317ae610b1 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:43.699935 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89df75-73d5-4a66-bea7-f9317ae610b1 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:43.701610 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 165/330] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:36:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:36:43.708814 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cc902-b4cb-44a9-bb38-2fdd15690467 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:43.709192 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cc902-b4cb-44a9-bb38-2fdd15690467 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:43.709378 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cc902-b4cb-44a9-bb38-2fdd15690467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:43.731161 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-809cc902-b4cb-44a9-bb38-2fdd15690467 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:36:43.732993 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-809cc902-b4cb-44a9-bb38-2fdd15690467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:36:43.739481 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 166/331] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:36:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:36:43.761691 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89df75-73d5-4a66-bea7-f9317ae610b1 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:43.773074 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89df75-73d5-4a66-bea7-f9317ae610b1 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:43.776848 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069c2ac-5c90-4200-8bd4-c1fd72178065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:43.777552 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069c2ac-5c90-4200-8bd4-c1fd72178065 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:43.777843 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069c2ac-5c90-4200-8bd4-c1fd72178065 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:43.778128 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069c2ac-5c90-4200-8bd4-c1fd72178065 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:43.789229 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069c2ac-5c90-4200-8bd4-c1fd72178065 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:36:43.796304 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-4069c2ac-5c90-4200-8bd4-c1fd72178065 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:36:43.797365 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 166/332] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:36:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:43.802635 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cc902-b4cb-44a9-bb38-2fdd15690467 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:43.811657 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cc902-b4cb-44a9-bb38-2fdd15690467 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:43.815482 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9bf5c-7cce-4e7f-9cf7-58faa5472137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:43.816067 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9bf5c-7cce-4e7f-9cf7-58faa5472137 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:43.816347 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9bf5c-7cce-4e7f-9cf7-58faa5472137 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:43.816624 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9bf5c-7cce-4e7f-9cf7-58faa5472137 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:43.817320 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9bf5c-7cce-4e7f-9cf7-58faa5472137 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:43.817617 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9bf5c-7cce-4e7f-9cf7-58faa5472137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:43.842882 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9bf5c-7cce-4e7f-9cf7-58faa5472137 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:43.851311 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 167/333] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:36:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:43.857217 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069c2ac-5c90-4200-8bd4-c1fd72178065 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:43.867617 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069c2ac-5c90-4200-8bd4-c1fd72178065 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:43.871474 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee96ee-d1e2-4468-a627-df8e0c258674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:43.872034 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee96ee-d1e2-4468-a627-df8e0c258674 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:43.872957 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee96ee-d1e2-4468-a627-df8e0c258674 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:43.873250 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee96ee-d1e2-4468-a627-df8e0c258674 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:43.880699 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee96ee-d1e2-4468-a627-df8e0c258674 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:43.905909 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee96ee-d1e2-4468-a627-df8e0c258674 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:43.914096 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 167/334] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:36:43 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:36:43.919840 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9bf5c-7cce-4e7f-9cf7-58faa5472137 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:43.928820 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9bf5c-7cce-4e7f-9cf7-58faa5472137 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:43.932578 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f2f38-6f1c-40d7-9b18-1b156e0e2099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:43.933339 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f2f38-6f1c-40d7-9b18-1b156e0e2099 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:43.933624 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f2f38-6f1c-40d7-9b18-1b156e0e2099 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:43.933901 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f2f38-6f1c-40d7-9b18-1b156e0e2099 admin admin] PATH_INFO: `/v3/projects/9d612e74acbd4ec5ba77fbe2eb639fcf` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:43.935604 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f2f38-6f1c-40d7-9b18-1b156e0e2099 admin admin] RBAC: Authorizing `identity:get_project(project_id=9d612e74acbd4ec5ba77fbe2eb639fcf)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:43.961011 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f2f38-6f1c-40d7-9b18-1b156e0e2099 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:43.962445 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 168/335] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:36:43 2021] GET /identity/v3/projects/9d612e74acbd4ec5ba77fbe2eb639fcf => generated 344 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:43.968060 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee96ee-d1e2-4468-a627-df8e0c258674 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:43.976249 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee96ee-d1e2-4468-a627-df8e0c258674 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:43.980091 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52d217-f1bb-4b8a-ab32-5daa128e7f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:43.980849 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52d217-f1bb-4b8a-ab32-5daa128e7f2f admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:43.981134 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52d217-f1bb-4b8a-ab32-5daa128e7f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:43.981413 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52d217-f1bb-4b8a-ab32-5daa128e7f2f admin admin] PATH_INFO: `/v3/groups/638b7fa1194f4d0693e0f0e4d6336e01` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:43.986490 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52d217-f1bb-4b8a-ab32-5daa128e7f2f admin admin] RBAC: Authorizing `identity:get_group(group_id=638b7fa1194f4d0693e0f0e4d6336e01)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:44.011819 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52d217-f1bb-4b8a-ab32-5daa128e7f2f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:44.013276 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 168/336] 10.222.0.37 () {56 vars in 1201 bytes} [Wed Dec 29 20:36:43 2021] GET /identity/v3/groups/638b7fa1194f4d0693e0f0e4d6336e01 => generated 229 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:36:44.018321 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f2f38-6f1c-40d7-9b18-1b156e0e2099 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:44.027211 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f2f38-6f1c-40d7-9b18-1b156e0e2099 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:44.031586 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfdf6e-c1fc-4dbb-a95b-2708e3404ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:44.032130 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfdf6e-c1fc-4dbb-a95b-2708e3404ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:44.032414 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfdf6e-c1fc-4dbb-a95b-2708e3404ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:44.032692 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfdf6e-c1fc-4dbb-a95b-2708e3404ee0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:44.033441 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfdf6e-c1fc-4dbb-a95b-2708e3404ee0 admin admin] RBAC: Adding query filter params (group.id=638b7fa1194f4d0693e0f0e4d6336e01, role.id=e66e6a94ba014fd193b851ceb92695ae, scope.project.id=9d612e74acbd4ec5ba77fbe2eb639fcf) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:44.033738 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfdf6e-c1fc-4dbb-a95b-2708e3404ee0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:44.059436 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfdf6e-c1fc-4dbb-a95b-2708e3404ee0 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:44.064855 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 169/337] 10.222.0.37 () {56 vars in 1397 bytes} [Wed Dec 29 20:36:44 2021] GET /identity/v3/role_assignments?group.id=638b7fa1194f4d0693e0f0e4d6336e01&scope.project.id=9d612e74acbd4ec5ba77fbe2eb639fcf&role.id=e66e6a94ba014fd193b851ceb92695ae => generated 260 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:45.990205 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428c57f-3ef9-4850-b40e-7e34aa9a9bf9 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:45.990751 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428c57f-3ef9-4850-b40e-7e34aa9a9bf9 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:45.990841 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428c57f-3ef9-4850-b40e-7e34aa9a9bf9 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:45.992451 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 169/338] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:36:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:36:45.997790 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f67b17-fba4-42d8-8303-2542a38eb248 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:45.998158 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f67b17-fba4-42d8-8303-2542a38eb248 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:45.998352 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f67b17-fba4-42d8-8303-2542a38eb248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:46.021643 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-d7f67b17-fba4-42d8-8303-2542a38eb248 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:36:46.022781 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-d7f67b17-fba4-42d8-8303-2542a38eb248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:36:46.029821 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 170/339] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:36:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:36:46.050777 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428c57f-3ef9-4850-b40e-7e34aa9a9bf9 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:46.062055 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428c57f-3ef9-4850-b40e-7e34aa9a9bf9 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:46.065791 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff3e5d-daf0-4ea4-9d63-27246596f50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:46.066489 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff3e5d-daf0-4ea4-9d63-27246596f50f admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:46.066812 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff3e5d-daf0-4ea4-9d63-27246596f50f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:46.067092 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff3e5d-daf0-4ea4-9d63-27246596f50f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:46.078988 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff3e5d-daf0-4ea4-9d63-27246596f50f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:36:46.085176 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-71ff3e5d-daf0-4ea4-9d63-27246596f50f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:36:46.086253 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 170/340] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:36:46 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:46.092350 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f67b17-fba4-42d8-8303-2542a38eb248 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:46.100683 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f67b17-fba4-42d8-8303-2542a38eb248 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:46.104511 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166a29a-fcd5-4b02-9129-b54573f0476f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:46.105086 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166a29a-fcd5-4b02-9129-b54573f0476f admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:46.105367 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166a29a-fcd5-4b02-9129-b54573f0476f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:46.105643 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166a29a-fcd5-4b02-9129-b54573f0476f admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:46.106338 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166a29a-fcd5-4b02-9129-b54573f0476f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:46.106682 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166a29a-fcd5-4b02-9129-b54573f0476f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:46.131925 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166a29a-fcd5-4b02-9129-b54573f0476f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:46.140726 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 171/341] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:36:46 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:46.145831 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff3e5d-daf0-4ea4-9d63-27246596f50f admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:46.156341 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff3e5d-daf0-4ea4-9d63-27246596f50f admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:46.160204 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b20d2-30b5-4420-a36d-4f4b2ecb06f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:46.160955 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b20d2-30b5-4420-a36d-4f4b2ecb06f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:46.161244 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b20d2-30b5-4420-a36d-4f4b2ecb06f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:46.161524 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b20d2-30b5-4420-a36d-4f4b2ecb06f8 admin admin] PATH_INFO: `/v3/groups/638b7fa1194f4d0693e0f0e4d6336e01` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:46.162564 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b20d2-30b5-4420-a36d-4f4b2ecb06f8 admin admin] RBAC: Authorizing `identity:get_group(group_id=638b7fa1194f4d0693e0f0e4d6336e01)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:46.188201 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b20d2-30b5-4420-a36d-4f4b2ecb06f8 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:46.189606 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 171/342] 10.222.0.37 () {56 vars in 1201 bytes} [Wed Dec 29 20:36:46 2021] GET /identity/v3/groups/638b7fa1194f4d0693e0f0e4d6336e01 => generated 229 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:46.194346 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166a29a-fcd5-4b02-9129-b54573f0476f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:46.204092 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166a29a-fcd5-4b02-9129-b54573f0476f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:46.207912 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4b282-799a-448c-b7c3-e2d7f3d00d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:46.208673 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4b282-799a-448c-b7c3-e2d7f3d00d2a admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:46.208955 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4b282-799a-448c-b7c3-e2d7f3d00d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:46.209229 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4b282-799a-448c-b7c3-e2d7f3d00d2a admin admin] PATH_INFO: `/v3/projects/9d612e74acbd4ec5ba77fbe2eb639fcf` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:46.210270 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4b282-799a-448c-b7c3-e2d7f3d00d2a admin admin] RBAC: Authorizing `identity:get_project(project_id=9d612e74acbd4ec5ba77fbe2eb639fcf)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:46.236241 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4b282-799a-448c-b7c3-e2d7f3d00d2a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:46.237699 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 172/343] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:36:46 2021] GET /identity/v3/projects/9d612e74acbd4ec5ba77fbe2eb639fcf => generated 344 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:46.242648 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b20d2-30b5-4420-a36d-4f4b2ecb06f8 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:46.252329 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b20d2-30b5-4420-a36d-4f4b2ecb06f8 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:46.256087 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b077218-67e1-4c5b-8169-48fb8c3bffb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:46.256861 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b077218-67e1-4c5b-8169-48fb8c3bffb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:46.257143 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b077218-67e1-4c5b-8169-48fb8c3bffb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:46.257421 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b077218-67e1-4c5b-8169-48fb8c3bffb5 admin admin] PATH_INFO: `/v3/projects/9d612e74acbd4ec5ba77fbe2eb639fcf/groups/638b7fa1194f4d0693e0f0e4d6336e01/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:46.259144 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b077218-67e1-4c5b-8169-48fb8c3bffb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d612e74acbd4ec5ba77fbe2eb639fcf, group_id=638b7fa1194f4d0693e0f0e4d6336e01, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:46.285664 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b077218-67e1-4c5b-8169-48fb8c3bffb5 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:46.297486 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 172/344] 10.222.0.37 () {58 vars in 1463 bytes} [Wed Dec 29 20:36:46 2021] PUT /identity/v3/projects/9d612e74acbd4ec5ba77fbe2eb639fcf/groups/638b7fa1194f4d0693e0f0e4d6336e01/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:36:48.217204 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11986041-1731-43b1-9b25-bfb76c934a5c None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:48.217691 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11986041-1731-43b1-9b25-bfb76c934a5c None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:48.217691 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11986041-1731-43b1-9b25-bfb76c934a5c None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:48.219385 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 173/345] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:36:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:36:48.224395 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9fe1d-5835-4c34-99ea-faa3d52b070f None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:48.224759 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9fe1d-5835-4c34-99ea-faa3d52b070f None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:48.224955 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9fe1d-5835-4c34-99ea-faa3d52b070f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:48.247719 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-d2d9fe1d-5835-4c34-99ea-faa3d52b070f None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:36:48.249001 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-d2d9fe1d-5835-4c34-99ea-faa3d52b070f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:36:48.311408 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 173/346] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:36:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:36:48.333588 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11986041-1731-43b1-9b25-bfb76c934a5c None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:48.345079 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11986041-1731-43b1-9b25-bfb76c934a5c None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:48.348814 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7657666-5956-4bdc-abb6-8aa0ae6b3ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:48.349515 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7657666-5956-4bdc-abb6-8aa0ae6b3ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:48.349801 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7657666-5956-4bdc-abb6-8aa0ae6b3ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:48.350080 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7657666-5956-4bdc-abb6-8aa0ae6b3ef6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:48.362319 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7657666-5956-4bdc-abb6-8aa0ae6b3ef6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:36:48.368542 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-f7657666-5956-4bdc-abb6-8aa0ae6b3ef6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:36:48.369601 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 174/347] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:36:48 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:48.375676 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9fe1d-5835-4c34-99ea-faa3d52b070f None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:48.383945 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9fe1d-5835-4c34-99ea-faa3d52b070f None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:48.387775 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033c331-0faa-42c7-89d3-81660a00fd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:48.388345 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033c331-0faa-42c7-89d3-81660a00fd18 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:48.388630 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033c331-0faa-42c7-89d3-81660a00fd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:48.388908 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033c331-0faa-42c7-89d3-81660a00fd18 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:48.389609 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033c331-0faa-42c7-89d3-81660a00fd18 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:48.389900 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033c331-0faa-42c7-89d3-81660a00fd18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:48.414885 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033c331-0faa-42c7-89d3-81660a00fd18 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:48.423677 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 174/348] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:36:48 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:48.428832 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7657666-5956-4bdc-abb6-8aa0ae6b3ef6 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:48.438383 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7657666-5956-4bdc-abb6-8aa0ae6b3ef6 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:48.442200 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca0aba-eae2-4fe0-b5e8-decdb414c08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:48.442791 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca0aba-eae2-4fe0-b5e8-decdb414c08d admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:48.443080 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca0aba-eae2-4fe0-b5e8-decdb414c08d admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:48.443360 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca0aba-eae2-4fe0-b5e8-decdb414c08d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:48.451213 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca0aba-eae2-4fe0-b5e8-decdb414c08d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:48.476993 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca0aba-eae2-4fe0-b5e8-decdb414c08d admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:48.485826 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 175/349] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:36:48 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:36:48.490847 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033c331-0faa-42c7-89d3-81660a00fd18 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:48.499834 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033c331-0faa-42c7-89d3-81660a00fd18 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:48.503583 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1824a-648a-402e-96f1-2976f2fdeb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:48.504339 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1824a-648a-402e-96f1-2976f2fdeb36 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:48.504623 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1824a-648a-402e-96f1-2976f2fdeb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:48.504901 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1824a-648a-402e-96f1-2976f2fdeb36 admin admin] PATH_INFO: `/v3/projects/9d612e74acbd4ec5ba77fbe2eb639fcf` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:48.505955 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1824a-648a-402e-96f1-2976f2fdeb36 admin admin] RBAC: Authorizing `identity:get_project(project_id=9d612e74acbd4ec5ba77fbe2eb639fcf)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:48.532744 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1824a-648a-402e-96f1-2976f2fdeb36 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:48.534242 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 175/350] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:36:48 2021] GET /identity/v3/projects/9d612e74acbd4ec5ba77fbe2eb639fcf => generated 344 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:48.539310 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca0aba-eae2-4fe0-b5e8-decdb414c08d admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:48.548946 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca0aba-eae2-4fe0-b5e8-decdb414c08d admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:48.552828 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbb982-11df-4c2e-b3c4-093658228ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:48.553591 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbb982-11df-4c2e-b3c4-093658228ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:48.553876 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbb982-11df-4c2e-b3c4-093658228ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:48.554155 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbb982-11df-4c2e-b3c4-093658228ff2 admin admin] PATH_INFO: `/v3/groups/638b7fa1194f4d0693e0f0e4d6336e01` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:48.555201 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fbb982-11df-4c2e-b3c4-093658228ff2 admin admin] RBAC: Authorizing `identity:get_group(group_id=638b7fa1194f4d0693e0f0e4d6336e01)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:48.580631 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fbb982-11df-4c2e-b3c4-093658228ff2 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:48.582050 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 176/351] 10.222.0.37 () {56 vars in 1201 bytes} [Wed Dec 29 20:36:48 2021] GET /identity/v3/groups/638b7fa1194f4d0693e0f0e4d6336e01 => generated 229 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:48.587058 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1824a-648a-402e-96f1-2976f2fdeb36 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:48.596700 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1824a-648a-402e-96f1-2976f2fdeb36 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:48.600479 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a019b-ba9c-4fdd-8552-ea5865697e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:48.601037 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a019b-ba9c-4fdd-8552-ea5865697e15 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:48.601318 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a019b-ba9c-4fdd-8552-ea5865697e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:48.601592 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a019b-ba9c-4fdd-8552-ea5865697e15 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:48.602353 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a019b-ba9c-4fdd-8552-ea5865697e15 admin admin] RBAC: Adding query filter params (group.id=638b7fa1194f4d0693e0f0e4d6336e01, role.id=e66e6a94ba014fd193b851ceb92695ae, scope.project.id=9d612e74acbd4ec5ba77fbe2eb639fcf) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:48.602672 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a019b-ba9c-4fdd-8552-ea5865697e15 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:48.628880 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a019b-ba9c-4fdd-8552-ea5865697e15 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:48.634319 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 176/352] 10.222.0.37 () {56 vars in 1397 bytes} [Wed Dec 29 20:36:48 2021] GET /identity/v3/role_assignments?group.id=638b7fa1194f4d0693e0f0e4d6336e01&scope.project.id=9d612e74acbd4ec5ba77fbe2eb639fcf&role.id=e66e6a94ba014fd193b851ceb92695ae => generated 611 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:50.630959 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3cd40-2ef8-4053-b27a-2689a2d67d7f None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:50.631479 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3cd40-2ef8-4053-b27a-2689a2d67d7f None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:50.631582 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3cd40-2ef8-4053-b27a-2689a2d67d7f None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:50.633165 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 177/353] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:36:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:36:50.638398 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c42a4-f091-48bc-981d-d0c63003975b None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:50.638797 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c42a4-f091-48bc-981d-d0c63003975b None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:50.639009 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c42a4-f091-48bc-981d-d0c63003975b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:50.660874 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-937c42a4-f091-48bc-981d-d0c63003975b None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:36:50.661987 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-937c42a4-f091-48bc-981d-d0c63003975b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:36:50.668615 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 177/354] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:36:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:36:50.692374 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3cd40-2ef8-4053-b27a-2689a2d67d7f None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:50.703981 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3cd40-2ef8-4053-b27a-2689a2d67d7f None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:50.707726 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f6fe2-e152-4f3b-8af1-398929fd4892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:50.708418 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f6fe2-e152-4f3b-8af1-398929fd4892 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:50.708701 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f6fe2-e152-4f3b-8af1-398929fd4892 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:50.708976 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f6fe2-e152-4f3b-8af1-398929fd4892 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:50.721324 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f6fe2-e152-4f3b-8af1-398929fd4892 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:50.746756 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f6fe2-e152-4f3b-8af1-398929fd4892 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:50.762857 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-925f6fe2-e152-4f3b-8af1-398929fd4892 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:36:50.763975 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 178/355] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:36:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:50.770076 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c42a4-f091-48bc-981d-d0c63003975b None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:50.779108 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c42a4-f091-48bc-981d-d0c63003975b None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:50.782995 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a858280-55e7-40df-9f4f-54e28ed03b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:50.783573 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a858280-55e7-40df-9f4f-54e28ed03b12 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:50.783863 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a858280-55e7-40df-9f4f-54e28ed03b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:50.784147 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a858280-55e7-40df-9f4f-54e28ed03b12 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:50.784837 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a858280-55e7-40df-9f4f-54e28ed03b12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:50.785137 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a858280-55e7-40df-9f4f-54e28ed03b12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:50.811095 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a858280-55e7-40df-9f4f-54e28ed03b12 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:50.823570 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 178/356] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:36:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:50.828985 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f6fe2-e152-4f3b-8af1-398929fd4892 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:50.837952 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f6fe2-e152-4f3b-8af1-398929fd4892 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:50.842300 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953abddd-9431-4efa-81a6-cd4484faecbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:50.842900 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953abddd-9431-4efa-81a6-cd4484faecbf admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:50.843187 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953abddd-9431-4efa-81a6-cd4484faecbf admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:50.843460 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953abddd-9431-4efa-81a6-cd4484faecbf admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:50.844097 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953abddd-9431-4efa-81a6-cd4484faecbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:50.868826 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING py.warnings [None req-953abddd-9431-4efa-81a6-cd4484faecbf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:36:50.868826 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: warnings.warn(msg) Dec 29 20:36:50.868826 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: Dec 29 20:36:50.869986 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953abddd-9431-4efa-81a6-cd4484faecbf admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:50.892918 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 179/357] 10.222.0.37 () {60 vars in 1153 bytes} [Wed Dec 29 20:36:50 2021] POST /identity/v3/users => generated 246 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:36:52.835235 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6a52d-7ed3-4d84-9500-f90ddcc8b3b8 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:52.835782 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6a52d-7ed3-4d84-9500-f90ddcc8b3b8 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:52.835782 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6a52d-7ed3-4d84-9500-f90ddcc8b3b8 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:52.837427 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 179/358] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:36:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:36:52.843224 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be8c98-a6ca-42d6-8dd0-b67796688d8a None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:52.843609 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be8c98-a6ca-42d6-8dd0-b67796688d8a None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:52.843928 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be8c98-a6ca-42d6-8dd0-b67796688d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:52.865534 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-91be8c98-a6ca-42d6-8dd0-b67796688d8a None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:36:52.866698 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-91be8c98-a6ca-42d6-8dd0-b67796688d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:36:52.873322 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 180/359] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:36:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:36:52.895729 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6a52d-7ed3-4d84-9500-f90ddcc8b3b8 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:52.907873 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6a52d-7ed3-4d84-9500-f90ddcc8b3b8 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:52.911645 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65386807-89ab-4b8a-ac34-188bed09bd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:52.912344 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65386807-89ab-4b8a-ac34-188bed09bd42 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:52.912629 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65386807-89ab-4b8a-ac34-188bed09bd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:52.912909 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65386807-89ab-4b8a-ac34-188bed09bd42 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:52.923726 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65386807-89ab-4b8a-ac34-188bed09bd42 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:36:52.930000 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-65386807-89ab-4b8a-ac34-188bed09bd42 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 29 20:36:52.931083 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 180/360] 10.222.0.37 () {56 vars in 1123 bytes} [Wed Dec 29 20:36:52 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:52.936890 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be8c98-a6ca-42d6-8dd0-b67796688d8a None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:52.945351 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be8c98-a6ca-42d6-8dd0-b67796688d8a None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:52.950702 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777de2f-4a2e-424f-9ccd-e923ede9208d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:52.951373 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777de2f-4a2e-424f-9ccd-e923ede9208d admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:52.951658 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777de2f-4a2e-424f-9ccd-e923ede9208d admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:52.951933 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777de2f-4a2e-424f-9ccd-e923ede9208d admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:52.952633 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777de2f-4a2e-424f-9ccd-e923ede9208d admin admin] RBAC: Adding query filter params (name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:52.952925 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777de2f-4a2e-424f-9ccd-e923ede9208d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:52.979378 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777de2f-4a2e-424f-9ccd-e923ede9208d admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:52.987588 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 181/361] 10.222.0.37 () {56 vars in 1124 bytes} [Wed Dec 29 20:36:52 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:52.992995 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65386807-89ab-4b8a-ac34-188bed09bd42 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:53.003188 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65386807-89ab-4b8a-ac34-188bed09bd42 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:53.007022 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558d755-93d4-4686-997a-4ca2b04d1838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:53.007725 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558d755-93d4-4686-997a-4ca2b04d1838 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:53.008014 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558d755-93d4-4686-997a-4ca2b04d1838 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:53.008297 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558d755-93d4-4686-997a-4ca2b04d1838 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:53.019892 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558d755-93d4-4686-997a-4ca2b04d1838 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:53.045659 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558d755-93d4-4686-997a-4ca2b04d1838 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:53.063326 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-d558d755-93d4-4686-997a-4ca2b04d1838 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:36:53.064366 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 181/362] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:36:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:53.069493 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777de2f-4a2e-424f-9ccd-e923ede9208d admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:53.079377 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777de2f-4a2e-424f-9ccd-e923ede9208d admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:53.083120 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce0caf-2f5f-49e4-8c8b-40bc64789b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:53.083689 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0caf-2f5f-49e4-8c8b-40bc64789b08 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:53.083973 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0caf-2f5f-49e4-8c8b-40bc64789b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:53.084531 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0caf-2f5f-49e4-8c8b-40bc64789b08 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:53.085203 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce0caf-2f5f-49e4-8c8b-40bc64789b08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:53.085549 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce0caf-2f5f-49e4-8c8b-40bc64789b08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:53.110301 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING py.warnings [None req-2dce0caf-2f5f-49e4-8c8b-40bc64789b08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:36:53.110301 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: warnings.warn(msg) Dec 29 20:36:53.110301 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: Dec 29 20:36:53.111174 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce0caf-2f5f-49e4-8c8b-40bc64789b08 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:53.124363 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 182/363] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:36:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:53.129472 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558d755-93d4-4686-997a-4ca2b04d1838 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:53.139138 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558d755-93d4-4686-997a-4ca2b04d1838 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:53.142988 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24597bfb-4ce1-461d-abd6-d95033a1d717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:53.143692 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24597bfb-4ce1-461d-abd6-d95033a1d717 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:53.143982 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24597bfb-4ce1-461d-abd6-d95033a1d717 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:53.144266 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24597bfb-4ce1-461d-abd6-d95033a1d717 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:53.156809 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24597bfb-4ce1-461d-abd6-d95033a1d717 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:53.182623 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24597bfb-4ce1-461d-abd6-d95033a1d717 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:53.201105 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-24597bfb-4ce1-461d-abd6-d95033a1d717 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 29 20:36:53.202150 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 182/364] 10.222.0.37 () {56 vars in 1114 bytes} [Wed Dec 29 20:36:53 2021] GET /identity/v3/users/nova => generated 82 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:53.207381 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce0caf-2f5f-49e4-8c8b-40bc64789b08 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:53.216732 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce0caf-2f5f-49e4-8c8b-40bc64789b08 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:53.220578 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dad106-78a7-456a-882b-124060941ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:53.221194 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dad106-78a7-456a-882b-124060941ada admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:53.221486 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dad106-78a7-456a-882b-124060941ada admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:53.221768 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dad106-78a7-456a-882b-124060941ada admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:53.222553 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dad106-78a7-456a-882b-124060941ada admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:53.222897 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dad106-78a7-456a-882b-124060941ada admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:53.247903 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING py.warnings [None req-b4dad106-78a7-456a-882b-124060941ada admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:36:53.247903 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: warnings.warn(msg) Dec 29 20:36:53.247903 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: Dec 29 20:36:53.249009 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dad106-78a7-456a-882b-124060941ada admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:53.278032 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 183/365] 10.222.0.37 () {56 vars in 1154 bytes} [Wed Dec 29 20:36:53 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:53.283250 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24597bfb-4ce1-461d-abd6-d95033a1d717 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:53.292299 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24597bfb-4ce1-461d-abd6-d95033a1d717 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:53.296135 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4304b0-9b8a-4e33-ba2e-2a26ed081a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:53.296699 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4304b0-9b8a-4e33-ba2e-2a26ed081a97 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:53.296988 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4304b0-9b8a-4e33-ba2e-2a26ed081a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:53.297270 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4304b0-9b8a-4e33-ba2e-2a26ed081a97 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:53.304717 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4304b0-9b8a-4e33-ba2e-2a26ed081a97 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:53.331692 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4304b0-9b8a-4e33-ba2e-2a26ed081a97 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:53.340074 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 183/366] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:36:53 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:36:53.345215 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dad106-78a7-456a-882b-124060941ada admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:53.354148 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dad106-78a7-456a-882b-124060941ada admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:53.358506 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b85ad-9fb8-4d49-8426-c2065d08a606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:53.359244 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b85ad-9fb8-4d49-8426-c2065d08a606 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:53.359529 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b85ad-9fb8-4d49-8426-c2065d08a606 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:53.359805 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b85ad-9fb8-4d49-8426-c2065d08a606 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:53.370905 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b85ad-9fb8-4d49-8426-c2065d08a606 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:53.396763 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b85ad-9fb8-4d49-8426-c2065d08a606 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:53.412935 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-d72b85ad-9fb8-4d49-8426-c2065d08a606 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:36:53.413958 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 184/367] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:36:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:36:53.419491 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4304b0-9b8a-4e33-ba2e-2a26ed081a97 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:53.427821 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4304b0-9b8a-4e33-ba2e-2a26ed081a97 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:53.431748 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd21a97-5ea2-4cbd-84e9-afb7428c51ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:53.432319 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd21a97-5ea2-4cbd-84e9-afb7428c51ac admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:53.432610 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd21a97-5ea2-4cbd-84e9-afb7428c51ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:53.432893 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd21a97-5ea2-4cbd-84e9-afb7428c51ac admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:53.433568 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd21a97-5ea2-4cbd-84e9-afb7428c51ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:53.433869 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd21a97-5ea2-4cbd-84e9-afb7428c51ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:53.459755 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd21a97-5ea2-4cbd-84e9-afb7428c51ac admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:53.472346 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 184/368] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:36:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:53.477278 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b85ad-9fb8-4d49-8426-c2065d08a606 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:53.486866 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b85ad-9fb8-4d49-8426-c2065d08a606 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:53.490606 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf6afe-ecb6-4a2b-b0d5-0cc75d90a2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:53.491318 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf6afe-ecb6-4a2b-b0d5-0cc75d90a2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:53.491601 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf6afe-ecb6-4a2b-b0d5-0cc75d90a2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:53.491874 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf6afe-ecb6-4a2b-b0d5-0cc75d90a2d3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:53.501023 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf6afe-ecb6-4a2b-b0d5-0cc75d90a2d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:53.526214 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf6afe-ecb6-4a2b-b0d5-0cc75d90a2d3 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:53.539487 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-29cf6afe-ecb6-4a2b-b0d5-0cc75d90a2d3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:36:53.540513 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 185/369] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:36:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:53.546243 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd21a97-5ea2-4cbd-84e9-afb7428c51ac admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:53.555293 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd21a97-5ea2-4cbd-84e9-afb7428c51ac admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:53.559088 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dccdb8-62a8-4501-961a-916ace4f25e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:53.560214 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dccdb8-62a8-4501-961a-916ace4f25e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:53.560493 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dccdb8-62a8-4501-961a-916ace4f25e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:53.560768 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dccdb8-62a8-4501-961a-916ace4f25e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:53.561498 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dccdb8-62a8-4501-961a-916ace4f25e3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:53.561798 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dccdb8-62a8-4501-961a-916ace4f25e3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:53.586359 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING py.warnings [None req-85dccdb8-62a8-4501-961a-916ace4f25e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:36:53.586359 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: warnings.warn(msg) Dec 29 20:36:53.586359 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: Dec 29 20:36:53.587479 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dccdb8-62a8-4501-961a-916ace4f25e3 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:53.600433 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 185/370] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:36:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:53.605606 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf6afe-ecb6-4a2b-b0d5-0cc75d90a2d3 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:53.615020 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf6afe-ecb6-4a2b-b0d5-0cc75d90a2d3 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:53.618782 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd747fc-d3aa-48fc-b6a8-8f47666b96c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:53.619339 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd747fc-d3aa-48fc-b6a8-8f47666b96c9 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:53.619621 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd747fc-d3aa-48fc-b6a8-8f47666b96c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:53.619898 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd747fc-d3aa-48fc-b6a8-8f47666b96c9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:53.620656 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd747fc-d3aa-48fc-b6a8-8f47666b96c9 admin admin] RBAC: Adding query filter params (role.id=1c5a8286caa54ded9e44ef97f73f6776, scope.project.id=ed634cf9bb9146f7a9738325a8638b70, user.id=51ef7e54d97a4320bda0c1926d190d8e) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:53.620953 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd747fc-d3aa-48fc-b6a8-8f47666b96c9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:53.647081 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd747fc-d3aa-48fc-b6a8-8f47666b96c9 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:53.652256 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 186/371] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:36:53 2021] GET /identity/v3/role_assignments?user.id=51ef7e54d97a4320bda0c1926d190d8e&scope.project.id=ed634cf9bb9146f7a9738325a8638b70&role.id=1c5a8286caa54ded9e44ef97f73f6776 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:55.599561 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf287808-3533-497c-bee0-3ffa5435d6bd None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:55.600174 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf287808-3533-497c-bee0-3ffa5435d6bd None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:55.600174 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf287808-3533-497c-bee0-3ffa5435d6bd None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:55.601774 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 186/372] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:36:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:36:55.607455 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9f9fd-23b5-4af7-857d-30fc2d1b1d50 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:55.607892 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9f9fd-23b5-4af7-857d-30fc2d1b1d50 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:55.608023 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9f9fd-23b5-4af7-857d-30fc2d1b1d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:55.630358 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-bfd9f9fd-23b5-4af7-857d-30fc2d1b1d50 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:36:55.631507 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-bfd9f9fd-23b5-4af7-857d-30fc2d1b1d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:36:55.638071 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 187/373] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:36:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:36:55.659221 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf287808-3533-497c-bee0-3ffa5435d6bd None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:55.671129 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf287808-3533-497c-bee0-3ffa5435d6bd None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:55.674815 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f5a26-9339-4a4b-a932-d577e98207bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:55.675511 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f5a26-9339-4a4b-a932-d577e98207bc admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:55.675796 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f5a26-9339-4a4b-a932-d577e98207bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:55.676073 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f5a26-9339-4a4b-a932-d577e98207bc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:55.687645 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f5a26-9339-4a4b-a932-d577e98207bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:36:55.693879 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-133f5a26-9339-4a4b-a932-d577e98207bc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 29 20:36:55.694953 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 187/374] 10.222.0.37 () {56 vars in 1123 bytes} [Wed Dec 29 20:36:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:55.700524 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9f9fd-23b5-4af7-857d-30fc2d1b1d50 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:55.708926 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9f9fd-23b5-4af7-857d-30fc2d1b1d50 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:55.712751 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbe5f2-bb7a-4c21-9ec7-a48dfd1a34b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:55.713329 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbe5f2-bb7a-4c21-9ec7-a48dfd1a34b2 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:55.713614 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbe5f2-bb7a-4c21-9ec7-a48dfd1a34b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:55.713893 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbe5f2-bb7a-4c21-9ec7-a48dfd1a34b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:55.714588 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbe5f2-bb7a-4c21-9ec7-a48dfd1a34b2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:55.714914 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbe5f2-bb7a-4c21-9ec7-a48dfd1a34b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:55.740465 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbe5f2-bb7a-4c21-9ec7-a48dfd1a34b2 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:55.749106 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 188/375] 10.222.0.37 () {56 vars in 1124 bytes} [Wed Dec 29 20:36:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:55.754202 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f5a26-9339-4a4b-a932-d577e98207bc admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:55.763748 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f5a26-9339-4a4b-a932-d577e98207bc admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:55.767569 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24d0f1-0987-4851-91f7-555e88e1e976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:55.768263 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24d0f1-0987-4851-91f7-555e88e1e976 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:55.768551 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24d0f1-0987-4851-91f7-555e88e1e976 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:55.768832 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24d0f1-0987-4851-91f7-555e88e1e976 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:55.779786 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24d0f1-0987-4851-91f7-555e88e1e976 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:55.805748 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24d0f1-0987-4851-91f7-555e88e1e976 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:55.823477 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-5f24d0f1-0987-4851-91f7-555e88e1e976 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:36:55.824831 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 188/376] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:36:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:36:55.830194 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbe5f2-bb7a-4c21-9ec7-a48dfd1a34b2 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:55.839317 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbe5f2-bb7a-4c21-9ec7-a48dfd1a34b2 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:55.843276 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452bd6d-a57d-4916-b128-ac0f7f450acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:55.843847 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452bd6d-a57d-4916-b128-ac0f7f450acb admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:55.844133 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452bd6d-a57d-4916-b128-ac0f7f450acb admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:55.844468 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452bd6d-a57d-4916-b128-ac0f7f450acb admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:55.845137 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452bd6d-a57d-4916-b128-ac0f7f450acb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:55.845459 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452bd6d-a57d-4916-b128-ac0f7f450acb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:55.870827 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452bd6d-a57d-4916-b128-ac0f7f450acb admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:55.883985 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 189/377] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:36:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:55.889144 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24d0f1-0987-4851-91f7-555e88e1e976 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:55.898185 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24d0f1-0987-4851-91f7-555e88e1e976 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:55.901946 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa3f23-7244-47fe-a547-6b99a7997b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:55.902643 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa3f23-7244-47fe-a547-6b99a7997b9b admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:55.902987 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa3f23-7244-47fe-a547-6b99a7997b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:55.903263 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa3f23-7244-47fe-a547-6b99a7997b9b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:55.915485 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa3f23-7244-47fe-a547-6b99a7997b9b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:55.942060 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa3f23-7244-47fe-a547-6b99a7997b9b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:55.959217 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-13aa3f23-7244-47fe-a547-6b99a7997b9b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 29 20:36:55.960258 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 189/378] 10.222.0.37 () {56 vars in 1114 bytes} [Wed Dec 29 20:36:55 2021] GET /identity/v3/users/nova => generated 82 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:55.965989 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452bd6d-a57d-4916-b128-ac0f7f450acb admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:55.975151 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452bd6d-a57d-4916-b128-ac0f7f450acb admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:55.978947 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fbe8a-edf4-4932-bc0c-6a65e1a56303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:55.979526 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fbe8a-edf4-4932-bc0c-6a65e1a56303 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:55.979809 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fbe8a-edf4-4932-bc0c-6a65e1a56303 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:55.980086 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fbe8a-edf4-4932-bc0c-6a65e1a56303 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:55.980860 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fbe8a-edf4-4932-bc0c-6a65e1a56303 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:55.981698 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fbe8a-edf4-4932-bc0c-6a65e1a56303 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:56.006917 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fbe8a-edf4-4932-bc0c-6a65e1a56303 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:56.111248 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 190/379] 10.222.0.37 () {56 vars in 1154 bytes} [Wed Dec 29 20:36:55 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:56.116747 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa3f23-7244-47fe-a547-6b99a7997b9b admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:56.126063 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa3f23-7244-47fe-a547-6b99a7997b9b admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:56.129850 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38ee36-c936-4889-843d-de140dac3f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:56.130559 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38ee36-c936-4889-843d-de140dac3f61 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:56.130875 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38ee36-c936-4889-843d-de140dac3f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:56.131156 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38ee36-c936-4889-843d-de140dac3f61 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:56.144530 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38ee36-c936-4889-843d-de140dac3f61 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:56.171288 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38ee36-c936-4889-843d-de140dac3f61 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:56.187624 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-5a38ee36-c936-4889-843d-de140dac3f61 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:36:56.188658 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 190/380] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:36:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:56.193775 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fbe8a-edf4-4932-bc0c-6a65e1a56303 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:56.203353 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fbe8a-edf4-4932-bc0c-6a65e1a56303 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:56.207124 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a23c9-4705-4179-981e-f9f37219e362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:56.207696 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a23c9-4705-4179-981e-f9f37219e362 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:56.207980 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a23c9-4705-4179-981e-f9f37219e362 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:56.208257 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a23c9-4705-4179-981e-f9f37219e362 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:56.208924 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a23c9-4705-4179-981e-f9f37219e362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:56.209214 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a23c9-4705-4179-981e-f9f37219e362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:56.235310 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a23c9-4705-4179-981e-f9f37219e362 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:56.247814 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 191/381] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:36:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:56.253033 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38ee36-c936-4889-843d-de140dac3f61 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:56.262007 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38ee36-c936-4889-843d-de140dac3f61 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:56.265816 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2fdfe-c6a2-40b8-b0fb-53c1346459d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:56.266511 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2fdfe-c6a2-40b8-b0fb-53c1346459d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:56.266827 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2fdfe-c6a2-40b8-b0fb-53c1346459d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:56.267104 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2fdfe-c6a2-40b8-b0fb-53c1346459d5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:56.351437 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2fdfe-c6a2-40b8-b0fb-53c1346459d5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:56.376694 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2fdfe-c6a2-40b8-b0fb-53c1346459d5 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:56.390587 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-82f2fdfe-c6a2-40b8-b0fb-53c1346459d5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:36:56.391676 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 191/382] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:36:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 139 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:56.397234 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a23c9-4705-4179-981e-f9f37219e362 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:56.407114 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a23c9-4705-4179-981e-f9f37219e362 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:56.410911 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b8b03-2f25-4f54-ad30-e064d94ed154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:56.411480 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b8b03-2f25-4f54-ad30-e064d94ed154 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:56.411764 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b8b03-2f25-4f54-ad30-e064d94ed154 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:56.412039 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b8b03-2f25-4f54-ad30-e064d94ed154 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:56.412764 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b8b03-2f25-4f54-ad30-e064d94ed154 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:56.413061 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b8b03-2f25-4f54-ad30-e064d94ed154 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:56.437398 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING py.warnings [None req-058b8b03-2f25-4f54-ad30-e064d94ed154 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:36:56.437398 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: warnings.warn(msg) Dec 29 20:36:56.437398 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: Dec 29 20:36:56.438502 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b8b03-2f25-4f54-ad30-e064d94ed154 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:56.451973 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 192/383] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:36:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:56.457198 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2fdfe-c6a2-40b8-b0fb-53c1346459d5 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:56.467025 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2fdfe-c6a2-40b8-b0fb-53c1346459d5 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:56.470833 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d57f04-0628-47b2-ae82-ed4f767cd8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:56.471614 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d57f04-0628-47b2-ae82-ed4f767cd8f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:56.471893 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d57f04-0628-47b2-ae82-ed4f767cd8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:56.472167 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d57f04-0628-47b2-ae82-ed4f767cd8f1 admin admin] PATH_INFO: `/v3/projects/ed634cf9bb9146f7a9738325a8638b70/users/51ef7e54d97a4320bda0c1926d190d8e/roles/1c5a8286caa54ded9e44ef97f73f6776` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:56.491507 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d57f04-0628-47b2-ae82-ed4f767cd8f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed634cf9bb9146f7a9738325a8638b70, user_id=51ef7e54d97a4320bda0c1926d190d8e, role_id=1c5a8286caa54ded9e44ef97f73f6776)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:56.518077 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d57f04-0628-47b2-ae82-ed4f767cd8f1 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:56.530382 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 192/384] 10.222.0.37 () {58 vars in 1460 bytes} [Wed Dec 29 20:36:56 2021] PUT /identity/v3/projects/ed634cf9bb9146f7a9738325a8638b70/users/51ef7e54d97a4320bda0c1926d190d8e/roles/1c5a8286caa54ded9e44ef97f73f6776 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:36:58.443910 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba9db9-0c90-4000-b158-a171f4be032e None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:58.444434 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba9db9-0c90-4000-b158-a171f4be032e None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:58.444536 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba9db9-0c90-4000-b158-a171f4be032e None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:58.446147 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 193/385] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:36:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:36:58.451416 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b9441-2cfb-4530-8d42-098dd2e19caf None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:58.451797 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b9441-2cfb-4530-8d42-098dd2e19caf None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:58.451975 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b9441-2cfb-4530-8d42-098dd2e19caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:58.474155 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-8e5b9441-2cfb-4530-8d42-098dd2e19caf None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:36:58.475298 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-8e5b9441-2cfb-4530-8d42-098dd2e19caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:36:58.536284 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 193/386] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:36:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:36:58.558222 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba9db9-0c90-4000-b158-a171f4be032e None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:58.569589 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba9db9-0c90-4000-b158-a171f4be032e None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:58.573391 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229ed58-ade9-4e06-99a5-2c5744263925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:58.574353 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229ed58-ade9-4e06-99a5-2c5744263925 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:58.575170 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229ed58-ade9-4e06-99a5-2c5744263925 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:58.575452 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229ed58-ade9-4e06-99a5-2c5744263925 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:58.586494 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229ed58-ade9-4e06-99a5-2c5744263925 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:36:58.593303 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-3229ed58-ade9-4e06-99a5-2c5744263925 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 29 20:36:58.594365 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 194/387] 10.222.0.37 () {56 vars in 1123 bytes} [Wed Dec 29 20:36:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:58.599745 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b9441-2cfb-4530-8d42-098dd2e19caf None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:58.608024 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b9441-2cfb-4530-8d42-098dd2e19caf None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:58.611884 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e384c8-3e67-406c-9fe8-1bfc2ec6715a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:58.612459 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e384c8-3e67-406c-9fe8-1bfc2ec6715a admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:58.612744 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e384c8-3e67-406c-9fe8-1bfc2ec6715a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:58.613026 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e384c8-3e67-406c-9fe8-1bfc2ec6715a admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:58.613720 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e384c8-3e67-406c-9fe8-1bfc2ec6715a admin admin] RBAC: Adding query filter params (name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:58.614012 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e384c8-3e67-406c-9fe8-1bfc2ec6715a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:58.640143 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e384c8-3e67-406c-9fe8-1bfc2ec6715a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:58.648239 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 194/388] 10.222.0.37 () {56 vars in 1124 bytes} [Wed Dec 29 20:36:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:36:58.654269 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229ed58-ade9-4e06-99a5-2c5744263925 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:58.663759 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229ed58-ade9-4e06-99a5-2c5744263925 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:58.667628 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e74dc6-9f5f-4f41-b8ad-7363a9dd3152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:58.668363 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e74dc6-9f5f-4f41-b8ad-7363a9dd3152 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:58.668902 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e74dc6-9f5f-4f41-b8ad-7363a9dd3152 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:58.669187 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e74dc6-9f5f-4f41-b8ad-7363a9dd3152 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:58.680059 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e74dc6-9f5f-4f41-b8ad-7363a9dd3152 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:58.706898 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e74dc6-9f5f-4f41-b8ad-7363a9dd3152 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:58.724790 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-b7e74dc6-9f5f-4f41-b8ad-7363a9dd3152 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:36:58.725846 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 195/389] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:36:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:58.731112 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e384c8-3e67-406c-9fe8-1bfc2ec6715a admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:58.740086 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e384c8-3e67-406c-9fe8-1bfc2ec6715a admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:58.744127 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6c7a5-c871-4adb-bfa8-93b4bb5fd1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:58.744697 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6c7a5-c871-4adb-bfa8-93b4bb5fd1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:58.745056 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6c7a5-c871-4adb-bfa8-93b4bb5fd1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:58.745336 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6c7a5-c871-4adb-bfa8-93b4bb5fd1e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:58.746010 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6c7a5-c871-4adb-bfa8-93b4bb5fd1e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:58.746304 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6c7a5-c871-4adb-bfa8-93b4bb5fd1e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:58.772043 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6c7a5-c871-4adb-bfa8-93b4bb5fd1e4 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:58.785190 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 195/390] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:36:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:58.790129 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e74dc6-9f5f-4f41-b8ad-7363a9dd3152 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:58.799379 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e74dc6-9f5f-4f41-b8ad-7363a9dd3152 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:58.803213 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6886fe-7398-4782-813c-cf1de5a083c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:58.803912 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6886fe-7398-4782-813c-cf1de5a083c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:58.804204 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6886fe-7398-4782-813c-cf1de5a083c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:58.804492 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6886fe-7398-4782-813c-cf1de5a083c1 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:58.816706 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6886fe-7398-4782-813c-cf1de5a083c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:58.843588 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6886fe-7398-4782-813c-cf1de5a083c1 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:58.861120 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-5f6886fe-7398-4782-813c-cf1de5a083c1 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 29 20:36:58.862203 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 196/391] 10.222.0.37 () {56 vars in 1114 bytes} [Wed Dec 29 20:36:58 2021] GET /identity/v3/users/nova => generated 82 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:58.867658 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6c7a5-c871-4adb-bfa8-93b4bb5fd1e4 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:58.876802 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6c7a5-c871-4adb-bfa8-93b4bb5fd1e4 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:58.880734 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0e328-5635-4f8a-9e26-358f4991a060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:58.881318 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0e328-5635-4f8a-9e26-358f4991a060 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:58.881605 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0e328-5635-4f8a-9e26-358f4991a060 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:58.881883 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0e328-5635-4f8a-9e26-358f4991a060 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:58.882689 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0e328-5635-4f8a-9e26-358f4991a060 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:58.882992 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0e328-5635-4f8a-9e26-358f4991a060 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:58.908734 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING py.warnings [None req-4af0e328-5635-4f8a-9e26-358f4991a060 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:36:58.908734 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: warnings.warn(msg) Dec 29 20:36:58.908734 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: Dec 29 20:36:58.909833 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0e328-5635-4f8a-9e26-358f4991a060 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:58.938535 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 196/392] 10.222.0.37 () {56 vars in 1154 bytes} [Wed Dec 29 20:36:58 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:36:58.943829 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6886fe-7398-4782-813c-cf1de5a083c1 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:58.953848 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6886fe-7398-4782-813c-cf1de5a083c1 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:58.957753 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8558af-414b-4190-a4b7-2e3d358e109c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:58.958264 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8558af-414b-4190-a4b7-2e3d358e109c admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:58.958555 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8558af-414b-4190-a4b7-2e3d358e109c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:58.958876 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8558af-414b-4190-a4b7-2e3d358e109c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:58.967244 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8558af-414b-4190-a4b7-2e3d358e109c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:58.992605 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8558af-414b-4190-a4b7-2e3d358e109c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:59.001726 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 197/393] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:36:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:36:59.007321 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0e328-5635-4f8a-9e26-358f4991a060 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:59.017206 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0e328-5635-4f8a-9e26-358f4991a060 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:59.021061 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6178fd-9ca7-445d-b1ee-ff2d83f73653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:59.021773 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6178fd-9ca7-445d-b1ee-ff2d83f73653 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:59.022097 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6178fd-9ca7-445d-b1ee-ff2d83f73653 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:59.022382 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6178fd-9ca7-445d-b1ee-ff2d83f73653 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:59.033903 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6178fd-9ca7-445d-b1ee-ff2d83f73653 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:59.060062 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6178fd-9ca7-445d-b1ee-ff2d83f73653 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:59.077246 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-cd6178fd-9ca7-445d-b1ee-ff2d83f73653 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:36:59.078303 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 197/394] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:36:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:59.083556 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8558af-414b-4190-a4b7-2e3d358e109c admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:59.092231 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8558af-414b-4190-a4b7-2e3d358e109c admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:59.096198 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f813d42-7540-4ed2-bd5b-b70b6f26b35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:59.096778 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f813d42-7540-4ed2-bd5b-b70b6f26b35a admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:59.097070 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f813d42-7540-4ed2-bd5b-b70b6f26b35a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:59.097355 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f813d42-7540-4ed2-bd5b-b70b6f26b35a admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:59.098029 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f813d42-7540-4ed2-bd5b-b70b6f26b35a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:59.098329 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f813d42-7540-4ed2-bd5b-b70b6f26b35a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:59.123883 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f813d42-7540-4ed2-bd5b-b70b6f26b35a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:59.136383 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 198/395] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:36:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:59.142005 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6178fd-9ca7-445d-b1ee-ff2d83f73653 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:59.151064 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6178fd-9ca7-445d-b1ee-ff2d83f73653 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:59.154936 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ffa3c-7b7e-45fb-a13c-61218b608b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:59.155632 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ffa3c-7b7e-45fb-a13c-61218b608b6d admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:59.155918 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ffa3c-7b7e-45fb-a13c-61218b608b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:59.156194 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ffa3c-7b7e-45fb-a13c-61218b608b6d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:59.164833 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ffa3c-7b7e-45fb-a13c-61218b608b6d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:59.190693 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ffa3c-7b7e-45fb-a13c-61218b608b6d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:59.204646 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-c92ffa3c-7b7e-45fb-a13c-61218b608b6d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:36:59.205702 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 198/396] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:36:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:36:59.210917 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f813d42-7540-4ed2-bd5b-b70b6f26b35a admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:59.219921 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f813d42-7540-4ed2-bd5b-b70b6f26b35a admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:59.223744 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883cb15-52b0-41f3-93d4-e739a63ee238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:59.224310 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883cb15-52b0-41f3-93d4-e739a63ee238 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:59.224595 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883cb15-52b0-41f3-93d4-e739a63ee238 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:59.224873 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883cb15-52b0-41f3-93d4-e739a63ee238 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:59.225599 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883cb15-52b0-41f3-93d4-e739a63ee238 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:59.225895 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883cb15-52b0-41f3-93d4-e739a63ee238 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:59.251552 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883cb15-52b0-41f3-93d4-e739a63ee238 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:59.264715 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 199/397] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:36:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:36:59.270177 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ffa3c-7b7e-45fb-a13c-61218b608b6d admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:36:59.279144 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ffa3c-7b7e-45fb-a13c-61218b608b6d admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:36:59.282978 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738d91a-d307-4dbd-bb48-87a628aa0829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:36:59.283537 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738d91a-d307-4dbd-bb48-87a628aa0829 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:36:59.283825 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738d91a-d307-4dbd-bb48-87a628aa0829 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:36:59.284105 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738d91a-d307-4dbd-bb48-87a628aa0829 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:36:59.284870 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738d91a-d307-4dbd-bb48-87a628aa0829 admin admin] RBAC: Adding query filter params (role.id=1c5a8286caa54ded9e44ef97f73f6776, scope.project.id=ed634cf9bb9146f7a9738325a8638b70, user.id=51ef7e54d97a4320bda0c1926d190d8e) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:36:59.285171 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738d91a-d307-4dbd-bb48-87a628aa0829 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:36:59.311218 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738d91a-d307-4dbd-bb48-87a628aa0829 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:36:59.316717 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 199/398] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:36:59 2021] GET /identity/v3/role_assignments?user.id=51ef7e54d97a4320bda0c1926d190d8e&scope.project.id=ed634cf9bb9146f7a9738325a8638b70&role.id=1c5a8286caa54ded9e44ef97f73f6776 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:01.280457 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7a249-02fb-4562-bc89-961bf141e446 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:01.280970 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7a249-02fb-4562-bc89-961bf141e446 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:01.280970 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7a249-02fb-4562-bc89-961bf141e446 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:01.282587 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 200/399] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:37:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:37:01.287573 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f077e-6b4f-43fb-a014-36e1dc49f4d0 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:01.287964 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f077e-6b4f-43fb-a014-36e1dc49f4d0 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:01.288135 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f077e-6b4f-43fb-a014-36e1dc49f4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:01.310466 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-fc9f077e-6b4f-43fb-a014-36e1dc49f4d0 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:37:01.311605 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-fc9f077e-6b4f-43fb-a014-36e1dc49f4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:37:01.318003 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 200/400] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:37:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:37:01.346841 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7a249-02fb-4562-bc89-961bf141e446 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:01.359061 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7a249-02fb-4562-bc89-961bf141e446 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:01.362788 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a71494-8e2a-400f-bb82-1473eca49440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:01.363489 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a71494-8e2a-400f-bb82-1473eca49440 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:01.363777 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a71494-8e2a-400f-bb82-1473eca49440 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:01.364058 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a71494-8e2a-400f-bb82-1473eca49440 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:01.375066 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a71494-8e2a-400f-bb82-1473eca49440 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:37:01.381316 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-c4a71494-8e2a-400f-bb82-1473eca49440 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:37:01.382387 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 201/401] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:37:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:01.387739 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f077e-6b4f-43fb-a014-36e1dc49f4d0 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:01.396040 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f077e-6b4f-43fb-a014-36e1dc49f4d0 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:01.400042 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1bac2-fb0d-459e-a762-306abe741bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:01.400632 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1bac2-fb0d-459e-a762-306abe741bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:01.400918 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1bac2-fb0d-459e-a762-306abe741bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:01.401200 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1bac2-fb0d-459e-a762-306abe741bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:01.401905 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1bac2-fb0d-459e-a762-306abe741bf6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:01.402200 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1bac2-fb0d-459e-a762-306abe741bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:01.428721 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1bac2-fb0d-459e-a762-306abe741bf6 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:01.437162 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 201/402] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:37:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:01.442487 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a71494-8e2a-400f-bb82-1473eca49440 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:01.452177 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a71494-8e2a-400f-bb82-1473eca49440 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:01.456039 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afe3f3-a670-4dc2-8677-e68eb4a91609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:01.456726 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afe3f3-a670-4dc2-8677-e68eb4a91609 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:01.457019 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afe3f3-a670-4dc2-8677-e68eb4a91609 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:01.457297 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afe3f3-a670-4dc2-8677-e68eb4a91609 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:01.468821 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afe3f3-a670-4dc2-8677-e68eb4a91609 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:01.494504 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afe3f3-a670-4dc2-8677-e68eb4a91609 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:01.511710 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-68afe3f3-a670-4dc2-8677-e68eb4a91609 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:01.512775 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 202/403] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:01.518175 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1bac2-fb0d-459e-a762-306abe741bf6 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:01.527095 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1bac2-fb0d-459e-a762-306abe741bf6 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:01.531604 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c6f80-9f85-4e7b-9a4c-d1445e763108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:01.532118 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c6f80-9f85-4e7b-9a4c-d1445e763108 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:01.532403 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c6f80-9f85-4e7b-9a4c-d1445e763108 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:01.532684 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c6f80-9f85-4e7b-9a4c-d1445e763108 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:01.533353 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c6f80-9f85-4e7b-9a4c-d1445e763108 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:01.533645 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c6f80-9f85-4e7b-9a4c-d1445e763108 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:01.559541 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c6f80-9f85-4e7b-9a4c-d1445e763108 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:01.573026 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 202/404] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:37:01.579082 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afe3f3-a670-4dc2-8677-e68eb4a91609 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:01.588106 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afe3f3-a670-4dc2-8677-e68eb4a91609 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:01.592568 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2475e-1674-4b37-aef7-70a2d6c8e8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:01.593260 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2475e-1674-4b37-aef7-70a2d6c8e8ad admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:01.593549 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2475e-1674-4b37-aef7-70a2d6c8e8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:01.593831 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2475e-1674-4b37-aef7-70a2d6c8e8ad admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:01.606018 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2475e-1674-4b37-aef7-70a2d6c8e8ad admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:01.631452 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2475e-1674-4b37-aef7-70a2d6c8e8ad admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:01.648972 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-55a2475e-1674-4b37-aef7-70a2d6c8e8ad admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 29 20:37:01.650009 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 203/405] 10.222.0.37 () {56 vars in 1114 bytes} [Wed Dec 29 20:37:01 2021] GET /identity/v3/users/nova => generated 82 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:01.655652 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c6f80-9f85-4e7b-9a4c-d1445e763108 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:01.664853 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c6f80-9f85-4e7b-9a4c-d1445e763108 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:01.668718 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecc097-8b4d-4610-8560-b128035d454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:01.669298 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecc097-8b4d-4610-8560-b128035d454e admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:01.669586 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecc097-8b4d-4610-8560-b128035d454e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:01.669988 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecc097-8b4d-4610-8560-b128035d454e admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:01.670906 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecc097-8b4d-4610-8560-b128035d454e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:01.671208 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecc097-8b4d-4610-8560-b128035d454e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:01.696774 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecc097-8b4d-4610-8560-b128035d454e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:01.726128 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 203/406] 10.222.0.37 () {56 vars in 1154 bytes} [Wed Dec 29 20:37:01 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:01.731309 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2475e-1674-4b37-aef7-70a2d6c8e8ad admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:01.740421 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2475e-1674-4b37-aef7-70a2d6c8e8ad admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:01.744193 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d6a3c-26fd-4b09-8938-540cc568ead5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:01.744746 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d6a3c-26fd-4b09-8938-540cc568ead5 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:01.745028 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d6a3c-26fd-4b09-8938-540cc568ead5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:01.745305 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d6a3c-26fd-4b09-8938-540cc568ead5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:01.752901 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d6a3c-26fd-4b09-8938-540cc568ead5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:01.778326 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d6a3c-26fd-4b09-8938-540cc568ead5 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:01.787131 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 204/407] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:37:01 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:37:01.792275 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecc097-8b4d-4610-8560-b128035d454e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:01.801446 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecc097-8b4d-4610-8560-b128035d454e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:01.805308 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36e880-7c67-4502-b91a-62036e14066c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:01.806016 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36e880-7c67-4502-b91a-62036e14066c admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:01.806306 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36e880-7c67-4502-b91a-62036e14066c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:01.806586 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36e880-7c67-4502-b91a-62036e14066c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:01.818007 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36e880-7c67-4502-b91a-62036e14066c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:01.844710 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36e880-7c67-4502-b91a-62036e14066c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:01.861586 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-de36e880-7c67-4502-b91a-62036e14066c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:01.862685 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 204/408] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:37:01.867961 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d6a3c-26fd-4b09-8938-540cc568ead5 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:01.876523 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d6a3c-26fd-4b09-8938-540cc568ead5 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:01.880362 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da3401-b48f-4fde-a039-8846e60ec551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:01.880938 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da3401-b48f-4fde-a039-8846e60ec551 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:01.881221 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da3401-b48f-4fde-a039-8846e60ec551 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:01.881497 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da3401-b48f-4fde-a039-8846e60ec551 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:01.882188 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da3401-b48f-4fde-a039-8846e60ec551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:01.882480 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da3401-b48f-4fde-a039-8846e60ec551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:01.908613 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da3401-b48f-4fde-a039-8846e60ec551 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:01.921195 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 205/409] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:01.926173 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36e880-7c67-4502-b91a-62036e14066c admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:01.935174 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36e880-7c67-4502-b91a-62036e14066c admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:01.939559 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f8ba3-11f3-48d8-b7fc-2141367c28b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:01.940254 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f8ba3-11f3-48d8-b7fc-2141367c28b1 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:01.940545 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f8ba3-11f3-48d8-b7fc-2141367c28b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:01.940830 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f8ba3-11f3-48d8-b7fc-2141367c28b1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:01.949789 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f8ba3-11f3-48d8-b7fc-2141367c28b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:01.975834 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f8ba3-11f3-48d8-b7fc-2141367c28b1 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:01.989013 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-ed1f8ba3-11f3-48d8-b7fc-2141367c28b1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:37:01.990090 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 205/410] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:37:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:01.995369 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da3401-b48f-4fde-a039-8846e60ec551 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:02.005116 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da3401-b48f-4fde-a039-8846e60ec551 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:02.008998 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4106b-e582-4d8f-9727-8fb361766a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:02.009569 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4106b-e582-4d8f-9727-8fb361766a83 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:02.009859 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4106b-e582-4d8f-9727-8fb361766a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:02.010143 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4106b-e582-4d8f-9727-8fb361766a83 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:02.010908 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4106b-e582-4d8f-9727-8fb361766a83 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:02.011214 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4106b-e582-4d8f-9727-8fb361766a83 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:02.037024 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4106b-e582-4d8f-9727-8fb361766a83 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:02.051115 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 206/411] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:37:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:02.056561 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f8ba3-11f3-48d8-b7fc-2141367c28b1 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:02.066143 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f8ba3-11f3-48d8-b7fc-2141367c28b1 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:02.069884 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118ea05-fb4c-476a-8449-b652e3c0c59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:02.070438 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118ea05-fb4c-476a-8449-b652e3c0c59b admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:02.070746 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118ea05-fb4c-476a-8449-b652e3c0c59b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:02.071027 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118ea05-fb4c-476a-8449-b652e3c0c59b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:02.071787 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118ea05-fb4c-476a-8449-b652e3c0c59b admin admin] RBAC: Adding query filter params (role.id=e66e6a94ba014fd193b851ceb92695ae, scope.project.id=ed634cf9bb9146f7a9738325a8638b70, user.id=51ef7e54d97a4320bda0c1926d190d8e) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:02.072086 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118ea05-fb4c-476a-8449-b652e3c0c59b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:02.098597 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118ea05-fb4c-476a-8449-b652e3c0c59b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:02.103665 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 206/412] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:37:02 2021] GET /identity/v3/role_assignments?user.id=51ef7e54d97a4320bda0c1926d190d8e&scope.project.id=ed634cf9bb9146f7a9738325a8638b70&role.id=e66e6a94ba014fd193b851ceb92695ae => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:04.017260 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1713d-d1d0-4ea5-842f-a9678e88be3c None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:04.017765 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1713d-d1d0-4ea5-842f-a9678e88be3c None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:04.017847 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1713d-d1d0-4ea5-842f-a9678e88be3c None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:04.019504 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 207/413] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:37:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:37:04.024568 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797945b-d0db-47a9-8708-2d09748cb599 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:04.024926 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797945b-d0db-47a9-8708-2d09748cb599 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:04.025147 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797945b-d0db-47a9-8708-2d09748cb599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:04.047751 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-7797945b-d0db-47a9-8708-2d09748cb599 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:37:04.048889 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-7797945b-d0db-47a9-8708-2d09748cb599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:37:04.055542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 207/414] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:37:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:37:04.077378 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1713d-d1d0-4ea5-842f-a9678e88be3c None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:04.088773 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1713d-d1d0-4ea5-842f-a9678e88be3c None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:04.093261 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212099a-d620-4475-a158-f5d6d55e0736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:04.093956 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212099a-d620-4475-a158-f5d6d55e0736 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:04.094242 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212099a-d620-4475-a158-f5d6d55e0736 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:04.094519 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212099a-d620-4475-a158-f5d6d55e0736 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:04.105312 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212099a-d620-4475-a158-f5d6d55e0736 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:37:04.111576 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-a212099a-d620-4475-a158-f5d6d55e0736 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:37:04.112622 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 208/415] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:37:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:04.118120 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797945b-d0db-47a9-8708-2d09748cb599 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:04.126486 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797945b-d0db-47a9-8708-2d09748cb599 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:04.130387 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a885858-d647-403d-a128-3554fde77798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:04.131002 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a885858-d647-403d-a128-3554fde77798 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:04.131293 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a885858-d647-403d-a128-3554fde77798 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:04.131579 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a885858-d647-403d-a128-3554fde77798 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:04.132284 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a885858-d647-403d-a128-3554fde77798 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:04.132585 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a885858-d647-403d-a128-3554fde77798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:04.158968 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a885858-d647-403d-a128-3554fde77798 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:04.167263 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 208/416] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:37:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:04.172454 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212099a-d620-4475-a158-f5d6d55e0736 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:04.181865 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212099a-d620-4475-a158-f5d6d55e0736 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:04.186256 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9027d-0eba-4f83-8966-9785001328ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:04.186972 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9027d-0eba-4f83-8966-9785001328ff admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:04.187258 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9027d-0eba-4f83-8966-9785001328ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:04.187538 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9027d-0eba-4f83-8966-9785001328ff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:04.198245 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9027d-0eba-4f83-8966-9785001328ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:04.224100 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9027d-0eba-4f83-8966-9785001328ff admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:04.241170 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-aae9027d-0eba-4f83-8966-9785001328ff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:04.242194 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 209/417] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:04.247380 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a885858-d647-403d-a128-3554fde77798 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:04.256915 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a885858-d647-403d-a128-3554fde77798 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:04.260798 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f272a-a204-40b9-a0e9-31682bc09549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:04.261371 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f272a-a204-40b9-a0e9-31682bc09549 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:04.261661 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f272a-a204-40b9-a0e9-31682bc09549 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:04.261947 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f272a-a204-40b9-a0e9-31682bc09549 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:04.262625 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f272a-a204-40b9-a0e9-31682bc09549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:04.262953 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f272a-a204-40b9-a0e9-31682bc09549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:04.288669 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f272a-a204-40b9-a0e9-31682bc09549 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:04.301251 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 209/418] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:04.306101 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9027d-0eba-4f83-8966-9785001328ff admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:04.315516 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9027d-0eba-4f83-8966-9785001328ff admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:04.319351 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e604b35-8d24-46ba-b3e7-fcfde381220b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:04.320036 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e604b35-8d24-46ba-b3e7-fcfde381220b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:04.320320 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e604b35-8d24-46ba-b3e7-fcfde381220b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:04.320595 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e604b35-8d24-46ba-b3e7-fcfde381220b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:04.332988 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e604b35-8d24-46ba-b3e7-fcfde381220b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:04.359769 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e604b35-8d24-46ba-b3e7-fcfde381220b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:04.376642 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-1e604b35-8d24-46ba-b3e7-fcfde381220b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 29 20:37:04.377603 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 210/419] 10.222.0.37 () {56 vars in 1114 bytes} [Wed Dec 29 20:37:04 2021] GET /identity/v3/users/nova => generated 82 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:04.382744 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f272a-a204-40b9-a0e9-31682bc09549 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:04.391777 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f272a-a204-40b9-a0e9-31682bc09549 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:04.395623 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7740d33-ed59-488c-8b2d-09d789d1e541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:04.396202 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740d33-ed59-488c-8b2d-09d789d1e541 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:04.396489 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740d33-ed59-488c-8b2d-09d789d1e541 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:04.396770 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740d33-ed59-488c-8b2d-09d789d1e541 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:04.397548 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7740d33-ed59-488c-8b2d-09d789d1e541 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:04.397849 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7740d33-ed59-488c-8b2d-09d789d1e541 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:04.424533 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7740d33-ed59-488c-8b2d-09d789d1e541 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:04.452270 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 210/420] 10.222.0.37 () {56 vars in 1154 bytes} [Wed Dec 29 20:37:04 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:04.457212 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e604b35-8d24-46ba-b3e7-fcfde381220b admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:04.466076 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e604b35-8d24-46ba-b3e7-fcfde381220b admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:04.470446 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135feb7c-2113-41b8-9080-cdb25ae7ae5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:04.471162 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135feb7c-2113-41b8-9080-cdb25ae7ae5b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:04.471447 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135feb7c-2113-41b8-9080-cdb25ae7ae5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:04.471724 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135feb7c-2113-41b8-9080-cdb25ae7ae5b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:04.483471 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135feb7c-2113-41b8-9080-cdb25ae7ae5b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:04.508712 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135feb7c-2113-41b8-9080-cdb25ae7ae5b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:04.525126 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-135feb7c-2113-41b8-9080-cdb25ae7ae5b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:04.526138 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 211/421] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:04.531412 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7740d33-ed59-488c-8b2d-09d789d1e541 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:04.540470 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7740d33-ed59-488c-8b2d-09d789d1e541 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:04.544387 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be848c60-1dd2-433b-bac7-2231729738e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:04.545490 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be848c60-1dd2-433b-bac7-2231729738e9 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:04.545781 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be848c60-1dd2-433b-bac7-2231729738e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:04.546065 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be848c60-1dd2-433b-bac7-2231729738e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:04.546785 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be848c60-1dd2-433b-bac7-2231729738e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:04.547084 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be848c60-1dd2-433b-bac7-2231729738e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:04.572633 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be848c60-1dd2-433b-bac7-2231729738e9 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:04.584696 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 211/422] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:04.589697 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135feb7c-2113-41b8-9080-cdb25ae7ae5b admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:04.598884 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135feb7c-2113-41b8-9080-cdb25ae7ae5b admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:04.602704 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985e693-10f3-425f-8574-7097e7f72d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:04.603395 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985e693-10f3-425f-8574-7097e7f72d0c admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:04.603684 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985e693-10f3-425f-8574-7097e7f72d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:04.603963 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985e693-10f3-425f-8574-7097e7f72d0c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:04.613143 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985e693-10f3-425f-8574-7097e7f72d0c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:04.639199 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985e693-10f3-425f-8574-7097e7f72d0c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:04.652132 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-a985e693-10f3-425f-8574-7097e7f72d0c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:37:04.653149 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 212/423] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:37:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:04.658354 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be848c60-1dd2-433b-bac7-2231729738e9 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:04.667341 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be848c60-1dd2-433b-bac7-2231729738e9 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:04.672614 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd34a3-1d8d-4899-bee7-fbd0bda1bc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:04.672614 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd34a3-1d8d-4899-bee7-fbd0bda1bc06 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:04.672832 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd34a3-1d8d-4899-bee7-fbd0bda1bc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:04.672940 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd34a3-1d8d-4899-bee7-fbd0bda1bc06 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:04.673684 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd34a3-1d8d-4899-bee7-fbd0bda1bc06 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:04.673990 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd34a3-1d8d-4899-bee7-fbd0bda1bc06 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:04.700135 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd34a3-1d8d-4899-bee7-fbd0bda1bc06 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:04.713903 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 212/424] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:37:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:04.719499 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985e693-10f3-425f-8574-7097e7f72d0c admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:04.728540 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985e693-10f3-425f-8574-7097e7f72d0c admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:04.732924 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd12b4d-a368-40e4-95b7-14011dd0918a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:04.733733 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd12b4d-a368-40e4-95b7-14011dd0918a admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:04.734018 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd12b4d-a368-40e4-95b7-14011dd0918a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:04.734294 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd12b4d-a368-40e4-95b7-14011dd0918a admin admin] PATH_INFO: `/v3/projects/ed634cf9bb9146f7a9738325a8638b70/users/51ef7e54d97a4320bda0c1926d190d8e/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:04.736070 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd12b4d-a368-40e4-95b7-14011dd0918a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed634cf9bb9146f7a9738325a8638b70, user_id=51ef7e54d97a4320bda0c1926d190d8e, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:04.762643 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd12b4d-a368-40e4-95b7-14011dd0918a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:04.774405 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 213/425] 10.222.0.37 () {58 vars in 1460 bytes} [Wed Dec 29 20:37:04 2021] PUT /identity/v3/projects/ed634cf9bb9146f7a9738325a8638b70/users/51ef7e54d97a4320bda0c1926d190d8e/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:37:06.703225 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c4dae-520f-4be7-8ab4-eae07be584db None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:06.703828 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c4dae-520f-4be7-8ab4-eae07be584db None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:06.703828 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c4dae-520f-4be7-8ab4-eae07be584db None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:06.705556 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 213/426] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:37:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:37:06.710588 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2fb2d-5bf1-4d65-ad69-77c463ec466d None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:06.710976 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2fb2d-5bf1-4d65-ad69-77c463ec466d None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:06.711186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2fb2d-5bf1-4d65-ad69-77c463ec466d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:06.733039 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-fff2fb2d-5bf1-4d65-ad69-77c463ec466d None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:37:06.734171 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-fff2fb2d-5bf1-4d65-ad69-77c463ec466d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:37:06.796668 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 214/427] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:37:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:37:06.819210 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c4dae-520f-4be7-8ab4-eae07be584db None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:06.830618 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c4dae-520f-4be7-8ab4-eae07be584db None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:06.834351 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b247a-ed29-4c31-807f-16e7dd19b0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:06.835085 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b247a-ed29-4c31-807f-16e7dd19b0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:06.835372 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b247a-ed29-4c31-807f-16e7dd19b0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:06.835651 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b247a-ed29-4c31-807f-16e7dd19b0e9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:06.846452 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b247a-ed29-4c31-807f-16e7dd19b0e9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:37:06.852668 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-bc4b247a-ed29-4c31-807f-16e7dd19b0e9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:37:06.853732 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 214/428] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:37:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:06.859661 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2fb2d-5bf1-4d65-ad69-77c463ec466d None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:06.868064 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2fb2d-5bf1-4d65-ad69-77c463ec466d None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:06.871919 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a0b19-69a9-41c7-8abc-5ec0562d5a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:06.872603 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a0b19-69a9-41c7-8abc-5ec0562d5a18 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:06.873404 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a0b19-69a9-41c7-8abc-5ec0562d5a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:06.873684 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a0b19-69a9-41c7-8abc-5ec0562d5a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:06.874388 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a0b19-69a9-41c7-8abc-5ec0562d5a18 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:06.874706 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a0b19-69a9-41c7-8abc-5ec0562d5a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:06.899801 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a0b19-69a9-41c7-8abc-5ec0562d5a18 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:06.908107 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 215/429] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:37:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:06.913838 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b247a-ed29-4c31-807f-16e7dd19b0e9 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:06.924024 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b247a-ed29-4c31-807f-16e7dd19b0e9 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:06.927863 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5777c-9f06-4717-aa52-d9e3b9f68d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:06.928558 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5777c-9f06-4717-aa52-d9e3b9f68d0e admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:06.928843 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5777c-9f06-4717-aa52-d9e3b9f68d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:06.929119 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5777c-9f06-4717-aa52-d9e3b9f68d0e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:06.940585 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5777c-9f06-4717-aa52-d9e3b9f68d0e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:06.966125 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5777c-9f06-4717-aa52-d9e3b9f68d0e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:06.983494 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-03c5777c-9f06-4717-aa52-d9e3b9f68d0e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:06.984527 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 215/430] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:37:06.990105 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a0b19-69a9-41c7-8abc-5ec0562d5a18 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:06.999842 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a0b19-69a9-41c7-8abc-5ec0562d5a18 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:07.003704 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fba90-557c-4b03-bae0-c17b2a0d116c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:07.004283 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fba90-557c-4b03-bae0-c17b2a0d116c admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:07.004568 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fba90-557c-4b03-bae0-c17b2a0d116c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:07.004850 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fba90-557c-4b03-bae0-c17b2a0d116c admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:07.005529 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005fba90-557c-4b03-bae0-c17b2a0d116c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:07.005827 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005fba90-557c-4b03-bae0-c17b2a0d116c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:07.032181 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005fba90-557c-4b03-bae0-c17b2a0d116c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:07.045220 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 216/431] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:07.050397 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5777c-9f06-4717-aa52-d9e3b9f68d0e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:07.059399 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5777c-9f06-4717-aa52-d9e3b9f68d0e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:07.063463 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946a0af-4856-4ccc-be27-a2d0b3059f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:07.064162 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946a0af-4856-4ccc-be27-a2d0b3059f71 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:07.064449 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946a0af-4856-4ccc-be27-a2d0b3059f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:07.064729 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946a0af-4856-4ccc-be27-a2d0b3059f71 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:07.079446 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946a0af-4856-4ccc-be27-a2d0b3059f71 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:07.105323 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946a0af-4856-4ccc-be27-a2d0b3059f71 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:07.122251 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-4946a0af-4856-4ccc-be27-a2d0b3059f71 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 29 20:37:07.123353 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 216/432] 10.222.0.37 () {56 vars in 1114 bytes} [Wed Dec 29 20:37:07 2021] GET /identity/v3/users/nova => generated 82 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:37:07.128609 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fba90-557c-4b03-bae0-c17b2a0d116c admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:07.137558 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fba90-557c-4b03-bae0-c17b2a0d116c admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:07.141952 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620ec54-dc12-4bde-86fb-304d4e9ad718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:07.142528 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620ec54-dc12-4bde-86fb-304d4e9ad718 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:07.142847 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620ec54-dc12-4bde-86fb-304d4e9ad718 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:07.143126 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620ec54-dc12-4bde-86fb-304d4e9ad718 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:07.143895 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620ec54-dc12-4bde-86fb-304d4e9ad718 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:07.144195 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620ec54-dc12-4bde-86fb-304d4e9ad718 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:07.169925 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620ec54-dc12-4bde-86fb-304d4e9ad718 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:07.197972 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 217/433] 10.222.0.37 () {56 vars in 1154 bytes} [Wed Dec 29 20:37:07 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:07.204158 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946a0af-4856-4ccc-be27-a2d0b3059f71 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:07.213133 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946a0af-4856-4ccc-be27-a2d0b3059f71 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:07.217207 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff1bf2-853c-42c7-bcf6-392bae99b220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:07.217732 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff1bf2-853c-42c7-bcf6-392bae99b220 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:07.218016 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff1bf2-853c-42c7-bcf6-392bae99b220 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:07.218290 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff1bf2-853c-42c7-bcf6-392bae99b220 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:07.225639 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff1bf2-853c-42c7-bcf6-392bae99b220 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:07.251397 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff1bf2-853c-42c7-bcf6-392bae99b220 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:07.259415 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 217/434] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:37:07 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:37:07.264685 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620ec54-dc12-4bde-86fb-304d4e9ad718 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:07.273747 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620ec54-dc12-4bde-86fb-304d4e9ad718 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:07.277567 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabd640-a28b-411a-b318-628bf4a03f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:07.278327 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabd640-a28b-411a-b318-628bf4a03f90 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:07.278617 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabd640-a28b-411a-b318-628bf4a03f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:07.279429 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabd640-a28b-411a-b318-628bf4a03f90 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:07.292234 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabd640-a28b-411a-b318-628bf4a03f90 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:07.317675 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabd640-a28b-411a-b318-628bf4a03f90 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:07.334014 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-7aabd640-a28b-411a-b318-628bf4a03f90 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:07.335075 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 218/435] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:07.340210 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff1bf2-853c-42c7-bcf6-392bae99b220 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:07.349046 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff1bf2-853c-42c7-bcf6-392bae99b220 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:07.352873 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065de417-7a59-456c-b8f6-4a46943babf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:07.353427 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065de417-7a59-456c-b8f6-4a46943babf7 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:07.353709 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065de417-7a59-456c-b8f6-4a46943babf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:07.353984 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065de417-7a59-456c-b8f6-4a46943babf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:07.354666 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065de417-7a59-456c-b8f6-4a46943babf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:07.354972 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065de417-7a59-456c-b8f6-4a46943babf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:07.381469 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065de417-7a59-456c-b8f6-4a46943babf7 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:07.394135 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 218/436] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:07.399169 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabd640-a28b-411a-b318-628bf4a03f90 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:07.408639 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabd640-a28b-411a-b318-628bf4a03f90 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:07.412458 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c5194-3325-4b50-a320-4fb0ad36f719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:07.413148 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c5194-3325-4b50-a320-4fb0ad36f719 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:07.413434 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c5194-3325-4b50-a320-4fb0ad36f719 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:07.413719 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c5194-3325-4b50-a320-4fb0ad36f719 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:07.422953 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c5194-3325-4b50-a320-4fb0ad36f719 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:07.447933 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c5194-3325-4b50-a320-4fb0ad36f719 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:07.461331 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-915c5194-3325-4b50-a320-4fb0ad36f719 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:37:07.462352 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 219/437] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:37:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:07.468158 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065de417-7a59-456c-b8f6-4a46943babf7 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:07.477113 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065de417-7a59-456c-b8f6-4a46943babf7 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:07.481016 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de586c7b-2b23-4ac5-847c-f62bd699ce4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:07.481587 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de586c7b-2b23-4ac5-847c-f62bd699ce4f admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:07.482448 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de586c7b-2b23-4ac5-847c-f62bd699ce4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:07.483062 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de586c7b-2b23-4ac5-847c-f62bd699ce4f admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:07.483747 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de586c7b-2b23-4ac5-847c-f62bd699ce4f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:07.484052 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de586c7b-2b23-4ac5-847c-f62bd699ce4f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:07.509294 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de586c7b-2b23-4ac5-847c-f62bd699ce4f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:07.521868 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 219/438] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:37:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:07.527055 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c5194-3325-4b50-a320-4fb0ad36f719 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:07.536545 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c5194-3325-4b50-a320-4fb0ad36f719 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:07.540543 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7122538-d03e-40a5-8060-3dbe80f9715f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:07.541112 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7122538-d03e-40a5-8060-3dbe80f9715f admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:07.541421 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7122538-d03e-40a5-8060-3dbe80f9715f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:07.541688 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7122538-d03e-40a5-8060-3dbe80f9715f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:07.542457 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7122538-d03e-40a5-8060-3dbe80f9715f admin admin] RBAC: Adding query filter params (role.id=e66e6a94ba014fd193b851ceb92695ae, scope.project.id=ed634cf9bb9146f7a9738325a8638b70, user.id=51ef7e54d97a4320bda0c1926d190d8e) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:07.542803 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7122538-d03e-40a5-8060-3dbe80f9715f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:07.568699 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7122538-d03e-40a5-8060-3dbe80f9715f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:07.574579 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 220/439] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:37:07 2021] GET /identity/v3/role_assignments?user.id=51ef7e54d97a4320bda0c1926d190d8e&scope.project.id=ed634cf9bb9146f7a9738325a8638b70&role.id=e66e6a94ba014fd193b851ceb92695ae => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:09.541484 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418555f-3e6a-4390-a9eb-5ccaaf79cc50 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:09.542041 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418555f-3e6a-4390-a9eb-5ccaaf79cc50 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:09.542041 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418555f-3e6a-4390-a9eb-5ccaaf79cc50 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:09.543730 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 220/440] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:37:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:37:09.548938 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41bb5a-f0cf-405a-a5cf-af0c6458b03e None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:09.549360 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41bb5a-f0cf-405a-a5cf-af0c6458b03e None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:09.549535 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41bb5a-f0cf-405a-a5cf-af0c6458b03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:09.571900 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-fc41bb5a-f0cf-405a-a5cf-af0c6458b03e None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:37:09.573009 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-fc41bb5a-f0cf-405a-a5cf-af0c6458b03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:37:09.580440 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 221/441] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:37:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:37:09.601332 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418555f-3e6a-4390-a9eb-5ccaaf79cc50 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:09.612849 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418555f-3e6a-4390-a9eb-5ccaaf79cc50 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:09.616607 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00845641-cff0-4074-bd89-06ca808fe169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:09.617316 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00845641-cff0-4074-bd89-06ca808fe169 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:09.617606 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00845641-cff0-4074-bd89-06ca808fe169 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:09.617885 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00845641-cff0-4074-bd89-06ca808fe169 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:09.618505 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00845641-cff0-4074-bd89-06ca808fe169 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:09.644657 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING py.warnings [None req-00845641-cff0-4074-bd89-06ca808fe169 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:37:09.644657 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: warnings.warn(msg) Dec 29 20:37:09.644657 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: Dec 29 20:37:09.645519 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00845641-cff0-4074-bd89-06ca808fe169 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:09.656597 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-00845641-cff0-4074-bd89-06ca808fe169 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 29 20:37:09.657632 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 221/442] 10.222.0.37 () {56 vars in 1153 bytes} [Wed Dec 29 20:37:09 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:09.662999 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41bb5a-f0cf-405a-a5cf-af0c6458b03e None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:09.671603 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41bb5a-f0cf-405a-a5cf-af0c6458b03e None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:09.675510 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657067c2-7d2b-4522-a12f-e02002541498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:09.676087 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657067c2-7d2b-4522-a12f-e02002541498 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:09.676373 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657067c2-7d2b-4522-a12f-e02002541498 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:09.676652 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657067c2-7d2b-4522-a12f-e02002541498 admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:09.677317 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657067c2-7d2b-4522-a12f-e02002541498 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:09.677615 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657067c2-7d2b-4522-a12f-e02002541498 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:09.703392 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING py.warnings [None req-657067c2-7d2b-4522-a12f-e02002541498 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:37:09.703392 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: warnings.warn(msg) Dec 29 20:37:09.703392 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: Dec 29 20:37:09.704280 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657067c2-7d2b-4522-a12f-e02002541498 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:09.709432 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 222/443] 10.222.0.37 () {56 vars in 1147 bytes} [Wed Dec 29 20:37:09 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:09.717093 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00845641-cff0-4074-bd89-06ca808fe169 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:09.726216 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00845641-cff0-4074-bd89-06ca808fe169 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:09.730056 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a5553-b689-4b11-a407-b3b18b1d5b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:09.730624 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a5553-b689-4b11-a407-b3b18b1d5b34 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:09.730941 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a5553-b689-4b11-a407-b3b18b1d5b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:09.731217 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a5553-b689-4b11-a407-b3b18b1d5b34 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:09.731932 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a5553-b689-4b11-a407-b3b18b1d5b34 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:09.732191 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a5553-b689-4b11-a407-b3b18b1d5b34 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:09.757173 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING py.warnings [None req-146a5553-b689-4b11-a407-b3b18b1d5b34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:37:09.757173 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: warnings.warn(msg) Dec 29 20:37:09.757173 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: Dec 29 20:37:09.758037 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a5553-b689-4b11-a407-b3b18b1d5b34 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:09.762372 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 222/444] 10.222.0.37 () {56 vars in 1147 bytes} [Wed Dec 29 20:37:09 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:11.692330 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004a978-c31d-4f48-9eba-ce5524bfec62 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:11.692886 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004a978-c31d-4f48-9eba-ce5524bfec62 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:11.692886 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004a978-c31d-4f48-9eba-ce5524bfec62 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:11.694538 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 223/445] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:37:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 29 20:37:11.699772 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a558a-2c99-4a5a-94c2-ecf24c9392a5 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:11.700156 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a558a-2c99-4a5a-94c2-ecf24c9392a5 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:11.700358 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a558a-2c99-4a5a-94c2-ecf24c9392a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:11.722851 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-e06a558a-2c99-4a5a-94c2-ecf24c9392a5 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:37:11.723972 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-e06a558a-2c99-4a5a-94c2-ecf24c9392a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:37:11.730501 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 223/446] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:37:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:37:11.752136 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004a978-c31d-4f48-9eba-ce5524bfec62 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:11.763676 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004a978-c31d-4f48-9eba-ce5524bfec62 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:11.767377 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea169ac-60e2-454a-a641-0da2e4c12842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:11.767940 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea169ac-60e2-454a-a641-0da2e4c12842 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:11.768222 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea169ac-60e2-454a-a641-0da2e4c12842 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:11.768503 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea169ac-60e2-454a-a641-0da2e4c12842 admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:11.769164 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea169ac-60e2-454a-a641-0da2e4c12842 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:11.795149 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING py.warnings [None req-8ea169ac-60e2-454a-a641-0da2e4c12842 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:37:11.795149 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: warnings.warn(msg) Dec 29 20:37:11.795149 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: Dec 29 20:37:11.796024 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea169ac-60e2-454a-a641-0da2e4c12842 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:11.809242 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 224/447] 10.222.0.37 () {60 vars in 1162 bytes} [Wed Dec 29 20:37:11 2021] POST /identity/v3/services => generated 269 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:37:13.751585 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919b4dc-a87b-4b19-97de-66f0dd580957 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:13.752108 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919b4dc-a87b-4b19-97de-66f0dd580957 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:13.752197 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919b4dc-a87b-4b19-97de-66f0dd580957 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:13.753811 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 224/448] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:37:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:37:13.758737 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dd645-7ab5-4a26-9070-3ef488c599f1 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:13.759127 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dd645-7ab5-4a26-9070-3ef488c599f1 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:13.759314 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dd645-7ab5-4a26-9070-3ef488c599f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:13.780825 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-2b6dd645-7ab5-4a26-9070-3ef488c599f1 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:37:13.781949 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-2b6dd645-7ab5-4a26-9070-3ef488c599f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:37:13.797728 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 225/449] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:37:13 2021] POST /identity/v3/auth/tokens => generated 1177 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:37:13.819140 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919b4dc-a87b-4b19-97de-66f0dd580957 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:13.830796 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919b4dc-a87b-4b19-97de-66f0dd580957 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:13.834559 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c6dad-557d-4dad-98ea-b1913dc822e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:13.835307 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c6dad-557d-4dad-98ea-b1913dc822e9 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:13.835598 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c6dad-557d-4dad-98ea-b1913dc822e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:13.835889 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c6dad-557d-4dad-98ea-b1913dc822e9 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:13.836509 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c6dad-557d-4dad-98ea-b1913dc822e9 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:13.861971 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c6dad-557d-4dad-98ea-b1913dc822e9 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:13.873191 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-7a1c6dad-557d-4dad-98ea-b1913dc822e9 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 29 20:37:13.874241 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 225/450] 10.222.0.37 () {56 vars in 1153 bytes} [Wed Dec 29 20:37:13 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:37:13.879833 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dd645-7ab5-4a26-9070-3ef488c599f1 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:13.888347 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dd645-7ab5-4a26-9070-3ef488c599f1 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:13.892151 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002e249-706e-4f5a-a69b-5be885a14a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:13.892724 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002e249-706e-4f5a-a69b-5be885a14a9e admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:13.893006 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002e249-706e-4f5a-a69b-5be885a14a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:13.893280 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002e249-706e-4f5a-a69b-5be885a14a9e admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:13.893941 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3002e249-706e-4f5a-a69b-5be885a14a9e admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:13.894234 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3002e249-706e-4f5a-a69b-5be885a14a9e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:13.919627 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3002e249-706e-4f5a-a69b-5be885a14a9e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:13.923911 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 226/451] 10.222.0.37 () {56 vars in 1147 bytes} [Wed Dec 29 20:37:13 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:13.929008 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c6dad-557d-4dad-98ea-b1913dc822e9 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:13.938572 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c6dad-557d-4dad-98ea-b1913dc822e9 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:13.942414 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b056260-0847-4420-b49d-5b2521d443b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:13.943023 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b056260-0847-4420-b49d-5b2521d443b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:13.943308 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b056260-0847-4420-b49d-5b2521d443b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:13.943587 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b056260-0847-4420-b49d-5b2521d443b4 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:13.944245 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b056260-0847-4420-b49d-5b2521d443b4 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:13.944542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b056260-0847-4420-b49d-5b2521d443b4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:13.970476 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b056260-0847-4420-b49d-5b2521d443b4 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:13.975017 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 226/452] 10.222.0.37 () {56 vars in 1147 bytes} [Wed Dec 29 20:37:13 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:13.980407 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002e249-706e-4f5a-a69b-5be885a14a9e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:13.990225 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002e249-706e-4f5a-a69b-5be885a14a9e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:13.994097 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea139d3-e2ce-48a5-a473-31791390c084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:13.994677 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea139d3-e2ce-48a5-a473-31791390c084 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:13.994980 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea139d3-e2ce-48a5-a473-31791390c084 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:13.995263 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea139d3-e2ce-48a5-a473-31791390c084 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:13.995991 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea139d3-e2ce-48a5-a473-31791390c084 admin admin] RBAC: Adding query filter params (interface=public, service_id=908e0bcd1d274b728fbbd02ca0c14d1b, region_id=RegionOne) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:13.996293 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea139d3-e2ce-48a5-a473-31791390c084 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:14.020997 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING py.warnings [None req-0ea139d3-e2ce-48a5-a473-31791390c084 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:37:14.020997 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: warnings.warn(msg) Dec 29 20:37:14.020997 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: Dec 29 20:37:14.021795 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea139d3-e2ce-48a5-a473-31791390c084 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:14.027496 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 227/453] 10.222.0.37 () {56 vars in 1272 bytes} [Wed Dec 29 20:37:13 2021] GET /identity/v3/endpoints?service_id=908e0bcd1d274b728fbbd02ca0c14d1b&interface=public®ion_id=RegionOne => generated 194 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:14.033305 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b056260-0847-4420-b49d-5b2521d443b4 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:14.042137 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b056260-0847-4420-b49d-5b2521d443b4 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:14.046833 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8bcc1-c892-4598-8bbb-922e2d6b22a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:14.047393 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8bcc1-c892-4598-8bbb-922e2d6b22a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:14.047675 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8bcc1-c892-4598-8bbb-922e2d6b22a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:14.047953 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8bcc1-c892-4598-8bbb-922e2d6b22a3 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:14.048583 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8bcc1-c892-4598-8bbb-922e2d6b22a3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:14.073647 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8bcc1-c892-4598-8bbb-922e2d6b22a3 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:14.078427 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 227/454] 10.222.0.37 () {56 vars in 1108 bytes} [Wed Dec 29 20:37:14 2021] GET /identity/v3/services => generated 562 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:16.011025 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81522602-b2e7-489f-98fd-bf59e22d4939 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:16.011568 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81522602-b2e7-489f-98fd-bf59e22d4939 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:16.011568 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81522602-b2e7-489f-98fd-bf59e22d4939 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:16.013787 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 228/455] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:37:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:37:16.018965 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f5913-124a-47f3-b791-56d8635f9263 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:16.019330 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f5913-124a-47f3-b791-56d8635f9263 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:16.019527 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f5913-124a-47f3-b791-56d8635f9263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:16.042592 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-e38f5913-124a-47f3-b791-56d8635f9263 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:37:16.043741 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-e38f5913-124a-47f3-b791-56d8635f9263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:37:16.050169 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 228/456] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:37:16 2021] POST /identity/v3/auth/tokens => generated 1177 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:37:16.071594 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81522602-b2e7-489f-98fd-bf59e22d4939 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:16.083706 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81522602-b2e7-489f-98fd-bf59e22d4939 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:16.087469 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bced81-247e-468a-8b29-a26587147a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:16.088187 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bced81-247e-468a-8b29-a26587147a45 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:16.088471 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bced81-247e-468a-8b29-a26587147a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:16.088751 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bced81-247e-468a-8b29-a26587147a45 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:16.089359 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bced81-247e-468a-8b29-a26587147a45 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:16.114426 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING py.warnings [None req-53bced81-247e-468a-8b29-a26587147a45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:37:16.114426 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: warnings.warn(msg) Dec 29 20:37:16.114426 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: Dec 29 20:37:16.115249 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bced81-247e-468a-8b29-a26587147a45 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:16.126548 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-53bced81-247e-468a-8b29-a26587147a45 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 29 20:37:16.127628 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 229/457] 10.222.0.37 () {56 vars in 1153 bytes} [Wed Dec 29 20:37:16 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:37:16.133364 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f5913-124a-47f3-b791-56d8635f9263 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:16.142441 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f5913-124a-47f3-b791-56d8635f9263 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:16.146296 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580f82d-f33b-434e-a585-3c00e7c9865b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:16.146906 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580f82d-f33b-434e-a585-3c00e7c9865b admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:16.147191 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580f82d-f33b-434e-a585-3c00e7c9865b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:16.147466 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580f82d-f33b-434e-a585-3c00e7c9865b admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:16.148126 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580f82d-f33b-434e-a585-3c00e7c9865b admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:16.148416 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580f82d-f33b-434e-a585-3c00e7c9865b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:16.174168 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580f82d-f33b-434e-a585-3c00e7c9865b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:16.178293 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 229/458] 10.222.0.37 () {56 vars in 1147 bytes} [Wed Dec 29 20:37:16 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:16.183347 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bced81-247e-468a-8b29-a26587147a45 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:16.192916 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bced81-247e-468a-8b29-a26587147a45 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:16.196762 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1e3f5-e86a-4281-8ae8-c5ae71d18a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:16.197319 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1e3f5-e86a-4281-8ae8-c5ae71d18a2a admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:16.197604 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1e3f5-e86a-4281-8ae8-c5ae71d18a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:16.197878 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1e3f5-e86a-4281-8ae8-c5ae71d18a2a admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:16.198526 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1e3f5-e86a-4281-8ae8-c5ae71d18a2a admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:16.199105 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1e3f5-e86a-4281-8ae8-c5ae71d18a2a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:16.224554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1e3f5-e86a-4281-8ae8-c5ae71d18a2a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:16.229132 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 230/459] 10.222.0.37 () {56 vars in 1147 bytes} [Wed Dec 29 20:37:16 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:16.234638 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580f82d-f33b-434e-a585-3c00e7c9865b admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:16.243619 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580f82d-f33b-434e-a585-3c00e7c9865b admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:16.248174 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fba08-e6ba-418d-b757-15c74eb9a850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:16.248935 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fba08-e6ba-418d-b757-15c74eb9a850 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:16.249350 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fba08-e6ba-418d-b757-15c74eb9a850 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:16.249755 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fba08-e6ba-418d-b757-15c74eb9a850 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:16.250761 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fba08-e6ba-418d-b757-15c74eb9a850 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:16.275847 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING py.warnings [None req-892fba08-e6ba-418d-b757-15c74eb9a850 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:37:16.275847 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: warnings.warn(msg) Dec 29 20:37:16.275847 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: Dec 29 20:37:16.276706 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fba08-e6ba-418d-b757-15c74eb9a850 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:16.295479 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 230/460] 10.222.0.37 () {60 vars in 1165 bytes} [Wed Dec 29 20:37:16 2021] POST /identity/v3/endpoints => generated 347 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:37:18.234569 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6dd2bc-c718-4734-a579-715a1cd27ee5 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:18.235091 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6dd2bc-c718-4734-a579-715a1cd27ee5 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:18.235091 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6dd2bc-c718-4734-a579-715a1cd27ee5 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:18.236754 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 231/461] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:37:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:37:18.241651 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c55b09-82ba-441e-8904-1b7df67aa772 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:18.242025 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c55b09-82ba-441e-8904-1b7df67aa772 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:18.242220 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c55b09-82ba-441e-8904-1b7df67aa772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:18.264606 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-b7c55b09-82ba-441e-8904-1b7df67aa772 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:37:18.265725 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-b7c55b09-82ba-441e-8904-1b7df67aa772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:37:18.285223 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 231/462] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:37:18 2021] POST /identity/v3/auth/tokens => generated 1364 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:37:18.306575 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6dd2bc-c718-4734-a579-715a1cd27ee5 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:18.318530 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6dd2bc-c718-4734-a579-715a1cd27ee5 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:18.322281 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee6a97-e954-43ee-a7be-10061099ec99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:18.323037 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee6a97-e954-43ee-a7be-10061099ec99 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:18.323325 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee6a97-e954-43ee-a7be-10061099ec99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:18.323602 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee6a97-e954-43ee-a7be-10061099ec99 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:18.324460 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee6a97-e954-43ee-a7be-10061099ec99 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:18.349795 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee6a97-e954-43ee-a7be-10061099ec99 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:18.360334 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-63ee6a97-e954-43ee-a7be-10061099ec99 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 29 20:37:18.361359 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 232/463] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:37:18 2021] GET /identity/v3/services/compute => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:18.366904 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c55b09-82ba-441e-8904-1b7df67aa772 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:18.375843 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c55b09-82ba-441e-8904-1b7df67aa772 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:18.379725 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f57f6f-bba3-4da9-a74d-641f3c52736d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:18.380296 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f57f6f-bba3-4da9-a74d-641f3c52736d admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:18.380582 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f57f6f-bba3-4da9-a74d-641f3c52736d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:18.380861 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f57f6f-bba3-4da9-a74d-641f3c52736d admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:18.381523 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f57f6f-bba3-4da9-a74d-641f3c52736d admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:18.381816 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f57f6f-bba3-4da9-a74d-641f3c52736d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:18.407151 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f57f6f-bba3-4da9-a74d-641f3c52736d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:18.411289 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 232/464] 10.222.0.37 () {56 vars in 1133 bytes} [Wed Dec 29 20:37:18 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:18.416355 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee6a97-e954-43ee-a7be-10061099ec99 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:18.426857 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee6a97-e954-43ee-a7be-10061099ec99 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:18.430645 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22282109-4c38-4cf1-9049-7e6d99607656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:18.431227 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22282109-4c38-4cf1-9049-7e6d99607656 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:18.431512 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22282109-4c38-4cf1-9049-7e6d99607656 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:18.431789 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22282109-4c38-4cf1-9049-7e6d99607656 admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:18.432433 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22282109-4c38-4cf1-9049-7e6d99607656 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:18.432727 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22282109-4c38-4cf1-9049-7e6d99607656 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:18.458814 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22282109-4c38-4cf1-9049-7e6d99607656 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:18.462940 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 233/465] 10.222.0.37 () {56 vars in 1133 bytes} [Wed Dec 29 20:37:18 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:20.393923 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8ce54-dc60-4bb8-ac59-bcb4f8e0e073 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:20.394431 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8ce54-dc60-4bb8-ac59-bcb4f8e0e073 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:20.394542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8ce54-dc60-4bb8-ac59-bcb4f8e0e073 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:20.396185 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 233/466] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:37:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:37:20.401123 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb7598-f2cb-421f-84e1-ed13505e762e None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:20.401516 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb7598-f2cb-421f-84e1-ed13505e762e None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:20.401689 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb7598-f2cb-421f-84e1-ed13505e762e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:20.423717 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-cccb7598-f2cb-421f-84e1-ed13505e762e None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:37:20.424831 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-cccb7598-f2cb-421f-84e1-ed13505e762e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:37:20.431274 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 234/467] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:37:20 2021] POST /identity/v3/auth/tokens => generated 1364 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:37:20.452905 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8ce54-dc60-4bb8-ac59-bcb4f8e0e073 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:20.464166 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8ce54-dc60-4bb8-ac59-bcb4f8e0e073 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:20.468575 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d3510-fa4c-4c84-ad6a-750e25b465d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:20.469142 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d3510-fa4c-4c84-ad6a-750e25b465d0 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:20.469429 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d3510-fa4c-4c84-ad6a-750e25b465d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:20.469707 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d3510-fa4c-4c84-ad6a-750e25b465d0 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:20.470379 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d3510-fa4c-4c84-ad6a-750e25b465d0 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:20.494837 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING py.warnings [None req-7e3d3510-fa4c-4c84-ad6a-750e25b465d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:37:20.494837 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: warnings.warn(msg) Dec 29 20:37:20.494837 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: Dec 29 20:37:20.495696 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d3510-fa4c-4c84-ad6a-750e25b465d0 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:20.508538 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 234/468] 10.222.0.37 () {60 vars in 1162 bytes} [Wed Dec 29 20:37:20 2021] POST /identity/v3/services => generated 242 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:37:22.446414 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea345d-5cf3-43cd-8ef3-ef665cd9b78c None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:22.446986 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea345d-5cf3-43cd-8ef3-ef665cd9b78c None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:22.446986 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea345d-5cf3-43cd-8ef3-ef665cd9b78c None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:22.448904 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 235/469] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:37:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:37:22.454173 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876e554-7e47-4693-afd8-ca7c16d2934c None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:22.454552 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876e554-7e47-4693-afd8-ca7c16d2934c None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:22.454785 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876e554-7e47-4693-afd8-ca7c16d2934c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:22.477263 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-f876e554-7e47-4693-afd8-ca7c16d2934c None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:37:22.478394 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-f876e554-7e47-4693-afd8-ca7c16d2934c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:37:22.495119 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 235/470] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:37:22 2021] POST /identity/v3/auth/tokens => generated 1460 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:37:22.516435 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea345d-5cf3-43cd-8ef3-ef665cd9b78c None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:22.527776 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea345d-5cf3-43cd-8ef3-ef665cd9b78c None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:22.532142 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a990d1-2ebf-4c6b-930b-f4c2d72cf8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:22.532840 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a990d1-2ebf-4c6b-930b-f4c2d72cf8df admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:22.533126 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a990d1-2ebf-4c6b-930b-f4c2d72cf8df admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:22.533407 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a990d1-2ebf-4c6b-930b-f4c2d72cf8df admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:22.534021 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a990d1-2ebf-4c6b-930b-f4c2d72cf8df admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:22.559831 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a990d1-2ebf-4c6b-930b-f4c2d72cf8df admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:22.569780 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-a8a990d1-2ebf-4c6b-930b-f4c2d72cf8df admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 29 20:37:22.570827 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 236/471] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:37:22 2021] GET /identity/v3/services/compute => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:22.577559 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876e554-7e47-4693-afd8-ca7c16d2934c None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:22.586000 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876e554-7e47-4693-afd8-ca7c16d2934c None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:22.589947 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa296e-e60f-4eac-b82a-9e2c9e13520a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:22.591570 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa296e-e60f-4eac-b82a-9e2c9e13520a admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:22.591868 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa296e-e60f-4eac-b82a-9e2c9e13520a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:22.592152 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa296e-e60f-4eac-b82a-9e2c9e13520a admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:22.592828 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa296e-e60f-4eac-b82a-9e2c9e13520a admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:22.593128 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa296e-e60f-4eac-b82a-9e2c9e13520a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:22.618812 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa296e-e60f-4eac-b82a-9e2c9e13520a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:22.623769 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 236/472] 10.222.0.37 () {56 vars in 1133 bytes} [Wed Dec 29 20:37:22 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:22.628960 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a990d1-2ebf-4c6b-930b-f4c2d72cf8df admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:22.638410 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a990d1-2ebf-4c6b-930b-f4c2d72cf8df admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:22.642325 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5572772-8a02-4ed7-9335-45108939c5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:22.642923 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5572772-8a02-4ed7-9335-45108939c5bb admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:22.643211 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5572772-8a02-4ed7-9335-45108939c5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:22.643490 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5572772-8a02-4ed7-9335-45108939c5bb admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:22.644155 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5572772-8a02-4ed7-9335-45108939c5bb admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:22.644452 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5572772-8a02-4ed7-9335-45108939c5bb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:22.670113 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5572772-8a02-4ed7-9335-45108939c5bb admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:22.674732 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 237/473] 10.222.0.37 () {56 vars in 1133 bytes} [Wed Dec 29 20:37:22 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:22.679853 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa296e-e60f-4eac-b82a-9e2c9e13520a admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:22.688929 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa296e-e60f-4eac-b82a-9e2c9e13520a admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:22.692824 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5ef1d-fa9c-430f-864a-98e813fe7730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:22.693381 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5ef1d-fa9c-430f-864a-98e813fe7730 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:22.693666 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5ef1d-fa9c-430f-864a-98e813fe7730 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:22.693945 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5ef1d-fa9c-430f-864a-98e813fe7730 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:22.694699 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5ef1d-fa9c-430f-864a-98e813fe7730 admin admin] RBAC: Adding query filter params (interface=public, service_id=d284f000e659410d845d4cce0694e2b9, region_id=RegionOne) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:22.694997 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5ef1d-fa9c-430f-864a-98e813fe7730 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:22.721151 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING py.warnings [None req-54f5ef1d-fa9c-430f-864a-98e813fe7730 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:37:22.721151 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: warnings.warn(msg) Dec 29 20:37:22.721151 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: Dec 29 20:37:22.721953 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5ef1d-fa9c-430f-864a-98e813fe7730 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:22.727704 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 237/474] 10.222.0.37 () {56 vars in 1272 bytes} [Wed Dec 29 20:37:22 2021] GET /identity/v3/endpoints?service_id=d284f000e659410d845d4cce0694e2b9&interface=public®ion_id=RegionOne => generated 194 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:22.732738 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5572772-8a02-4ed7-9335-45108939c5bb admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:22.741767 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5572772-8a02-4ed7-9335-45108939c5bb admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:22.745586 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a741fa-55f4-4b16-a6cd-f05b74be6309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:22.746153 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a741fa-55f4-4b16-a6cd-f05b74be6309 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:22.746438 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a741fa-55f4-4b16-a6cd-f05b74be6309 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:22.746783 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a741fa-55f4-4b16-a6cd-f05b74be6309 admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:22.747414 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a741fa-55f4-4b16-a6cd-f05b74be6309 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:22.772805 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a741fa-55f4-4b16-a6cd-f05b74be6309 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:22.777609 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 238/475] 10.222.0.37 () {56 vars in 1108 bytes} [Wed Dec 29 20:37:22 2021] GET /identity/v3/services => generated 792 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:24.732400 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596e99e-82af-48cb-8613-c32929b28b7d None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:24.732925 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596e99e-82af-48cb-8613-c32929b28b7d None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:24.733009 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596e99e-82af-48cb-8613-c32929b28b7d None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:24.734619 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 238/476] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:37:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:37:24.739737 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc084fa-9823-4913-a496-bc13a3ecba7f None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:24.740128 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc084fa-9823-4913-a496-bc13a3ecba7f None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:24.740299 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc084fa-9823-4913-a496-bc13a3ecba7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:24.763016 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-afc084fa-9823-4913-a496-bc13a3ecba7f None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:37:24.764126 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-afc084fa-9823-4913-a496-bc13a3ecba7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:37:24.770582 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 239/477] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:37:24 2021] POST /identity/v3/auth/tokens => generated 1460 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:37:24.791886 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596e99e-82af-48cb-8613-c32929b28b7d None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:24.803651 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596e99e-82af-48cb-8613-c32929b28b7d None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:24.807424 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a917ac3-e797-48c1-8876-01c5be4d33f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:24.808120 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a917ac3-e797-48c1-8876-01c5be4d33f9 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:24.808406 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a917ac3-e797-48c1-8876-01c5be4d33f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:24.808683 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a917ac3-e797-48c1-8876-01c5be4d33f9 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:24.809918 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a917ac3-e797-48c1-8876-01c5be4d33f9 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:24.836544 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a917ac3-e797-48c1-8876-01c5be4d33f9 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:24.847030 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-9a917ac3-e797-48c1-8876-01c5be4d33f9 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 29 20:37:24.848272 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 239/478] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:37:24 2021] GET /identity/v3/services/compute => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:37:24.853597 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc084fa-9823-4913-a496-bc13a3ecba7f None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:24.862579 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc084fa-9823-4913-a496-bc13a3ecba7f None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:24.866552 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815e310-af01-4e24-8833-ad771c695bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:24.867162 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815e310-af01-4e24-8833-ad771c695bed admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:24.867450 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815e310-af01-4e24-8833-ad771c695bed admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:24.867731 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815e310-af01-4e24-8833-ad771c695bed admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:24.868400 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815e310-af01-4e24-8833-ad771c695bed admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:24.868695 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815e310-af01-4e24-8833-ad771c695bed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:24.894477 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815e310-af01-4e24-8833-ad771c695bed admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:24.898791 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 240/479] 10.222.0.37 () {56 vars in 1133 bytes} [Wed Dec 29 20:37:24 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:24.904468 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a917ac3-e797-48c1-8876-01c5be4d33f9 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:24.913466 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a917ac3-e797-48c1-8876-01c5be4d33f9 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:24.917345 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606bae6-326c-4763-bed8-b42e03e8d3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:24.917915 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606bae6-326c-4763-bed8-b42e03e8d3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:24.918201 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606bae6-326c-4763-bed8-b42e03e8d3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:24.919044 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606bae6-326c-4763-bed8-b42e03e8d3f5 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:24.919712 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606bae6-326c-4763-bed8-b42e03e8d3f5 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:24.920011 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606bae6-326c-4763-bed8-b42e03e8d3f5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:24.945939 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606bae6-326c-4763-bed8-b42e03e8d3f5 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:24.950730 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 240/480] 10.222.0.37 () {56 vars in 1133 bytes} [Wed Dec 29 20:37:24 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:24.955794 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815e310-af01-4e24-8833-ad771c695bed admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:24.964676 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815e310-af01-4e24-8833-ad771c695bed admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:24.968568 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de246bca-36e2-4465-a818-dddc98c745e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:24.969124 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de246bca-36e2-4465-a818-dddc98c745e5 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:24.969406 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de246bca-36e2-4465-a818-dddc98c745e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:24.969685 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de246bca-36e2-4465-a818-dddc98c745e5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:24.970345 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de246bca-36e2-4465-a818-dddc98c745e5 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:24.995223 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING py.warnings [None req-de246bca-36e2-4465-a818-dddc98c745e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:37:24.995223 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: warnings.warn(msg) Dec 29 20:37:24.995223 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: Dec 29 20:37:24.996014 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de246bca-36e2-4465-a818-dddc98c745e5 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:25.015017 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 241/481] 10.222.0.37 () {60 vars in 1165 bytes} [Wed Dec 29 20:37:24 2021] POST /identity/v3/endpoints => generated 334 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:37:27.022173 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c700b5-2b58-4695-9e0b-85070d42c7ea None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:27.022767 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c700b5-2b58-4695-9e0b-85070d42c7ea None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:27.022767 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c700b5-2b58-4695-9e0b-85070d42c7ea None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:27.024438 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 241/482] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:37:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:37:27.029938 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9fa21-3dce-4cce-a47a-8a886c2e510c None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:27.030324 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9fa21-3dce-4cce-a47a-8a886c2e510c None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:27.030497 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9fa21-3dce-4cce-a47a-8a886c2e510c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:27.052780 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-c6c9fa21-3dce-4cce-a47a-8a886c2e510c None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:37:27.053896 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c6c9fa21-3dce-4cce-a47a-8a886c2e510c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:37:27.070050 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 242/483] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:37:27 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:37:27.092865 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c700b5-2b58-4695-9e0b-85070d42c7ea None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:27.104242 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c700b5-2b58-4695-9e0b-85070d42c7ea None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:27.108858 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773436b3-b2f6-4908-9c9b-3b051bab93f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:27.109573 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773436b3-b2f6-4908-9c9b-3b051bab93f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:27.109862 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773436b3-b2f6-4908-9c9b-3b051bab93f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:27.110142 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773436b3-b2f6-4908-9c9b-3b051bab93f5 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:27.122949 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773436b3-b2f6-4908-9c9b-3b051bab93f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:37:27.129576 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-773436b3-b2f6-4908-9c9b-3b051bab93f5 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 29 20:37:27.130636 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 242/484] 10.222.0.37 () {56 vars in 1141 bytes} [Wed Dec 29 20:37:27 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:27.136014 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9fa21-3dce-4cce-a47a-8a886c2e510c None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:27.145062 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9fa21-3dce-4cce-a47a-8a886c2e510c None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:27.149087 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890bcc8-3765-4a93-8d8b-9027a05965b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:27.150454 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890bcc8-3765-4a93-8d8b-9027a05965b0 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:27.150568 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890bcc8-3765-4a93-8d8b-9027a05965b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:27.150795 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890bcc8-3765-4a93-8d8b-9027a05965b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:27.151499 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890bcc8-3765-4a93-8d8b-9027a05965b0 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:27.151792 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890bcc8-3765-4a93-8d8b-9027a05965b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:27.177290 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890bcc8-3765-4a93-8d8b-9027a05965b0 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:27.186378 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 243/485] 10.222.0.37 () {56 vars in 1136 bytes} [Wed Dec 29 20:37:27 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:27.191871 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773436b3-b2f6-4908-9c9b-3b051bab93f5 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:27.201360 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773436b3-b2f6-4908-9c9b-3b051bab93f5 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:27.205271 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054f119-c938-4837-b1d6-947f8b9e2c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:27.205971 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054f119-c938-4837-b1d6-947f8b9e2c6e admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:27.206261 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054f119-c938-4837-b1d6-947f8b9e2c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:27.206543 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054f119-c938-4837-b1d6-947f8b9e2c6e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:27.218152 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054f119-c938-4837-b1d6-947f8b9e2c6e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:27.244077 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054f119-c938-4837-b1d6-947f8b9e2c6e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:27.260945 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-8054f119-c938-4837-b1d6-947f8b9e2c6e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:27.262025 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 243/486] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:37:27.267467 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890bcc8-3765-4a93-8d8b-9027a05965b0 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:27.276392 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890bcc8-3765-4a93-8d8b-9027a05965b0 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:27.280323 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9db977-eabc-41c2-934d-e3c1f6e124aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:27.280888 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9db977-eabc-41c2-934d-e3c1f6e124aa admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:27.281170 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9db977-eabc-41c2-934d-e3c1f6e124aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:27.281445 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9db977-eabc-41c2-934d-e3c1f6e124aa admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:27.282112 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9db977-eabc-41c2-934d-e3c1f6e124aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:27.282406 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9db977-eabc-41c2-934d-e3c1f6e124aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:27.307775 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9db977-eabc-41c2-934d-e3c1f6e124aa admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:27.319924 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 244/487] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:27.325793 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054f119-c938-4837-b1d6-947f8b9e2c6e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:27.334728 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054f119-c938-4837-b1d6-947f8b9e2c6e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:27.338621 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a01570-e26f-495e-8982-fd6d15fcaab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:27.339339 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a01570-e26f-495e-8982-fd6d15fcaab0 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:27.339623 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a01570-e26f-495e-8982-fd6d15fcaab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:27.339901 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a01570-e26f-495e-8982-fd6d15fcaab0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:27.353175 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a01570-e26f-495e-8982-fd6d15fcaab0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:27.378776 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a01570-e26f-495e-8982-fd6d15fcaab0 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:27.396229 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-33a01570-e26f-495e-8982-fd6d15fcaab0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 29 20:37:27.397263 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 244/488] 10.222.0.37 () {56 vars in 1114 bytes} [Wed Dec 29 20:37:27 2021] GET /identity/v3/users/nova => generated 82 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:27.402459 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9db977-eabc-41c2-934d-e3c1f6e124aa admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:27.412137 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9db977-eabc-41c2-934d-e3c1f6e124aa admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:27.416080 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242e176-d37b-45d5-8a9b-7efea33f3789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:27.416657 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242e176-d37b-45d5-8a9b-7efea33f3789 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:27.416944 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242e176-d37b-45d5-8a9b-7efea33f3789 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:27.417224 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242e176-d37b-45d5-8a9b-7efea33f3789 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:27.417998 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5242e176-d37b-45d5-8a9b-7efea33f3789 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:27.418375 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5242e176-d37b-45d5-8a9b-7efea33f3789 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:27.444293 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5242e176-d37b-45d5-8a9b-7efea33f3789 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:27.473462 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 245/489] 10.222.0.37 () {56 vars in 1154 bytes} [Wed Dec 29 20:37:27 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:27.478784 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a01570-e26f-495e-8982-fd6d15fcaab0 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:27.488466 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a01570-e26f-495e-8982-fd6d15fcaab0 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:27.492354 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa74c8-a045-43db-a1a6-cab9cc19e93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:27.492908 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa74c8-a045-43db-a1a6-cab9cc19e93e admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:27.493196 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa74c8-a045-43db-a1a6-cab9cc19e93e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:27.493474 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa74c8-a045-43db-a1a6-cab9cc19e93e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:27.500900 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa74c8-a045-43db-a1a6-cab9cc19e93e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:27.526349 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa74c8-a045-43db-a1a6-cab9cc19e93e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:27.536079 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 245/490] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:37:27 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:37:27.541118 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242e176-d37b-45d5-8a9b-7efea33f3789 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:27.550742 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242e176-d37b-45d5-8a9b-7efea33f3789 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:27.554537 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d6b90-817f-4aff-9a1c-180fcb5b331b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:27.555267 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d6b90-817f-4aff-9a1c-180fcb5b331b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:27.555554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d6b90-817f-4aff-9a1c-180fcb5b331b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:27.555830 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d6b90-817f-4aff-9a1c-180fcb5b331b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:27.567072 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d6b90-817f-4aff-9a1c-180fcb5b331b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:27.592870 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d6b90-817f-4aff-9a1c-180fcb5b331b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:27.609727 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-8a6d6b90-817f-4aff-9a1c-180fcb5b331b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:27.610782 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 246/491] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:27.615965 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa74c8-a045-43db-a1a6-cab9cc19e93e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:27.624196 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa74c8-a045-43db-a1a6-cab9cc19e93e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:27.628177 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23732e6c-f5f8-4a81-959e-995c472a6690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:27.628746 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23732e6c-f5f8-4a81-959e-995c472a6690 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:27.629081 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23732e6c-f5f8-4a81-959e-995c472a6690 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:27.629315 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23732e6c-f5f8-4a81-959e-995c472a6690 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:27.629991 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23732e6c-f5f8-4a81-959e-995c472a6690 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:27.630289 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23732e6c-f5f8-4a81-959e-995c472a6690 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:27.656369 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23732e6c-f5f8-4a81-959e-995c472a6690 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:27.667963 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 246/492] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:37:27.673593 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d6b90-817f-4aff-9a1c-180fcb5b331b admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:27.682426 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d6b90-817f-4aff-9a1c-180fcb5b331b admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:27.686255 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf39d8-17cd-4c4d-b19e-b549cb5d8bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:27.686977 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf39d8-17cd-4c4d-b19e-b549cb5d8bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:27.687260 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf39d8-17cd-4c4d-b19e-b549cb5d8bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:27.687537 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf39d8-17cd-4c4d-b19e-b549cb5d8bf5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:27.697527 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf39d8-17cd-4c4d-b19e-b549cb5d8bf5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:27.723537 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf39d8-17cd-4c4d-b19e-b549cb5d8bf5 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:27.738056 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-ebdf39d8-17cd-4c4d-b19e-b549cb5d8bf5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:37:27.739143 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 247/493] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:37:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:27.744409 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23732e6c-f5f8-4a81-959e-995c472a6690 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:27.753589 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23732e6c-f5f8-4a81-959e-995c472a6690 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:27.757523 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b39ada-5a88-4a8f-a57f-67f3a0b00132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:27.758096 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b39ada-5a88-4a8f-a57f-67f3a0b00132 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:27.758388 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b39ada-5a88-4a8f-a57f-67f3a0b00132 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:27.758705 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b39ada-5a88-4a8f-a57f-67f3a0b00132 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:27.759446 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b39ada-5a88-4a8f-a57f-67f3a0b00132 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:27.759748 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b39ada-5a88-4a8f-a57f-67f3a0b00132 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:27.786204 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b39ada-5a88-4a8f-a57f-67f3a0b00132 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:27.799528 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 247/494] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:37:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:27.805342 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf39d8-17cd-4c4d-b19e-b549cb5d8bf5 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:27.814725 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf39d8-17cd-4c4d-b19e-b549cb5d8bf5 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:27.818485 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968be1f-a249-4b52-9877-0e96aabc2268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:27.819090 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968be1f-a249-4b52-9877-0e96aabc2268 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:27.819374 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968be1f-a249-4b52-9877-0e96aabc2268 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:27.819651 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968be1f-a249-4b52-9877-0e96aabc2268 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:27.820416 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968be1f-a249-4b52-9877-0e96aabc2268 admin admin] RBAC: Adding query filter params (role.id=7be0a1814ee244dcb629551693d66f17, scope.project.id=ed634cf9bb9146f7a9738325a8638b70, user.id=51ef7e54d97a4320bda0c1926d190d8e) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:27.820716 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968be1f-a249-4b52-9877-0e96aabc2268 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:27.847510 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968be1f-a249-4b52-9877-0e96aabc2268 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:27.852801 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 248/495] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:37:27 2021] GET /identity/v3/role_assignments?user.id=51ef7e54d97a4320bda0c1926d190d8e&scope.project.id=ed634cf9bb9146f7a9738325a8638b70&role.id=7be0a1814ee244dcb629551693d66f17 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:29.804099 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04b6c5-0395-4b09-964c-c514b98e7c2d None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:29.804628 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04b6c5-0395-4b09-964c-c514b98e7c2d None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:29.804628 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04b6c5-0395-4b09-964c-c514b98e7c2d None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:29.806313 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 248/496] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:37:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:37:29.812476 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962d421-8d30-4302-a88d-812e9b630044 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:29.812911 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962d421-8d30-4302-a88d-812e9b630044 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:29.813030 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962d421-8d30-4302-a88d-812e9b630044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:29.839885 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-c962d421-8d30-4302-a88d-812e9b630044 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:37:29.841151 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c962d421-8d30-4302-a88d-812e9b630044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:37:29.847940 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 249/497] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:37:29 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:37:29.873977 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04b6c5-0395-4b09-964c-c514b98e7c2d None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:29.885968 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04b6c5-0395-4b09-964c-c514b98e7c2d None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:29.890675 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245b67c-4330-427c-86d1-15d28246d0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:29.891401 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245b67c-4330-427c-86d1-15d28246d0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:29.891687 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245b67c-4330-427c-86d1-15d28246d0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:29.891964 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245b67c-4330-427c-86d1-15d28246d0a7 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:29.903379 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245b67c-4330-427c-86d1-15d28246d0a7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:37:29.909944 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-2245b67c-4330-427c-86d1-15d28246d0a7 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 29 20:37:29.911041 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 249/498] 10.222.0.37 () {56 vars in 1141 bytes} [Wed Dec 29 20:37:29 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:29.916976 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962d421-8d30-4302-a88d-812e9b630044 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:29.926683 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962d421-8d30-4302-a88d-812e9b630044 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:29.930570 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895424a8-5029-4ac0-8d95-85bd7b3fa3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:29.931179 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895424a8-5029-4ac0-8d95-85bd7b3fa3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:29.931463 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895424a8-5029-4ac0-8d95-85bd7b3fa3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:29.931740 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895424a8-5029-4ac0-8d95-85bd7b3fa3d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:29.932439 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895424a8-5029-4ac0-8d95-85bd7b3fa3d2 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:29.932736 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895424a8-5029-4ac0-8d95-85bd7b3fa3d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:29.958146 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895424a8-5029-4ac0-8d95-85bd7b3fa3d2 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:29.967184 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 250/499] 10.222.0.37 () {56 vars in 1136 bytes} [Wed Dec 29 20:37:29 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:29.972613 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245b67c-4330-427c-86d1-15d28246d0a7 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:29.984782 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245b67c-4330-427c-86d1-15d28246d0a7 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:29.988686 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60015ed-9f11-4e47-8a89-371883825df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:29.989373 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60015ed-9f11-4e47-8a89-371883825df0 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:29.989659 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60015ed-9f11-4e47-8a89-371883825df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:29.989937 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60015ed-9f11-4e47-8a89-371883825df0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:30.000857 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60015ed-9f11-4e47-8a89-371883825df0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:30.026141 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60015ed-9f11-4e47-8a89-371883825df0 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:30.044213 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-e60015ed-9f11-4e47-8a89-371883825df0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:30.045285 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 250/500] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:30.050746 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895424a8-5029-4ac0-8d95-85bd7b3fa3d2 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:30.060025 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895424a8-5029-4ac0-8d95-85bd7b3fa3d2 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:30.063822 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f55e3-33f1-4367-acd3-e893dcf3df14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:30.064391 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f55e3-33f1-4367-acd3-e893dcf3df14 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:30.064675 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f55e3-33f1-4367-acd3-e893dcf3df14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:30.064954 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f55e3-33f1-4367-acd3-e893dcf3df14 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:30.065623 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f55e3-33f1-4367-acd3-e893dcf3df14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:30.065916 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f55e3-33f1-4367-acd3-e893dcf3df14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:30.092643 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f55e3-33f1-4367-acd3-e893dcf3df14 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:30.105095 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 251/501] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:30.110491 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60015ed-9f11-4e47-8a89-371883825df0 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:30.119599 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60015ed-9f11-4e47-8a89-371883825df0 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:30.123591 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda17b8-48fc-4df1-bee8-03852e061627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:30.124294 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda17b8-48fc-4df1-bee8-03852e061627 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:30.124579 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda17b8-48fc-4df1-bee8-03852e061627 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:30.124858 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda17b8-48fc-4df1-bee8-03852e061627 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:30.137706 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda17b8-48fc-4df1-bee8-03852e061627 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:30.164213 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda17b8-48fc-4df1-bee8-03852e061627 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:30.181926 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-4cda17b8-48fc-4df1-bee8-03852e061627 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 29 20:37:30.183024 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 251/502] 10.222.0.37 () {56 vars in 1114 bytes} [Wed Dec 29 20:37:30 2021] GET /identity/v3/users/nova => generated 82 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:30.188712 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f55e3-33f1-4367-acd3-e893dcf3df14 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:30.197888 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f55e3-33f1-4367-acd3-e893dcf3df14 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:30.202736 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14251529-e20e-4301-9b66-acbb2838f05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:30.203321 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14251529-e20e-4301-9b66-acbb2838f05f admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:30.203610 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14251529-e20e-4301-9b66-acbb2838f05f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:30.203892 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14251529-e20e-4301-9b66-acbb2838f05f admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:30.204669 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14251529-e20e-4301-9b66-acbb2838f05f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:30.204971 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14251529-e20e-4301-9b66-acbb2838f05f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:30.231234 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14251529-e20e-4301-9b66-acbb2838f05f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:30.258925 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 252/503] 10.222.0.37 () {56 vars in 1154 bytes} [Wed Dec 29 20:37:30 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:30.264735 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda17b8-48fc-4df1-bee8-03852e061627 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:30.273721 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda17b8-48fc-4df1-bee8-03852e061627 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:30.278102 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba31c3-d8dd-4d60-b5f9-023c53667e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:30.278927 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba31c3-d8dd-4d60-b5f9-023c53667e4a admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:30.279221 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba31c3-d8dd-4d60-b5f9-023c53667e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:30.279496 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba31c3-d8dd-4d60-b5f9-023c53667e4a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:30.291274 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba31c3-d8dd-4d60-b5f9-023c53667e4a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:30.316471 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba31c3-d8dd-4d60-b5f9-023c53667e4a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:30.333535 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-19ba31c3-d8dd-4d60-b5f9-023c53667e4a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:30.334551 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 252/504] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:30.339886 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14251529-e20e-4301-9b66-acbb2838f05f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:30.349178 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14251529-e20e-4301-9b66-acbb2838f05f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:30.353054 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305361a6-1f27-4a5d-9caf-2cc4ef6c6a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:30.353626 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305361a6-1f27-4a5d-9caf-2cc4ef6c6a49 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:30.353915 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305361a6-1f27-4a5d-9caf-2cc4ef6c6a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:30.354195 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305361a6-1f27-4a5d-9caf-2cc4ef6c6a49 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:30.354902 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305361a6-1f27-4a5d-9caf-2cc4ef6c6a49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:30.355200 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305361a6-1f27-4a5d-9caf-2cc4ef6c6a49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:30.381435 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305361a6-1f27-4a5d-9caf-2cc4ef6c6a49 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:30.392971 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 253/505] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:30.398095 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba31c3-d8dd-4d60-b5f9-023c53667e4a admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:30.407184 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba31c3-d8dd-4d60-b5f9-023c53667e4a admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:30.410990 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd877f-a9b9-4acf-9df7-f51cd27eac65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:30.411680 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd877f-a9b9-4acf-9df7-f51cd27eac65 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:30.411962 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd877f-a9b9-4acf-9df7-f51cd27eac65 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:30.412236 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd877f-a9b9-4acf-9df7-f51cd27eac65 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:30.421325 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd877f-a9b9-4acf-9df7-f51cd27eac65 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:30.447160 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd877f-a9b9-4acf-9df7-f51cd27eac65 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:30.460407 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-56bd877f-a9b9-4acf-9df7-f51cd27eac65 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:37:30.461419 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 253/506] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:37:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:30.467025 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305361a6-1f27-4a5d-9caf-2cc4ef6c6a49 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:30.475998 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305361a6-1f27-4a5d-9caf-2cc4ef6c6a49 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:30.479869 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca98d1b-a34a-4716-a1ac-652854761587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:30.480434 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca98d1b-a34a-4716-a1ac-652854761587 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:30.481490 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca98d1b-a34a-4716-a1ac-652854761587 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:30.481854 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca98d1b-a34a-4716-a1ac-652854761587 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:30.482591 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca98d1b-a34a-4716-a1ac-652854761587 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:30.482925 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca98d1b-a34a-4716-a1ac-652854761587 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:30.508205 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca98d1b-a34a-4716-a1ac-652854761587 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:30.521024 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 254/507] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:37:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:30.526207 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd877f-a9b9-4acf-9df7-f51cd27eac65 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:30.535634 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd877f-a9b9-4acf-9df7-f51cd27eac65 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:30.539474 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8beec7-6815-4bf7-879c-e44292726b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:30.540254 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8beec7-6815-4bf7-879c-e44292726b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:30.540537 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8beec7-6815-4bf7-879c-e44292726b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:30.540814 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8beec7-6815-4bf7-879c-e44292726b16 admin admin] PATH_INFO: `/v3/projects/ed634cf9bb9146f7a9738325a8638b70/users/51ef7e54d97a4320bda0c1926d190d8e/roles/7be0a1814ee244dcb629551693d66f17` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:30.542767 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8beec7-6815-4bf7-879c-e44292726b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed634cf9bb9146f7a9738325a8638b70, user_id=51ef7e54d97a4320bda0c1926d190d8e, role_id=7be0a1814ee244dcb629551693d66f17)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:30.569468 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8beec7-6815-4bf7-879c-e44292726b16 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:30.582480 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 254/508] 10.222.0.37 () {58 vars in 1460 bytes} [Wed Dec 29 20:37:30 2021] PUT /identity/v3/projects/ed634cf9bb9146f7a9738325a8638b70/users/51ef7e54d97a4320bda0c1926d190d8e/roles/7be0a1814ee244dcb629551693d66f17 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:37:32.510481 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e18ce1-44f8-4d3b-939b-bcde5fbbeed0 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:32.511062 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e18ce1-44f8-4d3b-939b-bcde5fbbeed0 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:32.511062 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e18ce1-44f8-4d3b-939b-bcde5fbbeed0 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:32.513217 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 255/509] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:37:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:37:32.518313 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4eb29-dc63-4870-b13a-c9fe5f440a49 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:32.518746 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4eb29-dc63-4870-b13a-c9fe5f440a49 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:32.518904 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4eb29-dc63-4870-b13a-c9fe5f440a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:32.541309 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-70d4eb29-dc63-4870-b13a-c9fe5f440a49 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:37:32.542435 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-70d4eb29-dc63-4870-b13a-c9fe5f440a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:37:32.603932 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 255/510] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:37:32 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:37:32.626355 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e18ce1-44f8-4d3b-939b-bcde5fbbeed0 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:32.638268 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e18ce1-44f8-4d3b-939b-bcde5fbbeed0 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:32.642216 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cc096-8298-4280-8fea-af8f97e3b895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:32.642953 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cc096-8298-4280-8fea-af8f97e3b895 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:32.643240 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cc096-8298-4280-8fea-af8f97e3b895 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:32.643516 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cc096-8298-4280-8fea-af8f97e3b895 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:32.655192 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cc096-8298-4280-8fea-af8f97e3b895 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:37:32.661790 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-328cc096-8298-4280-8fea-af8f97e3b895 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 29 20:37:32.662878 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 256/511] 10.222.0.37 () {56 vars in 1141 bytes} [Wed Dec 29 20:37:32 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:32.668169 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4eb29-dc63-4870-b13a-c9fe5f440a49 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:32.676459 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4eb29-dc63-4870-b13a-c9fe5f440a49 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:32.680347 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9858c7-3a66-4c51-a1c7-a1ecf7b8cd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:32.680920 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9858c7-3a66-4c51-a1c7-a1ecf7b8cd00 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:32.681205 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9858c7-3a66-4c51-a1c7-a1ecf7b8cd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:32.681481 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9858c7-3a66-4c51-a1c7-a1ecf7b8cd00 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:32.682179 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9858c7-3a66-4c51-a1c7-a1ecf7b8cd00 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:32.682471 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9858c7-3a66-4c51-a1c7-a1ecf7b8cd00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:32.708932 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9858c7-3a66-4c51-a1c7-a1ecf7b8cd00 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:32.717234 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 256/512] 10.222.0.37 () {56 vars in 1136 bytes} [Wed Dec 29 20:37:32 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:32.722384 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cc096-8298-4280-8fea-af8f97e3b895 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:32.732005 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cc096-8298-4280-8fea-af8f97e3b895 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:32.735973 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dadee-ccaf-4ca1-a0df-3043bcd75b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:32.736661 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dadee-ccaf-4ca1-a0df-3043bcd75b0f admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:32.736943 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dadee-ccaf-4ca1-a0df-3043bcd75b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:32.737214 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dadee-ccaf-4ca1-a0df-3043bcd75b0f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:32.748684 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933dadee-ccaf-4ca1-a0df-3043bcd75b0f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:32.774575 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933dadee-ccaf-4ca1-a0df-3043bcd75b0f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:32.791552 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-933dadee-ccaf-4ca1-a0df-3043bcd75b0f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:32.792569 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 257/513] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:32.797718 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9858c7-3a66-4c51-a1c7-a1ecf7b8cd00 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:32.806832 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9858c7-3a66-4c51-a1c7-a1ecf7b8cd00 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:32.811221 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b780a1-a603-42d0-8873-04d485efda7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:32.811794 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b780a1-a603-42d0-8873-04d485efda7c admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:32.812079 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b780a1-a603-42d0-8873-04d485efda7c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:32.812354 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b780a1-a603-42d0-8873-04d485efda7c admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:32.813023 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b780a1-a603-42d0-8873-04d485efda7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:32.813316 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b780a1-a603-42d0-8873-04d485efda7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:32.839400 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b780a1-a603-42d0-8873-04d485efda7c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:32.851905 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 257/514] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:32.857190 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dadee-ccaf-4ca1-a0df-3043bcd75b0f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:32.866334 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dadee-ccaf-4ca1-a0df-3043bcd75b0f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:32.870291 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8619a-c2b5-4feb-b780-ec559a13b685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:32.871554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8619a-c2b5-4feb-b780-ec559a13b685 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:32.871898 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8619a-c2b5-4feb-b780-ec559a13b685 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:32.872244 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8619a-c2b5-4feb-b780-ec559a13b685 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:32.884455 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8619a-c2b5-4feb-b780-ec559a13b685 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:32.911804 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8619a-c2b5-4feb-b780-ec559a13b685 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:32.929127 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-f8e8619a-c2b5-4feb-b780-ec559a13b685 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 29 20:37:32.930194 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 258/515] 10.222.0.37 () {56 vars in 1114 bytes} [Wed Dec 29 20:37:32 2021] GET /identity/v3/users/nova => generated 82 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:32.936194 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b780a1-a603-42d0-8873-04d485efda7c admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:32.945223 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b780a1-a603-42d0-8873-04d485efda7c admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:32.949867 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76688276-80c4-4c5d-856a-96fdfcd64876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:32.950432 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76688276-80c4-4c5d-856a-96fdfcd64876 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:32.950748 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76688276-80c4-4c5d-856a-96fdfcd64876 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:32.951030 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76688276-80c4-4c5d-856a-96fdfcd64876 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:32.951805 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76688276-80c4-4c5d-856a-96fdfcd64876 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:32.952099 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76688276-80c4-4c5d-856a-96fdfcd64876 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:32.977335 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76688276-80c4-4c5d-856a-96fdfcd64876 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:33.005490 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 258/516] 10.222.0.37 () {56 vars in 1154 bytes} [Wed Dec 29 20:37:32 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:33.010766 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8619a-c2b5-4feb-b780-ec559a13b685 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:33.020377 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8619a-c2b5-4feb-b780-ec559a13b685 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:33.024222 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1baaae3-3bfd-4371-808d-1dae5e77f66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:33.024829 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1baaae3-3bfd-4371-808d-1dae5e77f66b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:33.025075 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1baaae3-3bfd-4371-808d-1dae5e77f66b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:33.025352 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1baaae3-3bfd-4371-808d-1dae5e77f66b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:33.032821 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1baaae3-3bfd-4371-808d-1dae5e77f66b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:33.058275 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1baaae3-3bfd-4371-808d-1dae5e77f66b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:33.067006 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 259/517] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:37:33 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:37:33.072092 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76688276-80c4-4c5d-856a-96fdfcd64876 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:33.081275 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76688276-80c4-4c5d-856a-96fdfcd64876 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:33.085087 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d24404-d09d-407c-9ac8-6f3bb9d20cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:33.085786 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d24404-d09d-407c-9ac8-6f3bb9d20cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:33.086070 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d24404-d09d-407c-9ac8-6f3bb9d20cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:33.086346 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d24404-d09d-407c-9ac8-6f3bb9d20cd4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:33.097517 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d24404-d09d-407c-9ac8-6f3bb9d20cd4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:33.123973 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d24404-d09d-407c-9ac8-6f3bb9d20cd4 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:33.140154 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-96d24404-d09d-407c-9ac8-6f3bb9d20cd4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:33.141177 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 259/518] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:33.146449 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1baaae3-3bfd-4371-808d-1dae5e77f66b admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:33.155118 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1baaae3-3bfd-4371-808d-1dae5e77f66b admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:33.159035 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ff37f-4518-4b71-97c0-3b89d5b8585b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:33.159604 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ff37f-4518-4b71-97c0-3b89d5b8585b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:33.159891 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ff37f-4518-4b71-97c0-3b89d5b8585b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:33.160173 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ff37f-4518-4b71-97c0-3b89d5b8585b admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:33.160844 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ff37f-4518-4b71-97c0-3b89d5b8585b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:33.161142 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ff37f-4518-4b71-97c0-3b89d5b8585b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:33.187521 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ff37f-4518-4b71-97c0-3b89d5b8585b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:33.200568 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 260/519] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:33.205869 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d24404-d09d-407c-9ac8-6f3bb9d20cd4 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:33.215513 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d24404-d09d-407c-9ac8-6f3bb9d20cd4 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:33.219397 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab7974-bba2-4a11-9772-9a43bfd667d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:33.220091 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab7974-bba2-4a11-9772-9a43bfd667d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:33.220373 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab7974-bba2-4a11-9772-9a43bfd667d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:33.220647 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab7974-bba2-4a11-9772-9a43bfd667d6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:33.231365 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab7974-bba2-4a11-9772-9a43bfd667d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:33.257123 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab7974-bba2-4a11-9772-9a43bfd667d6 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:33.270084 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-e4ab7974-bba2-4a11-9772-9a43bfd667d6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:37:33.271141 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 260/520] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:37:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:37:33.276749 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ff37f-4518-4b71-97c0-3b89d5b8585b admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:33.285907 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ff37f-4518-4b71-97c0-3b89d5b8585b admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:33.289822 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6c21f-1939-43f2-90af-4ee7d76536e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:33.290390 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6c21f-1939-43f2-90af-4ee7d76536e1 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:33.290707 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6c21f-1939-43f2-90af-4ee7d76536e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:33.290989 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6c21f-1939-43f2-90af-4ee7d76536e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:33.291718 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6c21f-1939-43f2-90af-4ee7d76536e1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:33.292015 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6c21f-1939-43f2-90af-4ee7d76536e1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:33.318208 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6c21f-1939-43f2-90af-4ee7d76536e1 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:33.331097 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 261/521] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:37:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:33.336467 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab7974-bba2-4a11-9772-9a43bfd667d6 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:33.345653 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab7974-bba2-4a11-9772-9a43bfd667d6 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:33.349474 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed7860-5686-415a-baf1-4915033bba96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:33.350036 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed7860-5686-415a-baf1-4915033bba96 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:33.350318 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed7860-5686-415a-baf1-4915033bba96 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:33.350594 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed7860-5686-415a-baf1-4915033bba96 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:33.351389 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed7860-5686-415a-baf1-4915033bba96 admin admin] RBAC: Adding query filter params (role.id=7be0a1814ee244dcb629551693d66f17, scope.project.id=ed634cf9bb9146f7a9738325a8638b70, user.id=51ef7e54d97a4320bda0c1926d190d8e) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:33.351685 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed7860-5686-415a-baf1-4915033bba96 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:33.378360 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed7860-5686-415a-baf1-4915033bba96 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:33.383851 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 261/522] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:37:33 2021] GET /identity/v3/role_assignments?user.id=51ef7e54d97a4320bda0c1926d190d8e&scope.project.id=ed634cf9bb9146f7a9738325a8638b70&role.id=7be0a1814ee244dcb629551693d66f17 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:35.418691 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49353bb1-981f-48be-8d55-178455380efe None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:35.419210 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49353bb1-981f-48be-8d55-178455380efe None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:35.419312 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49353bb1-981f-48be-8d55-178455380efe None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:35.420921 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 262/523] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:37:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:37:35.425909 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef89a9b-f5bb-46b0-a2c7-de1e49ac56cc None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:35.426345 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef89a9b-f5bb-46b0-a2c7-de1e49ac56cc None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:35.426472 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef89a9b-f5bb-46b0-a2c7-de1e49ac56cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:35.448611 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-1ef89a9b-f5bb-46b0-a2c7-de1e49ac56cc None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:37:35.450282 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-1ef89a9b-f5bb-46b0-a2c7-de1e49ac56cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:37:35.456745 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 262/524] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:37:35 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:37:35.479919 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49353bb1-981f-48be-8d55-178455380efe None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:35.491272 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49353bb1-981f-48be-8d55-178455380efe None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:35.495027 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839c5fa-cbc7-486e-a59b-3f7e8f6573ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:35.495719 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839c5fa-cbc7-486e-a59b-3f7e8f6573ef admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:35.496011 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839c5fa-cbc7-486e-a59b-3f7e8f6573ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:35.496286 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839c5fa-cbc7-486e-a59b-3f7e8f6573ef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:35.507468 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839c5fa-cbc7-486e-a59b-3f7e8f6573ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:35.534068 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839c5fa-cbc7-486e-a59b-3f7e8f6573ef admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:35.550284 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-0839c5fa-cbc7-486e-a59b-3f7e8f6573ef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:35.551354 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 263/525] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:37:35.557055 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef89a9b-f5bb-46b0-a2c7-de1e49ac56cc None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:35.565620 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef89a9b-f5bb-46b0-a2c7-de1e49ac56cc None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:35.569504 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818394ee-08b1-4bcf-824d-27f536d7de44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:35.570073 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818394ee-08b1-4bcf-824d-27f536d7de44 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:35.570355 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818394ee-08b1-4bcf-824d-27f536d7de44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:35.570629 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818394ee-08b1-4bcf-824d-27f536d7de44 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:35.571335 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818394ee-08b1-4bcf-824d-27f536d7de44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:35.571628 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818394ee-08b1-4bcf-824d-27f536d7de44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:35.597933 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818394ee-08b1-4bcf-824d-27f536d7de44 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:35.610169 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 263/526] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:35.615294 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839c5fa-cbc7-486e-a59b-3f7e8f6573ef admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:35.624502 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839c5fa-cbc7-486e-a59b-3f7e8f6573ef admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:35.628439 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e7742-1740-4b2d-a4a4-98f3e62a91c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:35.629013 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e7742-1740-4b2d-a4a4-98f3e62a91c5 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:35.629300 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e7742-1740-4b2d-a4a4-98f3e62a91c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:35.629580 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e7742-1740-4b2d-a4a4-98f3e62a91c5 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:35.630214 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e7742-1740-4b2d-a4a4-98f3e62a91c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:35.657285 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e7742-1740-4b2d-a4a4-98f3e62a91c5 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:35.677945 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 264/527] 10.222.0.37 () {60 vars in 1153 bytes} [Wed Dec 29 20:37:35 2021] POST /identity/v3/users => generated 248 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:37:37.644787 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377eca6-55c8-4797-abea-d4658f0d58e8 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:37.645326 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377eca6-55c8-4797-abea-d4658f0d58e8 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:37.645431 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377eca6-55c8-4797-abea-d4658f0d58e8 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:37.647062 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 264/528] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:37:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:37:37.652089 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636f696-8e69-449e-a8bc-6f3ddf051ac1 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:37.652510 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636f696-8e69-449e-a8bc-6f3ddf051ac1 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:37.652647 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636f696-8e69-449e-a8bc-6f3ddf051ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:37.674236 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-8636f696-8e69-449e-a8bc-6f3ddf051ac1 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:37:37.675394 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-8636f696-8e69-449e-a8bc-6f3ddf051ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:37:37.681828 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 265/529] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:37:37 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:37:37.704957 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377eca6-55c8-4797-abea-d4658f0d58e8 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:37.716701 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377eca6-55c8-4797-abea-d4658f0d58e8 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:37.720573 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852dfab-1bb3-4880-889e-f3bb786930bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:37.721274 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852dfab-1bb3-4880-889e-f3bb786930bd admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:37.721561 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852dfab-1bb3-4880-889e-f3bb786930bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:37.721841 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852dfab-1bb3-4880-889e-f3bb786930bd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:37.733295 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1852dfab-1bb3-4880-889e-f3bb786930bd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:37:37.739632 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-1852dfab-1bb3-4880-889e-f3bb786930bd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 29 20:37:37.740692 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 265/530] 10.222.0.37 () {56 vars in 1123 bytes} [Wed Dec 29 20:37:37 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:37.746493 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636f696-8e69-449e-a8bc-6f3ddf051ac1 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:37.755734 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636f696-8e69-449e-a8bc-6f3ddf051ac1 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:37.759635 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d404692-d375-41d4-8670-99fd279f6e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:37.760212 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d404692-d375-41d4-8670-99fd279f6e42 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:37.760496 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d404692-d375-41d4-8670-99fd279f6e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:37.760779 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d404692-d375-41d4-8670-99fd279f6e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:37.761473 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d404692-d375-41d4-8670-99fd279f6e42 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:37.761767 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d404692-d375-41d4-8670-99fd279f6e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:37.786484 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d404692-d375-41d4-8670-99fd279f6e42 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:37.795079 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 266/531] 10.222.0.37 () {56 vars in 1124 bytes} [Wed Dec 29 20:37:37 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:37.800232 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852dfab-1bb3-4880-889e-f3bb786930bd admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:37.810168 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852dfab-1bb3-4880-889e-f3bb786930bd admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:37.814101 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956024f-037e-49e2-908d-a8adba820f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:37.815132 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956024f-037e-49e2-908d-a8adba820f04 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:37.815427 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956024f-037e-49e2-908d-a8adba820f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:37.815703 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956024f-037e-49e2-908d-a8adba820f04 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:37.826883 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956024f-037e-49e2-908d-a8adba820f04 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:37.852310 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956024f-037e-49e2-908d-a8adba820f04 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:37.869907 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-7956024f-037e-49e2-908d-a8adba820f04 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:37.871581 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 266/532] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:37.877038 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d404692-d375-41d4-8670-99fd279f6e42 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:37.886111 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d404692-d375-41d4-8670-99fd279f6e42 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:37.890228 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c3920-9f08-43c4-a6cc-6c81e11f1569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:37.890830 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c3920-9f08-43c4-a6cc-6c81e11f1569 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:37.891118 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c3920-9f08-43c4-a6cc-6c81e11f1569 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:37.891396 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c3920-9f08-43c4-a6cc-6c81e11f1569 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:37.892065 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c3920-9f08-43c4-a6cc-6c81e11f1569 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:37.892358 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c3920-9f08-43c4-a6cc-6c81e11f1569 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:37.918499 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c3920-9f08-43c4-a6cc-6c81e11f1569 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:37.930708 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 267/533] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:37.936512 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956024f-037e-49e2-908d-a8adba820f04 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:37.945430 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956024f-037e-49e2-908d-a8adba820f04 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:37.950056 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e2d17-d725-4e90-8deb-42911da179e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:37.950789 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e2d17-d725-4e90-8deb-42911da179e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:37.951075 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e2d17-d725-4e90-8deb-42911da179e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:37.951351 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e2d17-d725-4e90-8deb-42911da179e5 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:37.963360 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e2d17-d725-4e90-8deb-42911da179e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:37.990288 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e2d17-d725-4e90-8deb-42911da179e5 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:38.008845 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-8a4e2d17-d725-4e90-8deb-42911da179e5 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 29 20:37:38.009884 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 267/534] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:37:37 2021] GET /identity/v3/users/glance => generated 84 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:38.015385 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c3920-9f08-43c4-a6cc-6c81e11f1569 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:38.024606 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c3920-9f08-43c4-a6cc-6c81e11f1569 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:38.029046 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9d924-f89d-4a5a-9ddd-0872203c94c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:38.029622 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9d924-f89d-4a5a-9ddd-0872203c94c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:38.029908 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9d924-f89d-4a5a-9ddd-0872203c94c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:38.030186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9d924-f89d-4a5a-9ddd-0872203c94c4 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:38.031001 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9d924-f89d-4a5a-9ddd-0872203c94c4 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:38.031298 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9d924-f89d-4a5a-9ddd-0872203c94c4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:38.056872 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9d924-f89d-4a5a-9ddd-0872203c94c4 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:38.084907 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 268/535] 10.222.0.37 () {56 vars in 1158 bytes} [Wed Dec 29 20:37:38 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:38.091021 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e2d17-d725-4e90-8deb-42911da179e5 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:38.100715 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e2d17-d725-4e90-8deb-42911da179e5 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:38.104590 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73739200-a94b-4b0a-b444-f47cfaa8619d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:38.105986 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73739200-a94b-4b0a-b444-f47cfaa8619d admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:38.106279 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73739200-a94b-4b0a-b444-f47cfaa8619d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:38.106557 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73739200-a94b-4b0a-b444-f47cfaa8619d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:38.113905 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73739200-a94b-4b0a-b444-f47cfaa8619d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:38.140017 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73739200-a94b-4b0a-b444-f47cfaa8619d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:38.148092 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 268/536] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:37:38 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:37:38.153332 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9d924-f89d-4a5a-9ddd-0872203c94c4 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:38.162240 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9d924-f89d-4a5a-9ddd-0872203c94c4 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:38.166115 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd3108-352e-4cb0-97e3-5bdf8465ea3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:38.166849 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd3108-352e-4cb0-97e3-5bdf8465ea3a admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:38.167131 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd3108-352e-4cb0-97e3-5bdf8465ea3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:38.167405 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd3108-352e-4cb0-97e3-5bdf8465ea3a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:38.178681 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd3108-352e-4cb0-97e3-5bdf8465ea3a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:38.205246 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd3108-352e-4cb0-97e3-5bdf8465ea3a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:38.221544 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-1edd3108-352e-4cb0-97e3-5bdf8465ea3a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:38.222607 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 269/537] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:38.227922 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73739200-a94b-4b0a-b444-f47cfaa8619d admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:38.236570 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73739200-a94b-4b0a-b444-f47cfaa8619d admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:38.240509 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565d2df-870c-4239-8861-ceb730d10c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:38.241074 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565d2df-870c-4239-8861-ceb730d10c32 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:38.241357 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565d2df-870c-4239-8861-ceb730d10c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:38.241634 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565d2df-870c-4239-8861-ceb730d10c32 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:38.242306 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565d2df-870c-4239-8861-ceb730d10c32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:38.242600 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565d2df-870c-4239-8861-ceb730d10c32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:38.268773 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565d2df-870c-4239-8861-ceb730d10c32 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:38.281199 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 269/538] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:38.286313 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd3108-352e-4cb0-97e3-5bdf8465ea3a admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:38.296128 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd3108-352e-4cb0-97e3-5bdf8465ea3a admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:38.299991 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303d990-a06e-438c-970e-86bfe9dec3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:38.300687 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303d990-a06e-438c-970e-86bfe9dec3fc admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:38.300973 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303d990-a06e-438c-970e-86bfe9dec3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:38.301252 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303d990-a06e-438c-970e-86bfe9dec3fc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:38.310671 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303d990-a06e-438c-970e-86bfe9dec3fc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:38.336244 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303d990-a06e-438c-970e-86bfe9dec3fc admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:38.349431 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-3303d990-a06e-438c-970e-86bfe9dec3fc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:37:38.350447 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 270/539] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:37:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:38.356601 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565d2df-870c-4239-8861-ceb730d10c32 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:38.365539 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565d2df-870c-4239-8861-ceb730d10c32 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:38.369512 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634473e-de40-4ce9-a550-1bb268001e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:38.370083 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634473e-de40-4ce9-a550-1bb268001e68 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:38.370370 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634473e-de40-4ce9-a550-1bb268001e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:38.370669 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634473e-de40-4ce9-a550-1bb268001e68 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:38.372011 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634473e-de40-4ce9-a550-1bb268001e68 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:38.372290 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634473e-de40-4ce9-a550-1bb268001e68 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:38.397510 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634473e-de40-4ce9-a550-1bb268001e68 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:38.409936 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 270/540] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:37:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:38.415344 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303d990-a06e-438c-970e-86bfe9dec3fc admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:38.424833 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303d990-a06e-438c-970e-86bfe9dec3fc admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:38.428891 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e461dd-d322-4741-ba06-cdc971e5b172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:38.429401 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e461dd-d322-4741-ba06-cdc971e5b172 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:38.429689 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e461dd-d322-4741-ba06-cdc971e5b172 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:38.429972 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e461dd-d322-4741-ba06-cdc971e5b172 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:38.430819 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e461dd-d322-4741-ba06-cdc971e5b172 admin admin] RBAC: Adding query filter params (role.id=1c5a8286caa54ded9e44ef97f73f6776, scope.project.id=ed634cf9bb9146f7a9738325a8638b70, user.id=f1976a528ee24585bcaccc83e308fec0) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:38.431124 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e461dd-d322-4741-ba06-cdc971e5b172 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:38.457534 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e461dd-d322-4741-ba06-cdc971e5b172 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:38.462732 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 271/541] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:37:38 2021] GET /identity/v3/role_assignments?user.id=f1976a528ee24585bcaccc83e308fec0&scope.project.id=ed634cf9bb9146f7a9738325a8638b70&role.id=1c5a8286caa54ded9e44ef97f73f6776 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:40.379555 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f74377-0a5e-44dc-b64c-36ab3e3485d8 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:40.380063 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f74377-0a5e-44dc-b64c-36ab3e3485d8 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:40.380171 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f74377-0a5e-44dc-b64c-36ab3e3485d8 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:40.381758 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 271/542] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:37:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:37:40.386783 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44b3db-2401-4649-bb15-714d6f33028f None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:40.387215 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44b3db-2401-4649-bb15-714d6f33028f None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:40.387350 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44b3db-2401-4649-bb15-714d6f33028f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:40.409806 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-ba44b3db-2401-4649-bb15-714d6f33028f None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:37:40.410960 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-ba44b3db-2401-4649-bb15-714d6f33028f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:37:40.417419 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 272/543] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:37:40 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:37:40.439537 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f74377-0a5e-44dc-b64c-36ab3e3485d8 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:40.451189 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f74377-0a5e-44dc-b64c-36ab3e3485d8 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:40.454955 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1eacf0-8f8d-4dd8-bbdb-3d284d86ba88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:40.455648 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1eacf0-8f8d-4dd8-bbdb-3d284d86ba88 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:40.455932 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1eacf0-8f8d-4dd8-bbdb-3d284d86ba88 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:40.456207 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1eacf0-8f8d-4dd8-bbdb-3d284d86ba88 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:40.467379 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1eacf0-8f8d-4dd8-bbdb-3d284d86ba88 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:37:40.473617 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-7d1eacf0-8f8d-4dd8-bbdb-3d284d86ba88 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 29 20:37:40.474668 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 272/544] 10.222.0.37 () {56 vars in 1123 bytes} [Wed Dec 29 20:37:40 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:40.480021 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44b3db-2401-4649-bb15-714d6f33028f None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:40.488950 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44b3db-2401-4649-bb15-714d6f33028f None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:40.492861 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49a452-e983-4a8f-ba3b-9408538ecebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:40.493434 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49a452-e983-4a8f-ba3b-9408538ecebe admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:40.493718 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49a452-e983-4a8f-ba3b-9408538ecebe admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:40.493996 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49a452-e983-4a8f-ba3b-9408538ecebe admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:40.494718 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49a452-e983-4a8f-ba3b-9408538ecebe admin admin] RBAC: Adding query filter params (name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:40.495015 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49a452-e983-4a8f-ba3b-9408538ecebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:40.520482 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49a452-e983-4a8f-ba3b-9408538ecebe admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:40.529216 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 273/545] 10.222.0.37 () {56 vars in 1124 bytes} [Wed Dec 29 20:37:40 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:40.534311 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1eacf0-8f8d-4dd8-bbdb-3d284d86ba88 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:40.544257 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1eacf0-8f8d-4dd8-bbdb-3d284d86ba88 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:40.548172 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177c07e-2869-4594-aa8d-7a3da1f79d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:40.548855 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177c07e-2869-4594-aa8d-7a3da1f79d54 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:40.549139 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177c07e-2869-4594-aa8d-7a3da1f79d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:40.549415 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177c07e-2869-4594-aa8d-7a3da1f79d54 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:40.560255 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177c07e-2869-4594-aa8d-7a3da1f79d54 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:40.586302 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177c07e-2869-4594-aa8d-7a3da1f79d54 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:40.603550 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-2177c07e-2869-4594-aa8d-7a3da1f79d54 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:40.604573 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 273/546] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:37:40.609762 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49a452-e983-4a8f-ba3b-9408538ecebe admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:40.618728 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49a452-e983-4a8f-ba3b-9408538ecebe admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:40.622640 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8152d6-9bec-4ca8-a659-de3f0ee1dd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:40.623225 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8152d6-9bec-4ca8-a659-de3f0ee1dd2b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:40.623509 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8152d6-9bec-4ca8-a659-de3f0ee1dd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:40.623786 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8152d6-9bec-4ca8-a659-de3f0ee1dd2b admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:40.624447 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8152d6-9bec-4ca8-a659-de3f0ee1dd2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:40.624742 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8152d6-9bec-4ca8-a659-de3f0ee1dd2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:40.650362 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8152d6-9bec-4ca8-a659-de3f0ee1dd2b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:40.663261 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 274/547] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:40.668274 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177c07e-2869-4594-aa8d-7a3da1f79d54 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:40.677230 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177c07e-2869-4594-aa8d-7a3da1f79d54 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:40.681096 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edff570-8d7e-4e7e-81ed-3b480c2a742a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:40.681789 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edff570-8d7e-4e7e-81ed-3b480c2a742a admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:40.682071 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edff570-8d7e-4e7e-81ed-3b480c2a742a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:40.682343 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edff570-8d7e-4e7e-81ed-3b480c2a742a admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:40.694457 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edff570-8d7e-4e7e-81ed-3b480c2a742a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:40.721545 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edff570-8d7e-4e7e-81ed-3b480c2a742a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:40.738323 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-1edff570-8d7e-4e7e-81ed-3b480c2a742a admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 29 20:37:40.739366 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 274/548] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:37:40 2021] GET /identity/v3/users/glance => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:40.744650 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8152d6-9bec-4ca8-a659-de3f0ee1dd2b admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:40.753692 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8152d6-9bec-4ca8-a659-de3f0ee1dd2b admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:40.757590 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844d169-bd26-41b2-8089-dcd60f42c02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:40.758164 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844d169-bd26-41b2-8089-dcd60f42c02f admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:40.758451 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844d169-bd26-41b2-8089-dcd60f42c02f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:40.758766 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844d169-bd26-41b2-8089-dcd60f42c02f admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:40.759535 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844d169-bd26-41b2-8089-dcd60f42c02f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:40.759833 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844d169-bd26-41b2-8089-dcd60f42c02f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:40.786190 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844d169-bd26-41b2-8089-dcd60f42c02f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:40.814313 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 275/549] 10.222.0.37 () {56 vars in 1158 bytes} [Wed Dec 29 20:37:40 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:40.819441 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edff570-8d7e-4e7e-81ed-3b480c2a742a admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:40.829428 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edff570-8d7e-4e7e-81ed-3b480c2a742a admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:40.833328 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9eb54e-ed03-47e3-8019-35a29e48c262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:40.834027 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eb54e-ed03-47e3-8019-35a29e48c262 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:40.834314 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eb54e-ed03-47e3-8019-35a29e48c262 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:40.834592 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eb54e-ed03-47e3-8019-35a29e48c262 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:40.847081 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9eb54e-ed03-47e3-8019-35a29e48c262 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:40.872419 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9eb54e-ed03-47e3-8019-35a29e48c262 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:40.889435 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-6b9eb54e-ed03-47e3-8019-35a29e48c262 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:40.890493 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 275/550] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:37:40.895847 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844d169-bd26-41b2-8089-dcd60f42c02f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:40.905492 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844d169-bd26-41b2-8089-dcd60f42c02f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:40.909351 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ddce1-0497-471a-a571-918fac9d3d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:40.909923 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ddce1-0497-471a-a571-918fac9d3d7b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:40.910211 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ddce1-0497-471a-a571-918fac9d3d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:40.910493 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ddce1-0497-471a-a571-918fac9d3d7b admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:40.911203 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ddce1-0497-471a-a571-918fac9d3d7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:40.911503 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ddce1-0497-471a-a571-918fac9d3d7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:40.937188 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ddce1-0497-471a-a571-918fac9d3d7b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:40.949529 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 276/551] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:40.954617 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9eb54e-ed03-47e3-8019-35a29e48c262 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:40.964604 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9eb54e-ed03-47e3-8019-35a29e48c262 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:40.968663 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04785d-7f72-4fe6-b5d6-2db306c91432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:40.969366 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04785d-7f72-4fe6-b5d6-2db306c91432 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:40.969653 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04785d-7f72-4fe6-b5d6-2db306c91432 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:40.969932 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04785d-7f72-4fe6-b5d6-2db306c91432 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:40.979839 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04785d-7f72-4fe6-b5d6-2db306c91432 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:41.006150 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04785d-7f72-4fe6-b5d6-2db306c91432 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:41.019957 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-2c04785d-7f72-4fe6-b5d6-2db306c91432 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:37:41.020987 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 276/552] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:37:40 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:41.026408 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ddce1-0497-471a-a571-918fac9d3d7b admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:41.036015 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ddce1-0497-471a-a571-918fac9d3d7b admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:41.039953 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a366dad-3cb3-46e4-bc5b-ac2b266d5c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:41.040521 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a366dad-3cb3-46e4-bc5b-ac2b266d5c6e admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:41.040809 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a366dad-3cb3-46e4-bc5b-ac2b266d5c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:41.041085 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a366dad-3cb3-46e4-bc5b-ac2b266d5c6e admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:41.041929 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a366dad-3cb3-46e4-bc5b-ac2b266d5c6e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:41.042231 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a366dad-3cb3-46e4-bc5b-ac2b266d5c6e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:41.067883 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a366dad-3cb3-46e4-bc5b-ac2b266d5c6e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:41.081464 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 277/553] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:37:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:41.087410 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04785d-7f72-4fe6-b5d6-2db306c91432 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:41.096415 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04785d-7f72-4fe6-b5d6-2db306c91432 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:41.100316 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a29ae2-da64-4218-9888-1806f8b33aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:41.101107 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a29ae2-da64-4218-9888-1806f8b33aee admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:41.101390 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a29ae2-da64-4218-9888-1806f8b33aee admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:41.101666 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a29ae2-da64-4218-9888-1806f8b33aee admin admin] PATH_INFO: `/v3/projects/ed634cf9bb9146f7a9738325a8638b70/users/f1976a528ee24585bcaccc83e308fec0/roles/1c5a8286caa54ded9e44ef97f73f6776` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:41.122275 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a29ae2-da64-4218-9888-1806f8b33aee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed634cf9bb9146f7a9738325a8638b70, user_id=f1976a528ee24585bcaccc83e308fec0, role_id=1c5a8286caa54ded9e44ef97f73f6776)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:41.148856 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a29ae2-da64-4218-9888-1806f8b33aee admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:41.160677 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 277/554] 10.222.0.37 () {58 vars in 1460 bytes} [Wed Dec 29 20:37:41 2021] PUT /identity/v3/projects/ed634cf9bb9146f7a9738325a8638b70/users/f1976a528ee24585bcaccc83e308fec0/roles/1c5a8286caa54ded9e44ef97f73f6776 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:37:43.084772 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c324ba-a63b-4645-92a7-68b3b2b99af5 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:43.085281 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c324ba-a63b-4645-92a7-68b3b2b99af5 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:43.085386 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c324ba-a63b-4645-92a7-68b3b2b99af5 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:43.087025 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 278/555] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:37:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:37:43.092652 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fc2dc-725b-49f4-811c-6ebdfba09365 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:43.093069 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fc2dc-725b-49f4-811c-6ebdfba09365 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:43.093222 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fc2dc-725b-49f4-811c-6ebdfba09365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:43.115105 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-903fc2dc-725b-49f4-811c-6ebdfba09365 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:37:43.116179 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-903fc2dc-725b-49f4-811c-6ebdfba09365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:37:43.178468 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 278/556] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:37:43 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:37:43.201671 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c324ba-a63b-4645-92a7-68b3b2b99af5 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:43.213007 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c324ba-a63b-4645-92a7-68b3b2b99af5 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:43.217086 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae318e-d05c-4350-ac28-79d25bda08d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:43.217781 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae318e-d05c-4350-ac28-79d25bda08d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:43.218062 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae318e-d05c-4350-ac28-79d25bda08d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:43.218336 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae318e-d05c-4350-ac28-79d25bda08d3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:43.229301 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae318e-d05c-4350-ac28-79d25bda08d3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:37:43.235738 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-88ae318e-d05c-4350-ac28-79d25bda08d3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 29 20:37:43.236816 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 279/557] 10.222.0.37 () {56 vars in 1123 bytes} [Wed Dec 29 20:37:43 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:43.242962 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fc2dc-725b-49f4-811c-6ebdfba09365 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:43.251946 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fc2dc-725b-49f4-811c-6ebdfba09365 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:43.255927 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c7a72-b392-4f06-bce0-fd59bb807a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:43.256511 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c7a72-b392-4f06-bce0-fd59bb807a26 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:43.256801 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c7a72-b392-4f06-bce0-fd59bb807a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:43.257085 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c7a72-b392-4f06-bce0-fd59bb807a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:43.257792 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c7a72-b392-4f06-bce0-fd59bb807a26 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:43.258091 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c7a72-b392-4f06-bce0-fd59bb807a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:43.284139 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c7a72-b392-4f06-bce0-fd59bb807a26 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:43.292231 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 279/558] 10.222.0.37 () {56 vars in 1124 bytes} [Wed Dec 29 20:37:43 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:43.297587 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae318e-d05c-4350-ac28-79d25bda08d3 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:43.309803 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae318e-d05c-4350-ac28-79d25bda08d3 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:43.313717 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894939c-9c67-4577-99ed-25e5100c0de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:43.314407 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894939c-9c67-4577-99ed-25e5100c0de2 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:43.314721 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894939c-9c67-4577-99ed-25e5100c0de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:43.314999 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894939c-9c67-4577-99ed-25e5100c0de2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:43.326937 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c894939c-9c67-4577-99ed-25e5100c0de2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:43.352044 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c894939c-9c67-4577-99ed-25e5100c0de2 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:43.368915 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-c894939c-9c67-4577-99ed-25e5100c0de2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:43.369894 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 280/559] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:43.375935 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c7a72-b392-4f06-bce0-fd59bb807a26 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:43.384889 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c7a72-b392-4f06-bce0-fd59bb807a26 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:43.389659 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd1eac-d7de-475f-b441-da12f43bbe9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:43.390224 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd1eac-d7de-475f-b441-da12f43bbe9e admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:43.390510 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd1eac-d7de-475f-b441-da12f43bbe9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:43.390823 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd1eac-d7de-475f-b441-da12f43bbe9e admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:43.391498 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd1eac-d7de-475f-b441-da12f43bbe9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:43.391791 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd1eac-d7de-475f-b441-da12f43bbe9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:43.416842 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd1eac-d7de-475f-b441-da12f43bbe9e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:43.429011 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 280/560] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:43.435285 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894939c-9c67-4577-99ed-25e5100c0de2 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:43.444283 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894939c-9c67-4577-99ed-25e5100c0de2 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:43.448564 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78922695-130d-48de-a5c3-5d0691bdc880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:43.449885 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78922695-130d-48de-a5c3-5d0691bdc880 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:43.450169 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78922695-130d-48de-a5c3-5d0691bdc880 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:43.450444 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78922695-130d-48de-a5c3-5d0691bdc880 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:43.462452 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78922695-130d-48de-a5c3-5d0691bdc880 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:43.487660 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78922695-130d-48de-a5c3-5d0691bdc880 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:43.504778 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-78922695-130d-48de-a5c3-5d0691bdc880 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 29 20:37:43.505802 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 281/561] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:37:43 2021] GET /identity/v3/users/glance => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:43.511757 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd1eac-d7de-475f-b441-da12f43bbe9e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:43.520795 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd1eac-d7de-475f-b441-da12f43bbe9e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:43.524787 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b33f6-e0cc-4d37-9e8a-84544dfd9150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:43.525361 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b33f6-e0cc-4d37-9e8a-84544dfd9150 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:43.525645 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b33f6-e0cc-4d37-9e8a-84544dfd9150 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:43.525923 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b33f6-e0cc-4d37-9e8a-84544dfd9150 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:43.526791 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b33f6-e0cc-4d37-9e8a-84544dfd9150 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:43.527274 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b33f6-e0cc-4d37-9e8a-84544dfd9150 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:43.552841 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b33f6-e0cc-4d37-9e8a-84544dfd9150 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:43.581163 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 281/562] 10.222.0.37 () {56 vars in 1158 bytes} [Wed Dec 29 20:37:43 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:43.586351 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78922695-130d-48de-a5c3-5d0691bdc880 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:43.595284 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78922695-130d-48de-a5c3-5d0691bdc880 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:43.599109 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd3012-91c4-4bd3-a19f-3253cb83ad10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:43.599661 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd3012-91c4-4bd3-a19f-3253cb83ad10 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:43.599941 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd3012-91c4-4bd3-a19f-3253cb83ad10 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:43.600213 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd3012-91c4-4bd3-a19f-3253cb83ad10 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:43.608060 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd3012-91c4-4bd3-a19f-3253cb83ad10 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:43.633625 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd3012-91c4-4bd3-a19f-3253cb83ad10 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:43.641788 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 282/563] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:37:43 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:37:43.647036 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b33f6-e0cc-4d37-9e8a-84544dfd9150 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:43.656542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b33f6-e0cc-4d37-9e8a-84544dfd9150 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:43.660547 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc230bd-0cbe-4f7e-aca1-603845307660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:43.661252 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc230bd-0cbe-4f7e-aca1-603845307660 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:43.661539 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc230bd-0cbe-4f7e-aca1-603845307660 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:43.661820 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc230bd-0cbe-4f7e-aca1-603845307660 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:43.673921 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc230bd-0cbe-4f7e-aca1-603845307660 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:43.700454 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc230bd-0cbe-4f7e-aca1-603845307660 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:43.717327 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-dbc230bd-0cbe-4f7e-aca1-603845307660 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:43.718404 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 282/564] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:43.723802 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd3012-91c4-4bd3-a19f-3253cb83ad10 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:43.732843 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd3012-91c4-4bd3-a19f-3253cb83ad10 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:43.736767 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcc40c-8e4a-460a-bb01-52242b274144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:43.737338 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcc40c-8e4a-460a-bb01-52242b274144 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:43.737622 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcc40c-8e4a-460a-bb01-52242b274144 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:43.737900 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcc40c-8e4a-460a-bb01-52242b274144 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:43.738567 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcc40c-8e4a-460a-bb01-52242b274144 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:43.738890 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcc40c-8e4a-460a-bb01-52242b274144 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:43.764270 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcc40c-8e4a-460a-bb01-52242b274144 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:43.776582 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 283/565] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:43.781673 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc230bd-0cbe-4f7e-aca1-603845307660 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:43.790576 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc230bd-0cbe-4f7e-aca1-603845307660 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:43.795141 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e6971-ab92-4c5d-80c9-41b6952f6125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:43.795832 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e6971-ab92-4c5d-80c9-41b6952f6125 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:43.796116 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e6971-ab92-4c5d-80c9-41b6952f6125 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:43.796390 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e6971-ab92-4c5d-80c9-41b6952f6125 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:43.804977 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e6971-ab92-4c5d-80c9-41b6952f6125 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:43.831325 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e6971-ab92-4c5d-80c9-41b6952f6125 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:43.844576 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-1e9e6971-ab92-4c5d-80c9-41b6952f6125 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:37:43.845629 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 283/566] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:37:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:43.851015 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcc40c-8e4a-460a-bb01-52242b274144 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:43.860732 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcc40c-8e4a-460a-bb01-52242b274144 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:43.864722 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d66d7d-b135-4754-ad3b-3813155560f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:43.865296 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d66d7d-b135-4754-ad3b-3813155560f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:43.865584 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d66d7d-b135-4754-ad3b-3813155560f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:43.865863 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d66d7d-b135-4754-ad3b-3813155560f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:43.866592 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d66d7d-b135-4754-ad3b-3813155560f8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:43.866930 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d66d7d-b135-4754-ad3b-3813155560f8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:43.892736 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d66d7d-b135-4754-ad3b-3813155560f8 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:43.905492 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 284/567] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:37:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:43.911052 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e6971-ab92-4c5d-80c9-41b6952f6125 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:43.920678 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e6971-ab92-4c5d-80c9-41b6952f6125 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:43.924574 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af58a8a-a52e-4198-bb05-75f46ce02a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:43.925137 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af58a8a-a52e-4198-bb05-75f46ce02a72 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:43.925420 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af58a8a-a52e-4198-bb05-75f46ce02a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:43.925696 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af58a8a-a52e-4198-bb05-75f46ce02a72 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:43.926461 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af58a8a-a52e-4198-bb05-75f46ce02a72 admin admin] RBAC: Adding query filter params (role.id=1c5a8286caa54ded9e44ef97f73f6776, scope.project.id=ed634cf9bb9146f7a9738325a8638b70, user.id=f1976a528ee24585bcaccc83e308fec0) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:43.926789 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af58a8a-a52e-4198-bb05-75f46ce02a72 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:43.952889 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af58a8a-a52e-4198-bb05-75f46ce02a72 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:43.958316 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 284/568] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:37:43 2021] GET /identity/v3/role_assignments?user.id=f1976a528ee24585bcaccc83e308fec0&scope.project.id=ed634cf9bb9146f7a9738325a8638b70&role.id=1c5a8286caa54ded9e44ef97f73f6776 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:37:45.947471 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3be1b8-08a0-41be-8b49-a0f7e584b0e1 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:45.947967 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3be1b8-08a0-41be-8b49-a0f7e584b0e1 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:45.948050 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3be1b8-08a0-41be-8b49-a0f7e584b0e1 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:45.950823 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 285/569] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:37:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:37:45.955684 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c2e92-6be9-498d-bb8e-7d2c76de6308 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:45.956092 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c2e92-6be9-498d-bb8e-7d2c76de6308 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:45.956238 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c2e92-6be9-498d-bb8e-7d2c76de6308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:45.978695 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-aa0c2e92-6be9-498d-bb8e-7d2c76de6308 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:37:45.979816 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-aa0c2e92-6be9-498d-bb8e-7d2c76de6308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:37:45.986379 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 285/570] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:37:45 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:37:46.009272 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3be1b8-08a0-41be-8b49-a0f7e584b0e1 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:46.021175 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3be1b8-08a0-41be-8b49-a0f7e584b0e1 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:46.024980 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41eeacf-7222-4022-9d09-1020b6d23285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:46.025675 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41eeacf-7222-4022-9d09-1020b6d23285 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:46.025961 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41eeacf-7222-4022-9d09-1020b6d23285 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:46.026237 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41eeacf-7222-4022-9d09-1020b6d23285 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:46.038077 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41eeacf-7222-4022-9d09-1020b6d23285 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:46.063651 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41eeacf-7222-4022-9d09-1020b6d23285 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:46.080846 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-b41eeacf-7222-4022-9d09-1020b6d23285 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:46.081883 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 286/571] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:46.087654 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c2e92-6be9-498d-bb8e-7d2c76de6308 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:46.096563 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c2e92-6be9-498d-bb8e-7d2c76de6308 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:46.100449 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81bb43-7769-422d-a00f-ab9a3b97a46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:46.101018 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81bb43-7769-422d-a00f-ab9a3b97a46b admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:46.101301 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81bb43-7769-422d-a00f-ab9a3b97a46b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:46.101582 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81bb43-7769-422d-a00f-ab9a3b97a46b admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:46.102256 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81bb43-7769-422d-a00f-ab9a3b97a46b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:46.102548 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81bb43-7769-422d-a00f-ab9a3b97a46b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:46.127636 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81bb43-7769-422d-a00f-ab9a3b97a46b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:46.140229 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 286/572] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:46.145370 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41eeacf-7222-4022-9d09-1020b6d23285 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:46.155112 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41eeacf-7222-4022-9d09-1020b6d23285 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:46.159040 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69128ec1-af6e-4940-bc39-fd6076bb41de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:46.159618 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69128ec1-af6e-4940-bc39-fd6076bb41de admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:46.159908 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69128ec1-af6e-4940-bc39-fd6076bb41de admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:46.160192 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69128ec1-af6e-4940-bc39-fd6076bb41de admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:46.160838 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69128ec1-af6e-4940-bc39-fd6076bb41de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:46.186979 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69128ec1-af6e-4940-bc39-fd6076bb41de admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:46.206393 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 287/573] 10.222.0.37 () {60 vars in 1153 bytes} [Wed Dec 29 20:37:46 2021] POST /identity/v3/users => generated 254 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:37:48.178282 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6a682-145e-49e4-ba78-8b0d66935de8 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:48.178822 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6a682-145e-49e4-ba78-8b0d66935de8 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:48.178822 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6a682-145e-49e4-ba78-8b0d66935de8 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:48.180454 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 287/574] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:37:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:37:48.185591 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f841e90-5946-4623-92a0-9cd0b5e90fa7 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:48.186002 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f841e90-5946-4623-92a0-9cd0b5e90fa7 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:48.186138 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f841e90-5946-4623-92a0-9cd0b5e90fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:48.208094 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-8f841e90-5946-4623-92a0-9cd0b5e90fa7 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:37:48.209214 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-8f841e90-5946-4623-92a0-9cd0b5e90fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:37:48.216564 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 288/575] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:37:48 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:37:48.238210 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6a682-145e-49e4-ba78-8b0d66935de8 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:48.249648 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6a682-145e-49e4-ba78-8b0d66935de8 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:48.253401 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4435074-fb89-48ef-abec-91eb688c7b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:48.254093 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4435074-fb89-48ef-abec-91eb688c7b00 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:48.254376 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4435074-fb89-48ef-abec-91eb688c7b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:48.254666 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4435074-fb89-48ef-abec-91eb688c7b00 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:48.266082 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4435074-fb89-48ef-abec-91eb688c7b00 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:37:48.272252 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-c4435074-fb89-48ef-abec-91eb688c7b00 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 29 20:37:48.273290 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 288/576] 10.222.0.37 () {56 vars in 1123 bytes} [Wed Dec 29 20:37:48 2021] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:48.279544 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f841e90-5946-4623-92a0-9cd0b5e90fa7 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:48.287942 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f841e90-5946-4623-92a0-9cd0b5e90fa7 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:48.291869 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8c4ae-49a5-41f5-b340-589a9ad0503e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:48.292712 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8c4ae-49a5-41f5-b340-589a9ad0503e admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:48.293004 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8c4ae-49a5-41f5-b340-589a9ad0503e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:48.293283 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8c4ae-49a5-41f5-b340-589a9ad0503e admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:48.293985 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8c4ae-49a5-41f5-b340-589a9ad0503e admin admin] RBAC: Adding query filter params (name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:48.294281 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8c4ae-49a5-41f5-b340-589a9ad0503e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:48.319912 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8c4ae-49a5-41f5-b340-589a9ad0503e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:48.329100 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 289/577] 10.222.0.37 () {56 vars in 1124 bytes} [Wed Dec 29 20:37:48 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:48.334165 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4435074-fb89-48ef-abec-91eb688c7b00 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:48.345883 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4435074-fb89-48ef-abec-91eb688c7b00 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:48.349758 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9f878-76fe-4b9e-b664-5252cb4344eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:48.350446 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9f878-76fe-4b9e-b664-5252cb4344eb admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:48.350755 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9f878-76fe-4b9e-b664-5252cb4344eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:48.351029 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9f878-76fe-4b9e-b664-5252cb4344eb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:48.361767 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9f878-76fe-4b9e-b664-5252cb4344eb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:48.387790 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9f878-76fe-4b9e-b664-5252cb4344eb admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:48.404873 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-77f9f878-76fe-4b9e-b664-5252cb4344eb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:48.405883 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 289/578] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:48.411054 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8c4ae-49a5-41f5-b340-589a9ad0503e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:48.420234 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8c4ae-49a5-41f5-b340-589a9ad0503e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:48.424183 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09c914-df05-4591-855f-3a8ee1e39965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:48.424754 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09c914-df05-4591-855f-3a8ee1e39965 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:48.425040 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09c914-df05-4591-855f-3a8ee1e39965 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:48.425320 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09c914-df05-4591-855f-3a8ee1e39965 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:48.425998 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09c914-df05-4591-855f-3a8ee1e39965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:48.426294 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09c914-df05-4591-855f-3a8ee1e39965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:48.452992 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09c914-df05-4591-855f-3a8ee1e39965 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:48.465538 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 290/579] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:48.470699 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9f878-76fe-4b9e-b664-5252cb4344eb admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:48.479738 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9f878-76fe-4b9e-b664-5252cb4344eb admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:48.483871 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a897962-0add-4b62-80b2-990a4d6dc5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:48.484587 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a897962-0add-4b62-80b2-990a4d6dc5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:48.484874 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a897962-0add-4b62-80b2-990a4d6dc5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:48.485151 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a897962-0add-4b62-80b2-990a4d6dc5c5 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:48.497877 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a897962-0add-4b62-80b2-990a4d6dc5c5 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:48.524030 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a897962-0add-4b62-80b2-990a4d6dc5c5 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:48.541428 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-8a897962-0add-4b62-80b2-990a4d6dc5c5 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 29 20:37:48.542482 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 290/580] 10.222.0.37 () {56 vars in 1138 bytes} [Wed Dec 29 20:37:48 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:48.547796 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09c914-df05-4591-855f-3a8ee1e39965 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:48.558440 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09c914-df05-4591-855f-3a8ee1e39965 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:48.562617 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ef1c6-6fe1-4a30-bd59-981d47060422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:48.563236 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ef1c6-6fe1-4a30-bd59-981d47060422 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:48.563522 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ef1c6-6fe1-4a30-bd59-981d47060422 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:48.563801 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ef1c6-6fe1-4a30-bd59-981d47060422 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:48.564584 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ef1c6-6fe1-4a30-bd59-981d47060422 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:48.564886 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ef1c6-6fe1-4a30-bd59-981d47060422 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:48.591207 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ef1c6-6fe1-4a30-bd59-981d47060422 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:48.619593 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 291/581] 10.222.0.37 () {56 vars in 1170 bytes} [Wed Dec 29 20:37:48 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:48.625917 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a897962-0add-4b62-80b2-990a4d6dc5c5 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:48.635049 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a897962-0add-4b62-80b2-990a4d6dc5c5 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:48.639629 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cb7fb-ab43-474c-9010-a4eb370d3ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:48.640197 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cb7fb-ab43-474c-9010-a4eb370d3ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:48.640486 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cb7fb-ab43-474c-9010-a4eb370d3ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:48.640770 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cb7fb-ab43-474c-9010-a4eb370d3ce6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:48.648230 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8cb7fb-ab43-474c-9010-a4eb370d3ce6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:48.674035 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8cb7fb-ab43-474c-9010-a4eb370d3ce6 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:48.682244 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 291/582] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:37:48 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:37:48.688078 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ef1c6-6fe1-4a30-bd59-981d47060422 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:48.697115 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ef1c6-6fe1-4a30-bd59-981d47060422 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:48.702000 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c286de-5a3d-4b09-a63c-2f1a36b0836c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:48.702726 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c286de-5a3d-4b09-a63c-2f1a36b0836c admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:48.703060 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c286de-5a3d-4b09-a63c-2f1a36b0836c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:48.703291 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c286de-5a3d-4b09-a63c-2f1a36b0836c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:48.715148 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c286de-5a3d-4b09-a63c-2f1a36b0836c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:48.740187 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c286de-5a3d-4b09-a63c-2f1a36b0836c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:48.756984 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-b6c286de-5a3d-4b09-a63c-2f1a36b0836c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:48.758024 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 292/583] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:48.764062 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cb7fb-ab43-474c-9010-a4eb370d3ce6 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:48.772404 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cb7fb-ab43-474c-9010-a4eb370d3ce6 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:48.776454 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e286f9-e5b9-4723-8264-ebd02bc7d3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:48.777103 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e286f9-e5b9-4723-8264-ebd02bc7d3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:48.777396 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e286f9-e5b9-4723-8264-ebd02bc7d3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:48.777683 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e286f9-e5b9-4723-8264-ebd02bc7d3e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:48.778363 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e286f9-e5b9-4723-8264-ebd02bc7d3e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:48.778681 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e286f9-e5b9-4723-8264-ebd02bc7d3e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:48.804393 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e286f9-e5b9-4723-8264-ebd02bc7d3e6 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:48.817534 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 292/584] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:48.822627 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c286de-5a3d-4b09-a63c-2f1a36b0836c admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:48.832032 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c286de-5a3d-4b09-a63c-2f1a36b0836c admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:48.835958 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930f647-518b-4b78-ab8f-d55c27b9144b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:48.836652 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930f647-518b-4b78-ab8f-d55c27b9144b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:48.836938 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930f647-518b-4b78-ab8f-d55c27b9144b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:48.837214 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930f647-518b-4b78-ab8f-d55c27b9144b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:48.847550 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930f647-518b-4b78-ab8f-d55c27b9144b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:48.874065 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930f647-518b-4b78-ab8f-d55c27b9144b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:48.887365 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-2930f647-518b-4b78-ab8f-d55c27b9144b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:37:48.888421 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 293/585] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:37:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:48.893858 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e286f9-e5b9-4723-8264-ebd02bc7d3e6 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:48.903161 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e286f9-e5b9-4723-8264-ebd02bc7d3e6 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:48.907114 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3b4af-d004-4ae6-851f-e6212e1579df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:48.907691 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3b4af-d004-4ae6-851f-e6212e1579df admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:48.907979 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3b4af-d004-4ae6-851f-e6212e1579df admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:48.908261 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3b4af-d004-4ae6-851f-e6212e1579df admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:48.908999 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3b4af-d004-4ae6-851f-e6212e1579df admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:48.909301 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3b4af-d004-4ae6-851f-e6212e1579df admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:48.935723 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3b4af-d004-4ae6-851f-e6212e1579df admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:48.948593 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 293/586] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:37:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:48.954128 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930f647-518b-4b78-ab8f-d55c27b9144b admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:48.963146 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930f647-518b-4b78-ab8f-d55c27b9144b admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:48.967068 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f9926-5746-4886-92ec-2592945cf431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:48.967627 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f9926-5746-4886-92ec-2592945cf431 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:48.967911 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f9926-5746-4886-92ec-2592945cf431 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:48.968186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f9926-5746-4886-92ec-2592945cf431 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:48.968942 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f9926-5746-4886-92ec-2592945cf431 admin admin] RBAC: Adding query filter params (role.id=1c5a8286caa54ded9e44ef97f73f6776, scope.project.id=ed634cf9bb9146f7a9738325a8638b70, user.id=1959af22edbf47cd8afca70831d476c0) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:48.969241 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f9926-5746-4886-92ec-2592945cf431 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:48.994960 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f9926-5746-4886-92ec-2592945cf431 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:49.000829 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 294/587] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:37:48 2021] GET /identity/v3/role_assignments?user.id=1959af22edbf47cd8afca70831d476c0&scope.project.id=ed634cf9bb9146f7a9738325a8638b70&role.id=1c5a8286caa54ded9e44ef97f73f6776 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:50.927164 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877e4b3-57dd-49ef-b3b0-ec9ac4972261 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:50.927650 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877e4b3-57dd-49ef-b3b0-ec9ac4972261 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:50.927739 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877e4b3-57dd-49ef-b3b0-ec9ac4972261 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:50.929363 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 294/588] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:37:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:37:50.934798 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ea0da-e23d-4c14-97fd-5b73a0156cd6 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:50.935212 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ea0da-e23d-4c14-97fd-5b73a0156cd6 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:50.935366 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ea0da-e23d-4c14-97fd-5b73a0156cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:50.958052 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-c93ea0da-e23d-4c14-97fd-5b73a0156cd6 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:37:50.959216 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c93ea0da-e23d-4c14-97fd-5b73a0156cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:37:50.966781 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 295/589] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:37:50 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:37:50.988951 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877e4b3-57dd-49ef-b3b0-ec9ac4972261 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:51.000319 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877e4b3-57dd-49ef-b3b0-ec9ac4972261 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:51.004090 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cc64d-de33-4a59-acaf-b75b399f0527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:51.004791 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cc64d-de33-4a59-acaf-b75b399f0527 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:51.005078 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cc64d-de33-4a59-acaf-b75b399f0527 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:51.005359 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cc64d-de33-4a59-acaf-b75b399f0527 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:51.016361 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8cc64d-de33-4a59-acaf-b75b399f0527 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:37:51.022611 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-bc8cc64d-de33-4a59-acaf-b75b399f0527 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 29 20:37:51.023673 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 295/590] 10.222.0.37 () {56 vars in 1123 bytes} [Wed Dec 29 20:37:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:51.029858 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ea0da-e23d-4c14-97fd-5b73a0156cd6 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:51.038207 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ea0da-e23d-4c14-97fd-5b73a0156cd6 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:51.042937 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab1b32-3c72-4094-beae-952f8d677777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:51.043516 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab1b32-3c72-4094-beae-952f8d677777 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:51.043802 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab1b32-3c72-4094-beae-952f8d677777 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:51.044083 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab1b32-3c72-4094-beae-952f8d677777 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:51.044777 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab1b32-3c72-4094-beae-952f8d677777 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:51.045071 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab1b32-3c72-4094-beae-952f8d677777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:51.069850 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab1b32-3c72-4094-beae-952f8d677777 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:51.079075 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 296/591] 10.222.0.37 () {56 vars in 1124 bytes} [Wed Dec 29 20:37:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:51.084272 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cc64d-de33-4a59-acaf-b75b399f0527 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:51.094507 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cc64d-de33-4a59-acaf-b75b399f0527 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:51.098414 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132685d8-809d-46b3-8450-f6c0e8133f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:51.099136 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132685d8-809d-46b3-8450-f6c0e8133f65 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:51.099425 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132685d8-809d-46b3-8450-f6c0e8133f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:51.099706 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132685d8-809d-46b3-8450-f6c0e8133f65 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:51.110636 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132685d8-809d-46b3-8450-f6c0e8133f65 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:51.136641 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132685d8-809d-46b3-8450-f6c0e8133f65 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:51.154158 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-132685d8-809d-46b3-8450-f6c0e8133f65 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:51.155211 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 296/592] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:51.160332 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab1b32-3c72-4094-beae-952f8d677777 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:51.169330 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab1b32-3c72-4094-beae-952f8d677777 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:51.173248 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37393b74-54a1-4b1a-8d00-f06cf28a114b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:51.173817 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37393b74-54a1-4b1a-8d00-f06cf28a114b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:51.174104 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37393b74-54a1-4b1a-8d00-f06cf28a114b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:51.174387 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37393b74-54a1-4b1a-8d00-f06cf28a114b admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:51.175097 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37393b74-54a1-4b1a-8d00-f06cf28a114b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:51.175398 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37393b74-54a1-4b1a-8d00-f06cf28a114b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:51.201187 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37393b74-54a1-4b1a-8d00-f06cf28a114b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:51.213461 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 297/593] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:51.219340 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132685d8-809d-46b3-8450-f6c0e8133f65 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:51.228274 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132685d8-809d-46b3-8450-f6c0e8133f65 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:51.232388 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f97e6-66d7-4bb3-8fcb-a21f2385af7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:51.233093 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f97e6-66d7-4bb3-8fcb-a21f2385af7e admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:51.233378 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f97e6-66d7-4bb3-8fcb-a21f2385af7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:51.233652 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f97e6-66d7-4bb3-8fcb-a21f2385af7e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:51.245747 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f97e6-66d7-4bb3-8fcb-a21f2385af7e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:51.271862 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f97e6-66d7-4bb3-8fcb-a21f2385af7e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:51.290220 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-2c1f97e6-66d7-4bb3-8fcb-a21f2385af7e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 29 20:37:51.291310 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 297/594] 10.222.0.37 () {56 vars in 1138 bytes} [Wed Dec 29 20:37:51 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:51.297155 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37393b74-54a1-4b1a-8d00-f06cf28a114b admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:51.306435 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37393b74-54a1-4b1a-8d00-f06cf28a114b admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:51.310498 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac9401-261f-4215-b0be-b54bf094ccad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:51.311119 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac9401-261f-4215-b0be-b54bf094ccad admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:51.311411 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac9401-261f-4215-b0be-b54bf094ccad admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:51.311691 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac9401-261f-4215-b0be-b54bf094ccad admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:51.312469 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac9401-261f-4215-b0be-b54bf094ccad admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:51.312768 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac9401-261f-4215-b0be-b54bf094ccad admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:51.338660 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac9401-261f-4215-b0be-b54bf094ccad admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:51.366853 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 298/595] 10.222.0.37 () {56 vars in 1170 bytes} [Wed Dec 29 20:37:51 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:51.372229 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f97e6-66d7-4bb3-8fcb-a21f2385af7e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:51.381182 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f97e6-66d7-4bb3-8fcb-a21f2385af7e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:51.385008 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444ff04-beaf-41a6-935c-a897dd5d7601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:51.386253 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444ff04-beaf-41a6-935c-a897dd5d7601 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:51.386634 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444ff04-beaf-41a6-935c-a897dd5d7601 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:51.386989 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444ff04-beaf-41a6-935c-a897dd5d7601 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:51.398674 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444ff04-beaf-41a6-935c-a897dd5d7601 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:51.424393 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444ff04-beaf-41a6-935c-a897dd5d7601 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:51.441112 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-a444ff04-beaf-41a6-935c-a897dd5d7601 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:51.442154 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 298/596] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:51.447477 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac9401-261f-4215-b0be-b54bf094ccad admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:51.457523 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac9401-261f-4215-b0be-b54bf094ccad admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:51.461498 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24392579-6bb4-4ad0-8320-cba16befa7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:51.462075 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24392579-6bb4-4ad0-8320-cba16befa7bf admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:51.462365 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24392579-6bb4-4ad0-8320-cba16befa7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:51.462671 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24392579-6bb4-4ad0-8320-cba16befa7bf admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:51.463349 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24392579-6bb4-4ad0-8320-cba16befa7bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:51.463648 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24392579-6bb4-4ad0-8320-cba16befa7bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:51.488551 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24392579-6bb4-4ad0-8320-cba16befa7bf admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:51.500958 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 299/597] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:51.505934 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444ff04-beaf-41a6-935c-a897dd5d7601 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:51.515610 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444ff04-beaf-41a6-935c-a897dd5d7601 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:51.519542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba9b91-29c4-4eb3-88a2-917d2483d31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:51.520235 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba9b91-29c4-4eb3-88a2-917d2483d31c admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:51.520537 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba9b91-29c4-4eb3-88a2-917d2483d31c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:51.520816 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba9b91-29c4-4eb3-88a2-917d2483d31c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:51.529502 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba9b91-29c4-4eb3-88a2-917d2483d31c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:51.555079 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba9b91-29c4-4eb3-88a2-917d2483d31c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:51.568877 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-eeba9b91-29c4-4eb3-88a2-917d2483d31c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:37:51.569907 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 299/598] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:37:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:51.576119 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24392579-6bb4-4ad0-8320-cba16befa7bf admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:51.585131 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24392579-6bb4-4ad0-8320-cba16befa7bf admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:51.589049 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8383a9-1656-48f7-9a85-9a6093a899b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:51.589649 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8383a9-1656-48f7-9a85-9a6093a899b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:51.589943 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8383a9-1656-48f7-9a85-9a6093a899b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:51.590217 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8383a9-1656-48f7-9a85-9a6093a899b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:51.590979 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8383a9-1656-48f7-9a85-9a6093a899b4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:51.591279 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8383a9-1656-48f7-9a85-9a6093a899b4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:51.616441 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8383a9-1656-48f7-9a85-9a6093a899b4 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:51.629495 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 300/599] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:37:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:51.634884 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba9b91-29c4-4eb3-88a2-917d2483d31c admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:51.644377 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba9b91-29c4-4eb3-88a2-917d2483d31c admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:51.648240 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad5c49-30f5-4d33-ad2a-0170d801e65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:51.649019 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad5c49-30f5-4d33-ad2a-0170d801e65d admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:51.649301 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad5c49-30f5-4d33-ad2a-0170d801e65d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:51.649577 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad5c49-30f5-4d33-ad2a-0170d801e65d admin admin] PATH_INFO: `/v3/projects/ed634cf9bb9146f7a9738325a8638b70/users/1959af22edbf47cd8afca70831d476c0/roles/1c5a8286caa54ded9e44ef97f73f6776` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:51.668626 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad5c49-30f5-4d33-ad2a-0170d801e65d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed634cf9bb9146f7a9738325a8638b70, user_id=1959af22edbf47cd8afca70831d476c0, role_id=1c5a8286caa54ded9e44ef97f73f6776)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:51.695102 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad5c49-30f5-4d33-ad2a-0170d801e65d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:51.708834 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 300/600] 10.222.0.37 () {58 vars in 1460 bytes} [Wed Dec 29 20:37:51 2021] PUT /identity/v3/projects/ed634cf9bb9146f7a9738325a8638b70/users/1959af22edbf47cd8afca70831d476c0/roles/1c5a8286caa54ded9e44ef97f73f6776 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:37:53.631828 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c561b-2645-4cca-b8c3-edd73063337d None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:53.632344 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c561b-2645-4cca-b8c3-edd73063337d None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:53.632433 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c561b-2645-4cca-b8c3-edd73063337d None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:53.634039 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 301/601] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:37:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:37:53.639236 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb1b17-0410-4aa7-a9d1-a747404e66ec None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:53.639660 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb1b17-0410-4aa7-a9d1-a747404e66ec None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:53.639801 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb1b17-0410-4aa7-a9d1-a747404e66ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:53.661471 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-13bb1b17-0410-4aa7-a9d1-a747404e66ec None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:37:53.662593 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-13bb1b17-0410-4aa7-a9d1-a747404e66ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:37:53.726740 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 301/602] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:37:53 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:37:53.749432 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c561b-2645-4cca-b8c3-edd73063337d None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:53.760862 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c561b-2645-4cca-b8c3-edd73063337d None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:53.764596 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec816c5-afa9-421d-9d79-d297424dae0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:53.765291 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec816c5-afa9-421d-9d79-d297424dae0e admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:53.765573 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec816c5-afa9-421d-9d79-d297424dae0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:53.765849 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec816c5-afa9-421d-9d79-d297424dae0e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:53.777223 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec816c5-afa9-421d-9d79-d297424dae0e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:37:53.783413 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-5ec816c5-afa9-421d-9d79-d297424dae0e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 29 20:37:53.784469 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 302/603] 10.222.0.37 () {56 vars in 1123 bytes} [Wed Dec 29 20:37:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:53.789909 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb1b17-0410-4aa7-a9d1-a747404e66ec None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:53.799051 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb1b17-0410-4aa7-a9d1-a747404e66ec None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:53.803009 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5ba2e-c194-4d33-8e7c-4dc27509aa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:53.803591 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5ba2e-c194-4d33-8e7c-4dc27509aa12 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:53.803876 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5ba2e-c194-4d33-8e7c-4dc27509aa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:53.804155 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5ba2e-c194-4d33-8e7c-4dc27509aa12 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:53.804866 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5ba2e-c194-4d33-8e7c-4dc27509aa12 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:53.805164 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5ba2e-c194-4d33-8e7c-4dc27509aa12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:53.830602 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5ba2e-c194-4d33-8e7c-4dc27509aa12 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:53.839440 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 302/604] 10.222.0.37 () {56 vars in 1124 bytes} [Wed Dec 29 20:37:53 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:53.844744 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec816c5-afa9-421d-9d79-d297424dae0e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:53.854355 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec816c5-afa9-421d-9d79-d297424dae0e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:53.858786 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36021b02-3147-4470-a829-f8036693c256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:53.859477 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36021b02-3147-4470-a829-f8036693c256 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:53.859760 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36021b02-3147-4470-a829-f8036693c256 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:53.860036 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36021b02-3147-4470-a829-f8036693c256 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:53.871114 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36021b02-3147-4470-a829-f8036693c256 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:53.896284 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36021b02-3147-4470-a829-f8036693c256 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:53.913401 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-36021b02-3147-4470-a829-f8036693c256 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:53.914546 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 303/605] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:37:53.920665 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5ba2e-c194-4d33-8e7c-4dc27509aa12 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:53.929676 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5ba2e-c194-4d33-8e7c-4dc27509aa12 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:53.933944 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255d4b5-a032-496f-b62f-3b66a5f3a980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:53.934514 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255d4b5-a032-496f-b62f-3b66a5f3a980 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:53.934838 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255d4b5-a032-496f-b62f-3b66a5f3a980 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:53.935118 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255d4b5-a032-496f-b62f-3b66a5f3a980 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:53.935795 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255d4b5-a032-496f-b62f-3b66a5f3a980 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:53.936088 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255d4b5-a032-496f-b62f-3b66a5f3a980 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:53.961604 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255d4b5-a032-496f-b62f-3b66a5f3a980 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:53.974349 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 303/606] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:53.980173 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36021b02-3147-4470-a829-f8036693c256 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:53.989264 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36021b02-3147-4470-a829-f8036693c256 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:53.993200 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc9b1d-e946-4404-87e4-f81696e53ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:53.993909 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc9b1d-e946-4404-87e4-f81696e53ffc admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:53.994196 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc9b1d-e946-4404-87e4-f81696e53ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:53.994473 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc9b1d-e946-4404-87e4-f81696e53ffc admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:54.006626 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc9b1d-e946-4404-87e4-f81696e53ffc admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:54.032513 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc9b1d-e946-4404-87e4-f81696e53ffc admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:54.050502 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-e9bc9b1d-e946-4404-87e4-f81696e53ffc admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 29 20:37:54.051548 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 304/607] 10.222.0.37 () {56 vars in 1138 bytes} [Wed Dec 29 20:37:53 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:54.056726 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255d4b5-a032-496f-b62f-3b66a5f3a980 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:54.065680 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255d4b5-a032-496f-b62f-3b66a5f3a980 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:54.069554 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22cb9c-119a-45f1-81f8-e346de25c3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:54.070132 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22cb9c-119a-45f1-81f8-e346de25c3c6 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:54.070420 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22cb9c-119a-45f1-81f8-e346de25c3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:54.070722 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22cb9c-119a-45f1-81f8-e346de25c3c6 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:54.071504 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22cb9c-119a-45f1-81f8-e346de25c3c6 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:54.071800 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22cb9c-119a-45f1-81f8-e346de25c3c6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:54.098238 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22cb9c-119a-45f1-81f8-e346de25c3c6 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:54.125475 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 304/608] 10.222.0.37 () {56 vars in 1170 bytes} [Wed Dec 29 20:37:54 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:54.130621 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc9b1d-e946-4404-87e4-f81696e53ffc admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:54.140279 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc9b1d-e946-4404-87e4-f81696e53ffc admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:54.144231 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fe6c3-28ba-4f79-9a08-e2d9baf341e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:54.144782 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fe6c3-28ba-4f79-9a08-e2d9baf341e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:54.145067 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fe6c3-28ba-4f79-9a08-e2d9baf341e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:54.145348 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fe6c3-28ba-4f79-9a08-e2d9baf341e3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:54.153437 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fe6c3-28ba-4f79-9a08-e2d9baf341e3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:54.178507 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fe6c3-28ba-4f79-9a08-e2d9baf341e3 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:54.187024 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 305/609] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:37:54 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:37:54.192054 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22cb9c-119a-45f1-81f8-e346de25c3c6 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:54.201613 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22cb9c-119a-45f1-81f8-e346de25c3c6 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:54.205490 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57944612-2ac7-4e04-ab48-0511e9d1a003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:54.206185 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57944612-2ac7-4e04-ab48-0511e9d1a003 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:54.206469 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57944612-2ac7-4e04-ab48-0511e9d1a003 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:54.206784 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57944612-2ac7-4e04-ab48-0511e9d1a003 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:54.218334 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57944612-2ac7-4e04-ab48-0511e9d1a003 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:54.243667 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57944612-2ac7-4e04-ab48-0511e9d1a003 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:54.259700 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-57944612-2ac7-4e04-ab48-0511e9d1a003 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:54.261222 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 305/610] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:54.266256 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fe6c3-28ba-4f79-9a08-e2d9baf341e3 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:54.274588 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fe6c3-28ba-4f79-9a08-e2d9baf341e3 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:54.279340 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea809b-c664-4b31-8b35-05d4c3ad3fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:54.279906 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea809b-c664-4b31-8b35-05d4c3ad3fff admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:54.280194 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea809b-c664-4b31-8b35-05d4c3ad3fff admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:54.280475 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea809b-c664-4b31-8b35-05d4c3ad3fff admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:54.281149 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea809b-c664-4b31-8b35-05d4c3ad3fff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:54.281444 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea809b-c664-4b31-8b35-05d4c3ad3fff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:54.306321 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea809b-c664-4b31-8b35-05d4c3ad3fff admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:54.318798 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 306/611] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:54.324393 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57944612-2ac7-4e04-ab48-0511e9d1a003 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:54.333214 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57944612-2ac7-4e04-ab48-0511e9d1a003 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:54.336996 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d973449-43ee-4800-94e0-c1477dc95321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:54.337682 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d973449-43ee-4800-94e0-c1477dc95321 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:54.337966 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d973449-43ee-4800-94e0-c1477dc95321 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:54.338240 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d973449-43ee-4800-94e0-c1477dc95321 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:54.347269 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d973449-43ee-4800-94e0-c1477dc95321 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:54.372542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d973449-43ee-4800-94e0-c1477dc95321 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:54.386000 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-9d973449-43ee-4800-94e0-c1477dc95321 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:37:54.387050 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 306/612] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:37:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:54.392271 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea809b-c664-4b31-8b35-05d4c3ad3fff admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:54.402037 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea809b-c664-4b31-8b35-05d4c3ad3fff admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:54.406050 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49850fe2-71b4-46b9-8b31-006070c0d9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:54.406569 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49850fe2-71b4-46b9-8b31-006070c0d9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:54.406889 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49850fe2-71b4-46b9-8b31-006070c0d9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:54.407170 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49850fe2-71b4-46b9-8b31-006070c0d9f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:54.407897 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49850fe2-71b4-46b9-8b31-006070c0d9f1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:54.408198 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49850fe2-71b4-46b9-8b31-006070c0d9f1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:54.433918 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49850fe2-71b4-46b9-8b31-006070c0d9f1 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:54.446476 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 307/613] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:37:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:37:54.452718 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d973449-43ee-4800-94e0-c1477dc95321 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:54.461600 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d973449-43ee-4800-94e0-c1477dc95321 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:54.465512 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cce29-b035-4d26-b2ce-deb23277774c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:54.466075 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cce29-b035-4d26-b2ce-deb23277774c admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:54.466358 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cce29-b035-4d26-b2ce-deb23277774c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:54.466635 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cce29-b035-4d26-b2ce-deb23277774c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:54.467430 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716cce29-b035-4d26-b2ce-deb23277774c admin admin] RBAC: Adding query filter params (role.id=1c5a8286caa54ded9e44ef97f73f6776, scope.project.id=ed634cf9bb9146f7a9738325a8638b70, user.id=1959af22edbf47cd8afca70831d476c0) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:54.467732 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716cce29-b035-4d26-b2ce-deb23277774c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:54.493174 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716cce29-b035-4d26-b2ce-deb23277774c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:54.499307 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 307/614] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:37:54 2021] GET /identity/v3/role_assignments?user.id=1959af22edbf47cd8afca70831d476c0&scope.project.id=ed634cf9bb9146f7a9738325a8638b70&role.id=1c5a8286caa54ded9e44ef97f73f6776 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:56.485250 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84de26-7106-4da3-9f5c-4aa46e2971b3 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:56.485872 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84de26-7106-4da3-9f5c-4aa46e2971b3 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:56.485872 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84de26-7106-4da3-9f5c-4aa46e2971b3 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:56.487519 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 308/615] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:37:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:37:56.492562 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0059b4-1f57-4e17-ba35-4fdcb90b41cd None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:56.492994 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0059b4-1f57-4e17-ba35-4fdcb90b41cd None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:56.493124 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0059b4-1f57-4e17-ba35-4fdcb90b41cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:56.515717 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-5f0059b4-1f57-4e17-ba35-4fdcb90b41cd None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:37:56.516854 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-5f0059b4-1f57-4e17-ba35-4fdcb90b41cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:37:56.523431 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 308/616] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:37:56 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:37:56.545874 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84de26-7106-4da3-9f5c-4aa46e2971b3 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:56.557856 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84de26-7106-4da3-9f5c-4aa46e2971b3 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:56.561888 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde994a1-5804-4869-a232-45c08385b381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:56.562599 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde994a1-5804-4869-a232-45c08385b381 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:56.562915 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde994a1-5804-4869-a232-45c08385b381 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:56.563198 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde994a1-5804-4869-a232-45c08385b381 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:56.574740 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde994a1-5804-4869-a232-45c08385b381 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:37:56.581426 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-bde994a1-5804-4869-a232-45c08385b381 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 29 20:37:56.582485 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 309/617] 10.222.0.37 () {56 vars in 1141 bytes} [Wed Dec 29 20:37:56 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:56.587856 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0059b4-1f57-4e17-ba35-4fdcb90b41cd None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:56.596171 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0059b4-1f57-4e17-ba35-4fdcb90b41cd None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:56.600229 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7d250-9e5e-4c59-95fb-7e163a39b445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:56.600803 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7d250-9e5e-4c59-95fb-7e163a39b445 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:56.601090 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7d250-9e5e-4c59-95fb-7e163a39b445 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:56.601367 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7d250-9e5e-4c59-95fb-7e163a39b445 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:56.602066 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7d250-9e5e-4c59-95fb-7e163a39b445 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:56.602361 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7d250-9e5e-4c59-95fb-7e163a39b445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:56.628904 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7d250-9e5e-4c59-95fb-7e163a39b445 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:56.637119 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 309/618] 10.222.0.37 () {56 vars in 1136 bytes} [Wed Dec 29 20:37:56 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:56.642415 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde994a1-5804-4869-a232-45c08385b381 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:56.652136 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde994a1-5804-4869-a232-45c08385b381 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:56.656011 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452f496-8cba-46af-939f-16bc8fd2cc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:56.656695 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452f496-8cba-46af-939f-16bc8fd2cc51 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:56.656978 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452f496-8cba-46af-939f-16bc8fd2cc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:56.657254 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452f496-8cba-46af-939f-16bc8fd2cc51 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:56.668655 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452f496-8cba-46af-939f-16bc8fd2cc51 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:56.694256 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452f496-8cba-46af-939f-16bc8fd2cc51 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:56.712443 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-0452f496-8cba-46af-939f-16bc8fd2cc51 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:56.713984 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 310/619] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:56.719375 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7d250-9e5e-4c59-95fb-7e163a39b445 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:56.728379 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7d250-9e5e-4c59-95fb-7e163a39b445 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:56.732935 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adfab8-ed8a-425a-abed-f46fdbe1285e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:56.733504 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adfab8-ed8a-425a-abed-f46fdbe1285e admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:56.733788 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adfab8-ed8a-425a-abed-f46fdbe1285e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:56.734064 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adfab8-ed8a-425a-abed-f46fdbe1285e admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:56.734770 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9adfab8-ed8a-425a-abed-f46fdbe1285e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:56.735066 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9adfab8-ed8a-425a-abed-f46fdbe1285e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:56.760090 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9adfab8-ed8a-425a-abed-f46fdbe1285e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:56.772260 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 310/620] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:56.777958 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452f496-8cba-46af-939f-16bc8fd2cc51 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:56.786937 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452f496-8cba-46af-939f-16bc8fd2cc51 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:56.790845 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ce2dc-f071-47c0-b733-6a854ecbdcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:56.791548 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ce2dc-f071-47c0-b733-6a854ecbdcbe admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:56.792392 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ce2dc-f071-47c0-b733-6a854ecbdcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:56.792672 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ce2dc-f071-47c0-b733-6a854ecbdcbe admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:56.804998 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ce2dc-f071-47c0-b733-6a854ecbdcbe admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:56.830724 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ce2dc-f071-47c0-b733-6a854ecbdcbe admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:56.849186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-be5ce2dc-f071-47c0-b733-6a854ecbdcbe admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 29 20:37:56.850250 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 311/621] 10.222.0.37 () {56 vars in 1138 bytes} [Wed Dec 29 20:37:56 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:56.856476 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adfab8-ed8a-425a-abed-f46fdbe1285e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:56.865660 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adfab8-ed8a-425a-abed-f46fdbe1285e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:56.869598 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ab716-a6f4-43c4-b137-d55ac192335c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:56.870209 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ab716-a6f4-43c4-b137-d55ac192335c admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:56.870492 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ab716-a6f4-43c4-b137-d55ac192335c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:56.870806 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ab716-a6f4-43c4-b137-d55ac192335c admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:56.871592 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ab716-a6f4-43c4-b137-d55ac192335c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:56.871896 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ab716-a6f4-43c4-b137-d55ac192335c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:56.897273 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ab716-a6f4-43c4-b137-d55ac192335c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:56.926059 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 311/622] 10.222.0.37 () {56 vars in 1170 bytes} [Wed Dec 29 20:37:56 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:56.931438 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ce2dc-f071-47c0-b733-6a854ecbdcbe admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:56.940501 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ce2dc-f071-47c0-b733-6a854ecbdcbe admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:56.944372 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b3438-6532-4799-81f1-4e19fb0e4588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:56.944926 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b3438-6532-4799-81f1-4e19fb0e4588 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:56.945210 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b3438-6532-4799-81f1-4e19fb0e4588 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:56.945487 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b3438-6532-4799-81f1-4e19fb0e4588 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:56.953365 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b3438-6532-4799-81f1-4e19fb0e4588 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:56.979008 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b3438-6532-4799-81f1-4e19fb0e4588 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:56.987648 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 312/623] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:37:56 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:37:56.992829 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ab716-a6f4-43c4-b137-d55ac192335c admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:57.001868 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ab716-a6f4-43c4-b137-d55ac192335c admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:57.005839 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07a53b-b992-4c09-a7d7-ef613ab96fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:57.006542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07a53b-b992-4c09-a7d7-ef613ab96fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:57.006865 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07a53b-b992-4c09-a7d7-ef613ab96fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:57.007148 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07a53b-b992-4c09-a7d7-ef613ab96fa1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:57.018687 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07a53b-b992-4c09-a7d7-ef613ab96fa1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:57.045458 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07a53b-b992-4c09-a7d7-ef613ab96fa1 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:57.062051 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-8b07a53b-b992-4c09-a7d7-ef613ab96fa1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:57.063138 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 312/624] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:57.068416 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b3438-6532-4799-81f1-4e19fb0e4588 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:57.077241 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b3438-6532-4799-81f1-4e19fb0e4588 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:57.081133 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e868f0-15e9-44a7-8af4-10dd7a29320e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:57.081696 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e868f0-15e9-44a7-8af4-10dd7a29320e admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:57.081982 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e868f0-15e9-44a7-8af4-10dd7a29320e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:57.082256 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e868f0-15e9-44a7-8af4-10dd7a29320e admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:57.082956 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e868f0-15e9-44a7-8af4-10dd7a29320e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:57.083249 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e868f0-15e9-44a7-8af4-10dd7a29320e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:57.108643 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e868f0-15e9-44a7-8af4-10dd7a29320e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:57.121096 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 313/625] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:57.126208 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07a53b-b992-4c09-a7d7-ef613ab96fa1 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:57.135918 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07a53b-b992-4c09-a7d7-ef613ab96fa1 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:57.139726 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1a642-26a7-4178-86d3-a9abdf2e0a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:57.140418 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1a642-26a7-4178-86d3-a9abdf2e0a69 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:57.140703 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1a642-26a7-4178-86d3-a9abdf2e0a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:57.140980 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1a642-26a7-4178-86d3-a9abdf2e0a69 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:57.151682 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1a642-26a7-4178-86d3-a9abdf2e0a69 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:57.176956 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1a642-26a7-4178-86d3-a9abdf2e0a69 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:57.190337 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-e9e1a642-26a7-4178-86d3-a9abdf2e0a69 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:37:57.191398 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 313/626] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:37:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:37:57.196619 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e868f0-15e9-44a7-8af4-10dd7a29320e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:57.206187 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e868f0-15e9-44a7-8af4-10dd7a29320e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:57.210077 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca32975-1c30-4a71-91ac-0aa1dcd4db17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:57.210644 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca32975-1c30-4a71-91ac-0aa1dcd4db17 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:57.210960 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca32975-1c30-4a71-91ac-0aa1dcd4db17 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:57.211238 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca32975-1c30-4a71-91ac-0aa1dcd4db17 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:57.211962 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca32975-1c30-4a71-91ac-0aa1dcd4db17 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:57.212262 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca32975-1c30-4a71-91ac-0aa1dcd4db17 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:57.238277 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca32975-1c30-4a71-91ac-0aa1dcd4db17 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:57.250881 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 314/627] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:37:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:57.256253 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1a642-26a7-4178-86d3-a9abdf2e0a69 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:57.265824 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1a642-26a7-4178-86d3-a9abdf2e0a69 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:57.269743 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2fe0f-e63b-4f07-9985-27d1e2ff8d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:57.270251 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2fe0f-e63b-4f07-9985-27d1e2ff8d15 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:57.270539 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2fe0f-e63b-4f07-9985-27d1e2ff8d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:57.270850 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2fe0f-e63b-4f07-9985-27d1e2ff8d15 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:57.271626 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2fe0f-e63b-4f07-9985-27d1e2ff8d15 admin admin] RBAC: Adding query filter params (role.id=7be0a1814ee244dcb629551693d66f17, scope.project.id=ed634cf9bb9146f7a9738325a8638b70, user.id=1959af22edbf47cd8afca70831d476c0) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:57.271926 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2fe0f-e63b-4f07-9985-27d1e2ff8d15 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:57.297809 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2fe0f-e63b-4f07-9985-27d1e2ff8d15 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:57.302947 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 314/628] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:37:57 2021] GET /identity/v3/role_assignments?user.id=1959af22edbf47cd8afca70831d476c0&scope.project.id=ed634cf9bb9146f7a9738325a8638b70&role.id=7be0a1814ee244dcb629551693d66f17 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:59.211967 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7dea0-1802-454f-bcc6-04e74ac76074 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:59.212480 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7dea0-1802-454f-bcc6-04e74ac76074 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:59.212480 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7dea0-1802-454f-bcc6-04e74ac76074 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:59.214143 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 315/629] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:37:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:37:59.219166 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba955c1-1f0a-4f6a-9e48-37850141c0ad None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:59.219576 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba955c1-1f0a-4f6a-9e48-37850141c0ad None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:59.219730 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba955c1-1f0a-4f6a-9e48-37850141c0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:59.241944 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-4ba955c1-1f0a-4f6a-9e48-37850141c0ad None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:37:59.243105 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-4ba955c1-1f0a-4f6a-9e48-37850141c0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:37:59.250205 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 315/630] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:37:59 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:37:59.272091 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7dea0-1802-454f-bcc6-04e74ac76074 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:59.283349 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7dea0-1802-454f-bcc6-04e74ac76074 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:59.287110 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe2384-7dee-4fa1-bf29-a58ab3a94aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:59.287815 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe2384-7dee-4fa1-bf29-a58ab3a94aab admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:59.288114 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe2384-7dee-4fa1-bf29-a58ab3a94aab admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:59.288368 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe2384-7dee-4fa1-bf29-a58ab3a94aab admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:59.299599 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe2384-7dee-4fa1-bf29-a58ab3a94aab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:37:59.306113 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-effe2384-7dee-4fa1-bf29-a58ab3a94aab admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 29 20:37:59.307754 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 316/631] 10.222.0.37 () {56 vars in 1141 bytes} [Wed Dec 29 20:37:59 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:59.313079 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba955c1-1f0a-4f6a-9e48-37850141c0ad None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:59.321292 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba955c1-1f0a-4f6a-9e48-37850141c0ad None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:59.325633 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c386d-e177-4af0-9a62-58dec777c2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:59.326206 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c386d-e177-4af0-9a62-58dec777c2ff admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:59.326489 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c386d-e177-4af0-9a62-58dec777c2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:59.326874 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c386d-e177-4af0-9a62-58dec777c2ff admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:59.327573 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c386d-e177-4af0-9a62-58dec777c2ff admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:59.327864 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c386d-e177-4af0-9a62-58dec777c2ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:59.359261 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c386d-e177-4af0-9a62-58dec777c2ff admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:59.372170 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 316/632] 10.222.0.37 () {56 vars in 1136 bytes} [Wed Dec 29 20:37:59 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:37:59.377671 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe2384-7dee-4fa1-bf29-a58ab3a94aab admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:59.387232 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe2384-7dee-4fa1-bf29-a58ab3a94aab admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:59.391119 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f88b8a-b802-4eff-a8be-0c729307f9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:59.391811 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f88b8a-b802-4eff-a8be-0c729307f9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:59.392095 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f88b8a-b802-4eff-a8be-0c729307f9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:59.392374 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f88b8a-b802-4eff-a8be-0c729307f9e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:59.403169 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f88b8a-b802-4eff-a8be-0c729307f9e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:59.428964 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f88b8a-b802-4eff-a8be-0c729307f9e6 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:59.446434 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-34f88b8a-b802-4eff-a8be-0c729307f9e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:59.447485 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 317/633] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:59.452966 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c386d-e177-4af0-9a62-58dec777c2ff admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:59.461885 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c386d-e177-4af0-9a62-58dec777c2ff admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:59.465981 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fe8a9-9740-4274-b75f-371a819715f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:59.466494 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fe8a9-9740-4274-b75f-371a819715f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:59.466819 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fe8a9-9740-4274-b75f-371a819715f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:59.467096 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fe8a9-9740-4274-b75f-371a819715f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:59.467769 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fe8a9-9740-4274-b75f-371a819715f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:59.468060 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fe8a9-9740-4274-b75f-371a819715f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:59.493513 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fe8a9-9740-4274-b75f-371a819715f0 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:59.506466 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 317/634] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:59.511682 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f88b8a-b802-4eff-a8be-0c729307f9e6 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:59.520695 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f88b8a-b802-4eff-a8be-0c729307f9e6 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:59.524606 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559df5f-528b-4da7-a981-6a85eac6e284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:59.525319 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559df5f-528b-4da7-a981-6a85eac6e284 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:59.525606 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559df5f-528b-4da7-a981-6a85eac6e284 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:59.525957 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559df5f-528b-4da7-a981-6a85eac6e284 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:59.538331 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559df5f-528b-4da7-a981-6a85eac6e284 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:59.565263 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559df5f-528b-4da7-a981-6a85eac6e284 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:59.583012 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-b559df5f-528b-4da7-a981-6a85eac6e284 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 29 20:37:59.584034 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 318/635] 10.222.0.37 () {56 vars in 1138 bytes} [Wed Dec 29 20:37:59 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:37:59.589323 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fe8a9-9740-4274-b75f-371a819715f0 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:59.598201 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fe8a9-9740-4274-b75f-371a819715f0 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:59.602040 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5c604-43c7-4aa6-906a-7c08a4c06482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:59.602612 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5c604-43c7-4aa6-906a-7c08a4c06482 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:59.602924 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5c604-43c7-4aa6-906a-7c08a4c06482 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:59.603200 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5c604-43c7-4aa6-906a-7c08a4c06482 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:59.604563 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5c604-43c7-4aa6-906a-7c08a4c06482 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:59.604946 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5c604-43c7-4aa6-906a-7c08a4c06482 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:59.630969 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5c604-43c7-4aa6-906a-7c08a4c06482 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:59.658422 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 318/636] 10.222.0.37 () {56 vars in 1170 bytes} [Wed Dec 29 20:37:59 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:59.663586 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559df5f-528b-4da7-a981-6a85eac6e284 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:59.673236 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559df5f-528b-4da7-a981-6a85eac6e284 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:59.677155 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f685b06-d244-4ace-a6f9-115729e0caea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:59.677850 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f685b06-d244-4ace-a6f9-115729e0caea admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:59.678137 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f685b06-d244-4ace-a6f9-115729e0caea admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:59.678418 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f685b06-d244-4ace-a6f9-115729e0caea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:59.690885 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f685b06-d244-4ace-a6f9-115729e0caea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:59.716911 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f685b06-d244-4ace-a6f9-115729e0caea admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:59.736883 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-9f685b06-d244-4ace-a6f9-115729e0caea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:37:59.737937 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 319/637] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:37:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:59.743307 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5c604-43c7-4aa6-906a-7c08a4c06482 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:59.752365 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5c604-43c7-4aa6-906a-7c08a4c06482 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:59.756202 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7708f-048f-4a92-a606-0fd063385843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:59.756776 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7708f-048f-4a92-a606-0fd063385843 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:59.757063 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7708f-048f-4a92-a606-0fd063385843 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:59.757340 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7708f-048f-4a92-a606-0fd063385843 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:59.758014 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7708f-048f-4a92-a606-0fd063385843 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:59.758307 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7708f-048f-4a92-a606-0fd063385843 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:59.784389 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7708f-048f-4a92-a606-0fd063385843 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:59.796342 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 319/638] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:37:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:37:59.801508 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f685b06-d244-4ace-a6f9-115729e0caea admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:59.810766 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f685b06-d244-4ace-a6f9-115729e0caea admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:59.814633 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefdf92-3423-472a-97bc-fd0dfebd1758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:59.815352 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefdf92-3423-472a-97bc-fd0dfebd1758 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:59.815636 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefdf92-3423-472a-97bc-fd0dfebd1758 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:59.815911 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefdf92-3423-472a-97bc-fd0dfebd1758 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:59.824951 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefdf92-3423-472a-97bc-fd0dfebd1758 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:59.851140 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefdf92-3423-472a-97bc-fd0dfebd1758 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:59.864829 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-baefdf92-3423-472a-97bc-fd0dfebd1758 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:37:59.865878 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 320/639] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:37:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:37:59.871321 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7708f-048f-4a92-a606-0fd063385843 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:59.880373 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7708f-048f-4a92-a606-0fd063385843 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:59.884220 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09733d-5c16-4838-afc5-4f6c211e317d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:59.884790 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09733d-5c16-4838-afc5-4f6c211e317d admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:59.885101 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09733d-5c16-4838-afc5-4f6c211e317d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:59.885389 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09733d-5c16-4838-afc5-4f6c211e317d admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:59.886200 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09733d-5c16-4838-afc5-4f6c211e317d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:37:59.886499 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09733d-5c16-4838-afc5-4f6c211e317d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:59.912355 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09733d-5c16-4838-afc5-4f6c211e317d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:59.925463 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 320/640] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:37:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:37:59.930760 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefdf92-3423-472a-97bc-fd0dfebd1758 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:37:59.939784 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefdf92-3423-472a-97bc-fd0dfebd1758 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:37:59.943680 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c5739-9c0e-4416-abb2-a67daecf5d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:37:59.944468 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c5739-9c0e-4416-abb2-a67daecf5d96 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:37:59.944755 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c5739-9c0e-4416-abb2-a67daecf5d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:37:59.945035 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c5739-9c0e-4416-abb2-a67daecf5d96 admin admin] PATH_INFO: `/v3/projects/ed634cf9bb9146f7a9738325a8638b70/users/1959af22edbf47cd8afca70831d476c0/roles/7be0a1814ee244dcb629551693d66f17` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:37:59.947028 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c5739-9c0e-4416-abb2-a67daecf5d96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed634cf9bb9146f7a9738325a8638b70, user_id=1959af22edbf47cd8afca70831d476c0, role_id=7be0a1814ee244dcb629551693d66f17)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:37:59.973664 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c5739-9c0e-4416-abb2-a67daecf5d96 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:37:59.985813 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 321/641] 10.222.0.37 () {58 vars in 1460 bytes} [Wed Dec 29 20:37:59 2021] PUT /identity/v3/projects/ed634cf9bb9146f7a9738325a8638b70/users/1959af22edbf47cd8afca70831d476c0/roles/7be0a1814ee244dcb629551693d66f17 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:38:01.905878 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46de68a-9a49-4f57-8f00-782aa72ef5a5 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:01.906337 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46de68a-9a49-4f57-8f00-782aa72ef5a5 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:01.906445 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46de68a-9a49-4f57-8f00-782aa72ef5a5 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:01.908156 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 321/642] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:38:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:38:01.913079 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3296-7b12-4080-b85c-80a366fbfef6 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:01.913442 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3296-7b12-4080-b85c-80a366fbfef6 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:01.913651 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3296-7b12-4080-b85c-80a366fbfef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:01.936652 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-f1bc3296-7b12-4080-b85c-80a366fbfef6 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:38:01.937768 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-f1bc3296-7b12-4080-b85c-80a366fbfef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:38:01.999805 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 322/643] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:38:01 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:38:02.021733 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46de68a-9a49-4f57-8f00-782aa72ef5a5 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:02.033614 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46de68a-9a49-4f57-8f00-782aa72ef5a5 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:02.037415 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112095a-b71b-45a4-8a0c-a739e041ea6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:02.038168 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112095a-b71b-45a4-8a0c-a739e041ea6d admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:02.038454 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112095a-b71b-45a4-8a0c-a739e041ea6d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:02.038761 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112095a-b71b-45a4-8a0c-a739e041ea6d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:02.050118 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112095a-b71b-45a4-8a0c-a739e041ea6d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:38:02.056753 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-e112095a-b71b-45a4-8a0c-a739e041ea6d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 29 20:38:02.057950 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 322/644] 10.222.0.37 () {56 vars in 1141 bytes} [Wed Dec 29 20:38:02 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:02.063442 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc3296-7b12-4080-b85c-80a366fbfef6 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:02.071750 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc3296-7b12-4080-b85c-80a366fbfef6 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:02.076049 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df14d5-5b87-471d-b119-1c385a525f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:02.076624 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df14d5-5b87-471d-b119-1c385a525f81 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:02.076910 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df14d5-5b87-471d-b119-1c385a525f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:02.077188 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df14d5-5b87-471d-b119-1c385a525f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:02.077888 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df14d5-5b87-471d-b119-1c385a525f81 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:02.078184 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df14d5-5b87-471d-b119-1c385a525f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:02.103597 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df14d5-5b87-471d-b119-1c385a525f81 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:02.112193 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 323/645] 10.222.0.37 () {56 vars in 1136 bytes} [Wed Dec 29 20:38:02 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:02.117289 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112095a-b71b-45a4-8a0c-a739e041ea6d admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:02.126732 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112095a-b71b-45a4-8a0c-a739e041ea6d admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:02.130629 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe41f3a-330a-4fc7-9cbf-1583aae6c51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:02.131337 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe41f3a-330a-4fc7-9cbf-1583aae6c51e admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:02.131628 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe41f3a-330a-4fc7-9cbf-1583aae6c51e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:02.131906 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe41f3a-330a-4fc7-9cbf-1583aae6c51e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:02.142781 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe41f3a-330a-4fc7-9cbf-1583aae6c51e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:02.168880 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe41f3a-330a-4fc7-9cbf-1583aae6c51e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:02.186383 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-9fe41f3a-330a-4fc7-9cbf-1583aae6c51e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:38:02.187429 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 323/646] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:38:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:02.192515 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df14d5-5b87-471d-b119-1c385a525f81 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:02.202215 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df14d5-5b87-471d-b119-1c385a525f81 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:02.206131 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc3e36-67b1-444d-950b-6be93f840721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:02.206728 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc3e36-67b1-444d-950b-6be93f840721 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:02.207020 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc3e36-67b1-444d-950b-6be93f840721 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:02.207301 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc3e36-67b1-444d-950b-6be93f840721 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:02.207970 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc3e36-67b1-444d-950b-6be93f840721 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:02.208268 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc3e36-67b1-444d-950b-6be93f840721 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:02.233587 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc3e36-67b1-444d-950b-6be93f840721 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:02.247761 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 324/647] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:38:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:02.252821 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe41f3a-330a-4fc7-9cbf-1583aae6c51e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:02.262409 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe41f3a-330a-4fc7-9cbf-1583aae6c51e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:02.266364 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac177bdc-9755-473b-8ee3-9a339b85157a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:02.267105 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac177bdc-9755-473b-8ee3-9a339b85157a admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:02.267394 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac177bdc-9755-473b-8ee3-9a339b85157a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:02.267675 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac177bdc-9755-473b-8ee3-9a339b85157a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:02.279921 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac177bdc-9755-473b-8ee3-9a339b85157a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:02.305709 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac177bdc-9755-473b-8ee3-9a339b85157a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:02.323998 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-ac177bdc-9755-473b-8ee3-9a339b85157a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 29 20:38:02.325028 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 324/648] 10.222.0.37 () {56 vars in 1138 bytes} [Wed Dec 29 20:38:02 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:02.330366 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc3e36-67b1-444d-950b-6be93f840721 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:02.339609 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc3e36-67b1-444d-950b-6be93f840721 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:02.343523 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0de9e9-0bbc-4f95-9778-a8923e4c143c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:02.344101 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0de9e9-0bbc-4f95-9778-a8923e4c143c admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:02.344388 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0de9e9-0bbc-4f95-9778-a8923e4c143c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:02.344666 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0de9e9-0bbc-4f95-9778-a8923e4c143c admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:02.345436 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0de9e9-0bbc-4f95-9778-a8923e4c143c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:02.345734 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0de9e9-0bbc-4f95-9778-a8923e4c143c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:02.372011 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0de9e9-0bbc-4f95-9778-a8923e4c143c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:02.399670 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 325/649] 10.222.0.37 () {56 vars in 1170 bytes} [Wed Dec 29 20:38:02 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:02.405300 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac177bdc-9755-473b-8ee3-9a339b85157a admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:02.414351 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac177bdc-9755-473b-8ee3-9a339b85157a admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:02.418903 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7e1fc-74f1-4faf-bf28-a933abbe38c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:02.419461 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7e1fc-74f1-4faf-bf28-a933abbe38c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:02.419748 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7e1fc-74f1-4faf-bf28-a933abbe38c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:02.420029 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7e1fc-74f1-4faf-bf28-a933abbe38c0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:02.427394 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7e1fc-74f1-4faf-bf28-a933abbe38c0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:02.453247 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7e1fc-74f1-4faf-bf28-a933abbe38c0 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:02.461402 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 325/650] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:38:02 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:38:02.467032 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0de9e9-0bbc-4f95-9778-a8923e4c143c admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:02.476022 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0de9e9-0bbc-4f95-9778-a8923e4c143c admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:02.480973 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c43652-b871-4dfa-8eb0-ca494d9e1584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:02.481682 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c43652-b871-4dfa-8eb0-ca494d9e1584 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:02.481972 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c43652-b871-4dfa-8eb0-ca494d9e1584 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:02.482257 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c43652-b871-4dfa-8eb0-ca494d9e1584 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:02.493461 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c43652-b871-4dfa-8eb0-ca494d9e1584 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:02.520408 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c43652-b871-4dfa-8eb0-ca494d9e1584 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:02.537168 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-c0c43652-b871-4dfa-8eb0-ca494d9e1584 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:38:02.538199 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 326/651] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:38:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:02.543821 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7e1fc-74f1-4faf-bf28-a933abbe38c0 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:02.552019 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7e1fc-74f1-4faf-bf28-a933abbe38c0 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:02.555937 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e88d86-694f-4cd4-b072-7c3eb5ce87c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:02.556500 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e88d86-694f-4cd4-b072-7c3eb5ce87c6 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:02.556787 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e88d86-694f-4cd4-b072-7c3eb5ce87c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:02.557633 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e88d86-694f-4cd4-b072-7c3eb5ce87c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:02.558306 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e88d86-694f-4cd4-b072-7c3eb5ce87c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:02.558597 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e88d86-694f-4cd4-b072-7c3eb5ce87c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:02.583852 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e88d86-694f-4cd4-b072-7c3eb5ce87c6 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:02.596237 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 326/652] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:38:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:02.601294 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c43652-b871-4dfa-8eb0-ca494d9e1584 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:02.610891 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c43652-b871-4dfa-8eb0-ca494d9e1584 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:02.614773 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2068e-ff88-46f6-b81b-fb3146b97ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:02.615466 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2068e-ff88-46f6-b81b-fb3146b97ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:02.615752 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2068e-ff88-46f6-b81b-fb3146b97ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:02.616029 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2068e-ff88-46f6-b81b-fb3146b97ee9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:02.625262 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2068e-ff88-46f6-b81b-fb3146b97ee9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:02.650505 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2068e-ff88-46f6-b81b-fb3146b97ee9 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:02.663659 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-09b2068e-ff88-46f6-b81b-fb3146b97ee9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:38:02.664751 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 327/653] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:38:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:38:02.670673 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e88d86-694f-4cd4-b072-7c3eb5ce87c6 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:02.679798 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e88d86-694f-4cd4-b072-7c3eb5ce87c6 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:02.684648 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9573c5-0943-415d-98ed-c4d82fbda4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:02.685226 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9573c5-0943-415d-98ed-c4d82fbda4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:02.685515 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9573c5-0943-415d-98ed-c4d82fbda4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:02.685800 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9573c5-0943-415d-98ed-c4d82fbda4d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:02.686538 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9573c5-0943-415d-98ed-c4d82fbda4d1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:02.686877 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9573c5-0943-415d-98ed-c4d82fbda4d1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:02.712570 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9573c5-0943-415d-98ed-c4d82fbda4d1 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:02.725764 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 327/654] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:38:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:02.731991 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2068e-ff88-46f6-b81b-fb3146b97ee9 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:02.741074 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2068e-ff88-46f6-b81b-fb3146b97ee9 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:02.745072 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7c88f-98a3-40f5-b399-fbdea9e3bae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:02.745635 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7c88f-98a3-40f5-b399-fbdea9e3bae6 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:02.745923 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7c88f-98a3-40f5-b399-fbdea9e3bae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:02.746210 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7c88f-98a3-40f5-b399-fbdea9e3bae6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:02.747008 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7c88f-98a3-40f5-b399-fbdea9e3bae6 admin admin] RBAC: Adding query filter params (role.id=7be0a1814ee244dcb629551693d66f17, scope.project.id=ed634cf9bb9146f7a9738325a8638b70, user.id=1959af22edbf47cd8afca70831d476c0) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:02.747310 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7c88f-98a3-40f5-b399-fbdea9e3bae6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:02.772665 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7c88f-98a3-40f5-b399-fbdea9e3bae6 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:02.778706 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 328/655] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:38:02 2021] GET /identity/v3/role_assignments?user.id=1959af22edbf47cd8afca70831d476c0&scope.project.id=ed634cf9bb9146f7a9738325a8638b70&role.id=7be0a1814ee244dcb629551693d66f17 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:04.713316 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f4860-98bc-4ca7-b83d-b5f8d8fca270 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:04.713874 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f4860-98bc-4ca7-b83d-b5f8d8fca270 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:04.713874 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f4860-98bc-4ca7-b83d-b5f8d8fca270 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:04.715562 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 328/656] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:38:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:38:04.720635 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb512d7-6604-42f4-a8b5-4fa9aa98b5e7 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:04.721038 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb512d7-6604-42f4-a8b5-4fa9aa98b5e7 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:04.721194 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb512d7-6604-42f4-a8b5-4fa9aa98b5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:04.743624 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-6eb512d7-6604-42f4-a8b5-4fa9aa98b5e7 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:38:04.745316 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-6eb512d7-6604-42f4-a8b5-4fa9aa98b5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:38:04.751835 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 329/657] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:38:04 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:38:04.772460 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f4860-98bc-4ca7-b83d-b5f8d8fca270 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:04.783718 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f4860-98bc-4ca7-b83d-b5f8d8fca270 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:04.787469 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ababe59-8607-490b-9a93-362ef7c14f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:04.788157 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ababe59-8607-490b-9a93-362ef7c14f5c admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:04.788441 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ababe59-8607-490b-9a93-362ef7c14f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:04.788718 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ababe59-8607-490b-9a93-362ef7c14f5c admin admin] PATH_INFO: `/v3/services/image` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:04.789333 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ababe59-8607-490b-9a93-362ef7c14f5c admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:04.815599 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ababe59-8607-490b-9a93-362ef7c14f5c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:04.825877 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-2ababe59-8607-490b-9a93-362ef7c14f5c admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 29 20:38:04.826935 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 329/658] 10.222.0.37 () {56 vars in 1126 bytes} [Wed Dec 29 20:38:04 2021] GET /identity/v3/services/image => generated 86 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:04.832285 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb512d7-6604-42f4-a8b5-4fa9aa98b5e7 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:04.841205 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb512d7-6604-42f4-a8b5-4fa9aa98b5e7 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:04.845288 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7cfa6d-f0f8-44ed-8057-191f56deeca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:04.845862 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cfa6d-f0f8-44ed-8057-191f56deeca3 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:04.846146 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cfa6d-f0f8-44ed-8057-191f56deeca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:04.846423 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cfa6d-f0f8-44ed-8057-191f56deeca3 admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:04.847118 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7cfa6d-f0f8-44ed-8057-191f56deeca3 admin admin] RBAC: Adding query filter params (name=image) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:04.847414 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7cfa6d-f0f8-44ed-8057-191f56deeca3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:04.873517 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7cfa6d-f0f8-44ed-8057-191f56deeca3 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:04.877999 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 330/659] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:38:04 2021] GET /identity/v3/services?name=image => generated 122 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:04.883347 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ababe59-8607-490b-9a93-362ef7c14f5c admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:04.892319 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ababe59-8607-490b-9a93-362ef7c14f5c admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:04.896211 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17288c3-421e-4fbd-8ce4-2ece60cf4d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:04.896782 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17288c3-421e-4fbd-8ce4-2ece60cf4d2f admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:04.897066 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17288c3-421e-4fbd-8ce4-2ece60cf4d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:04.897342 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17288c3-421e-4fbd-8ce4-2ece60cf4d2f admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:04.898002 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17288c3-421e-4fbd-8ce4-2ece60cf4d2f admin admin] RBAC: Adding query filter params (type=image) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:04.898294 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17288c3-421e-4fbd-8ce4-2ece60cf4d2f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:04.924446 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17288c3-421e-4fbd-8ce4-2ece60cf4d2f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:04.928681 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 330/660] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:38:04 2021] GET /identity/v3/services?type=image => generated 122 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:38:06.849126 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f011b-d9a0-4b56-9bbf-7f889122b2f4 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:06.849663 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f011b-d9a0-4b56-9bbf-7f889122b2f4 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:06.849663 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f011b-d9a0-4b56-9bbf-7f889122b2f4 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:06.851381 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 331/661] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:38:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:38:06.856490 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a3601-6aaa-46a0-80cf-400d10937ca5 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:06.856886 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a3601-6aaa-46a0-80cf-400d10937ca5 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:06.857046 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a3601-6aaa-46a0-80cf-400d10937ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:06.878804 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-b04a3601-6aaa-46a0-80cf-400d10937ca5 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:38:06.879926 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-b04a3601-6aaa-46a0-80cf-400d10937ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:38:06.887068 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 331/662] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:38:06 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:38:06.908880 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f011b-d9a0-4b56-9bbf-7f889122b2f4 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:06.920570 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f011b-d9a0-4b56-9bbf-7f889122b2f4 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:06.924332 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96931c24-8bca-4100-baae-7ec379ecf2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:06.924903 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96931c24-8bca-4100-baae-7ec379ecf2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:06.925189 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96931c24-8bca-4100-baae-7ec379ecf2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:06.925472 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96931c24-8bca-4100-baae-7ec379ecf2c2 admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:06.926137 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96931c24-8bca-4100-baae-7ec379ecf2c2 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:06.951924 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96931c24-8bca-4100-baae-7ec379ecf2c2 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:06.964628 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 332/663] 10.222.0.37 () {60 vars in 1162 bytes} [Wed Dec 29 20:38:06 2021] POST /identity/v3/services => generated 242 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:38:08.966856 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073585df-d896-49ec-bbe1-59827c8829ef None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:08.967349 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073585df-d896-49ec-bbe1-59827c8829ef None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:08.967450 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073585df-d896-49ec-bbe1-59827c8829ef None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:08.969090 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 332/664] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:38:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:38:08.974200 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770ce04-f92c-43cc-b6d1-db6d057d86b2 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:08.974589 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770ce04-f92c-43cc-b6d1-db6d057d86b2 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:08.974804 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770ce04-f92c-43cc-b6d1-db6d057d86b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:08.997251 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-b770ce04-f92c-43cc-b6d1-db6d057d86b2 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:38:08.998373 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-b770ce04-f92c-43cc-b6d1-db6d057d86b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:38:09.015497 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 333/665] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:38:08 2021] POST /identity/v3/auth/tokens => generated 1712 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:38:09.036569 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073585df-d896-49ec-bbe1-59827c8829ef None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:09.048490 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073585df-d896-49ec-bbe1-59827c8829ef None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:09.052305 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885061c-f85f-4fe1-8746-41d17569c1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:09.053004 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885061c-f85f-4fe1-8746-41d17569c1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:09.053293 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885061c-f85f-4fe1-8746-41d17569c1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:09.053571 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885061c-f85f-4fe1-8746-41d17569c1d8 admin admin] PATH_INFO: `/v3/services/image` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:09.054195 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885061c-f85f-4fe1-8746-41d17569c1d8 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:09.080494 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885061c-f85f-4fe1-8746-41d17569c1d8 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:09.090431 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-f885061c-f85f-4fe1-8746-41d17569c1d8 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 29 20:38:09.091486 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 333/666] 10.222.0.37 () {56 vars in 1126 bytes} [Wed Dec 29 20:38:09 2021] GET /identity/v3/services/image => generated 86 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:09.096948 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770ce04-f92c-43cc-b6d1-db6d057d86b2 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:09.106053 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770ce04-f92c-43cc-b6d1-db6d057d86b2 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:09.109958 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0ae56-2364-4453-979c-9108cc2dc223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:09.110533 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0ae56-2364-4453-979c-9108cc2dc223 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:09.110861 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0ae56-2364-4453-979c-9108cc2dc223 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:09.111142 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0ae56-2364-4453-979c-9108cc2dc223 admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:09.111813 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0ae56-2364-4453-979c-9108cc2dc223 admin admin] RBAC: Adding query filter params (name=image) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:09.112109 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0ae56-2364-4453-979c-9108cc2dc223 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:09.137744 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0ae56-2364-4453-979c-9108cc2dc223 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:09.142003 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 334/667] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:38:09 2021] GET /identity/v3/services?name=image => generated 122 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:09.147567 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885061c-f85f-4fe1-8746-41d17569c1d8 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:09.156670 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885061c-f85f-4fe1-8746-41d17569c1d8 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:09.160638 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce6b84-9d11-402c-bafb-a29ec858e120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:09.161207 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce6b84-9d11-402c-bafb-a29ec858e120 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:09.161495 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce6b84-9d11-402c-bafb-a29ec858e120 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:09.161779 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce6b84-9d11-402c-bafb-a29ec858e120 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:09.162442 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce6b84-9d11-402c-bafb-a29ec858e120 admin admin] RBAC: Adding query filter params (type=image) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:09.162778 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce6b84-9d11-402c-bafb-a29ec858e120 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:09.189911 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce6b84-9d11-402c-bafb-a29ec858e120 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:09.194624 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 334/668] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:38:09 2021] GET /identity/v3/services?type=image => generated 350 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:09.200285 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0ae56-2364-4453-979c-9108cc2dc223 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:09.209299 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0ae56-2364-4453-979c-9108cc2dc223 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:09.213450 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049f3fa-0e7d-4d10-9831-8c786a12c7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:09.214018 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049f3fa-0e7d-4d10-9831-8c786a12c7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:09.214307 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049f3fa-0e7d-4d10-9831-8c786a12c7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:09.214591 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049f3fa-0e7d-4d10-9831-8c786a12c7c5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:09.215357 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049f3fa-0e7d-4d10-9831-8c786a12c7c5 admin admin] RBAC: Adding query filter params (interface=public, service_id=05285f553c4d4c3590cf0a15f8e58583, region_id=RegionOne) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:09.215689 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049f3fa-0e7d-4d10-9831-8c786a12c7c5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:09.241429 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049f3fa-0e7d-4d10-9831-8c786a12c7c5 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:09.246567 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 335/669] 10.222.0.37 () {56 vars in 1272 bytes} [Wed Dec 29 20:38:09 2021] GET /identity/v3/endpoints?service_id=05285f553c4d4c3590cf0a15f8e58583&interface=public®ion_id=RegionOne => generated 194 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:09.251450 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce6b84-9d11-402c-bafb-a29ec858e120 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:09.261019 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce6b84-9d11-402c-bafb-a29ec858e120 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:09.264953 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc5c5e-48e4-461f-83b5-2244f4172e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:09.265523 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc5c5e-48e4-461f-83b5-2244f4172e2d admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:09.265814 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc5c5e-48e4-461f-83b5-2244f4172e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:09.266098 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc5c5e-48e4-461f-83b5-2244f4172e2d admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:09.266772 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc5c5e-48e4-461f-83b5-2244f4172e2d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:09.292586 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc5c5e-48e4-461f-83b5-2244f4172e2d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:09.297670 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 335/670] 10.222.0.37 () {56 vars in 1108 bytes} [Wed Dec 29 20:38:09 2021] GET /identity/v3/services => generated 1022 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:38:11.224589 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ca876-3ffa-42a4-b175-1e2a72eb2957 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:11.225098 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ca876-3ffa-42a4-b175-1e2a72eb2957 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:11.225098 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ca876-3ffa-42a4-b175-1e2a72eb2957 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:11.226752 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 336/671] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:38:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:38:11.232387 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7066416-22f5-407b-a7c4-290d9573bd60 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:11.232787 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7066416-22f5-407b-a7c4-290d9573bd60 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:11.232948 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7066416-22f5-407b-a7c4-290d9573bd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:11.255904 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-c7066416-22f5-407b-a7c4-290d9573bd60 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:38:11.257017 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-c7066416-22f5-407b-a7c4-290d9573bd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:38:11.263570 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 336/672] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:38:11 2021] POST /identity/v3/auth/tokens => generated 1712 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:38:11.284995 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ca876-3ffa-42a4-b175-1e2a72eb2957 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:11.296821 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ca876-3ffa-42a4-b175-1e2a72eb2957 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:11.300611 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4c022-e999-4855-831a-f111c915b900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:11.301304 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4c022-e999-4855-831a-f111c915b900 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:11.301593 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4c022-e999-4855-831a-f111c915b900 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:11.301873 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4c022-e999-4855-831a-f111c915b900 admin admin] PATH_INFO: `/v3/services/image` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:11.302482 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4c022-e999-4855-831a-f111c915b900 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:11.328266 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4c022-e999-4855-831a-f111c915b900 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:11.338700 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-e8d4c022-e999-4855-831a-f111c915b900 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 29 20:38:11.339735 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 337/673] 10.222.0.37 () {56 vars in 1126 bytes} [Wed Dec 29 20:38:11 2021] GET /identity/v3/services/image => generated 86 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:11.345214 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7066416-22f5-407b-a7c4-290d9573bd60 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:11.353625 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7066416-22f5-407b-a7c4-290d9573bd60 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:11.357552 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe391675-0bb8-4715-800b-9ee48d551b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:11.358131 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe391675-0bb8-4715-800b-9ee48d551b13 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:11.358417 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe391675-0bb8-4715-800b-9ee48d551b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:11.358734 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe391675-0bb8-4715-800b-9ee48d551b13 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:11.359403 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe391675-0bb8-4715-800b-9ee48d551b13 admin admin] RBAC: Adding query filter params (name=image) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:11.359699 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe391675-0bb8-4715-800b-9ee48d551b13 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:11.385443 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe391675-0bb8-4715-800b-9ee48d551b13 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:11.389784 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 337/674] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:38:11 2021] GET /identity/v3/services?name=image => generated 122 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:11.395448 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4c022-e999-4855-831a-f111c915b900 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:11.404956 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4c022-e999-4855-831a-f111c915b900 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:11.408859 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0e932-4889-4870-a320-cc2e6baeb3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:11.409421 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0e932-4889-4870-a320-cc2e6baeb3db admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:11.409706 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0e932-4889-4870-a320-cc2e6baeb3db admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:11.409984 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0e932-4889-4870-a320-cc2e6baeb3db admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:11.410633 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0e932-4889-4870-a320-cc2e6baeb3db admin admin] RBAC: Adding query filter params (type=image) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:11.410957 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0e932-4889-4870-a320-cc2e6baeb3db admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:11.447408 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0e932-4889-4870-a320-cc2e6baeb3db admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:11.452620 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 338/675] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:38:11 2021] GET /identity/v3/services?type=image => generated 350 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:11.457921 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe391675-0bb8-4715-800b-9ee48d551b13 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:11.467687 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe391675-0bb8-4715-800b-9ee48d551b13 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:11.471626 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6375c35-d631-48ec-a8b8-884a9e43112a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:11.472197 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6375c35-d631-48ec-a8b8-884a9e43112a admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:11.472486 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6375c35-d631-48ec-a8b8-884a9e43112a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:11.472769 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6375c35-d631-48ec-a8b8-884a9e43112a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:11.473449 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6375c35-d631-48ec-a8b8-884a9e43112a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:11.499079 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6375c35-d631-48ec-a8b8-884a9e43112a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:11.516087 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 338/676] 10.222.0.37 () {60 vars in 1165 bytes} [Wed Dec 29 20:38:11 2021] POST /identity/v3/endpoints => generated 327 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:38:13.470213 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d5188-cab1-40e8-b32b-bd921abe93e3 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:13.470849 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d5188-cab1-40e8-b32b-bd921abe93e3 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:13.470849 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d5188-cab1-40e8-b32b-bd921abe93e3 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:13.472494 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 339/677] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:38:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:38:13.477455 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986ec2e-f711-4939-9dd9-47e01ba5b411 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:13.477863 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986ec2e-f711-4939-9dd9-47e01ba5b411 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:13.478047 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986ec2e-f711-4939-9dd9-47e01ba5b411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:13.500374 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-3986ec2e-f711-4939-9dd9-47e01ba5b411 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:38:13.501483 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-3986ec2e-f711-4939-9dd9-47e01ba5b411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:38:13.516953 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 339/678] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:38:13 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:38:13.538799 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d5188-cab1-40e8-b32b-bd921abe93e3 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:13.550806 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d5188-cab1-40e8-b32b-bd921abe93e3 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:13.554606 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772ddaa-97e2-4883-8221-2e5ba2d40725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:13.555191 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772ddaa-97e2-4883-8221-2e5ba2d40725 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:13.555482 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772ddaa-97e2-4883-8221-2e5ba2d40725 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:13.555790 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772ddaa-97e2-4883-8221-2e5ba2d40725 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:13.563372 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7772ddaa-97e2-4883-8221-2e5ba2d40725 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:13.589907 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7772ddaa-97e2-4883-8221-2e5ba2d40725 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:13.598883 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 340/679] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:38:13 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:38:13.604412 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986ec2e-f711-4939-9dd9-47e01ba5b411 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:13.612617 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986ec2e-f711-4939-9dd9-47e01ba5b411 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:13.616530 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a6fb0-b7c4-4b1b-b15f-c1c596b17fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:13.617230 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a6fb0-b7c4-4b1b-b15f-c1c596b17fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:13.617512 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a6fb0-b7c4-4b1b-b15f-c1c596b17fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:13.617789 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a6fb0-b7c4-4b1b-b15f-c1c596b17fd9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:13.618936 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a6fb0-b7c4-4b1b-b15f-c1c596b17fd9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:13.644514 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a6fb0-b7c4-4b1b-b15f-c1c596b17fd9 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:13.645928 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 340/680] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:38:13 2021] GET /identity/v3/domains/default => generated 199 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:38:15.681515 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4fd76-79e8-4ae8-a510-6ab440258125 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:15.682067 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4fd76-79e8-4ae8-a510-6ab440258125 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:15.682294 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4fd76-79e8-4ae8-a510-6ab440258125 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:15.684022 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 341/681] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:38:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:38:15.689010 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6c780-fc5c-476a-8c42-768a6bbd32db None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:15.689438 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6c780-fc5c-476a-8c42-768a6bbd32db None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:15.689566 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6c780-fc5c-476a-8c42-768a6bbd32db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:15.711990 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-80d6c780-fc5c-476a-8c42-768a6bbd32db None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:38:15.713104 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-80d6c780-fc5c-476a-8c42-768a6bbd32db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:38:15.719725 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 341/682] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:38:15 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:38:15.742614 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4fd76-79e8-4ae8-a510-6ab440258125 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:15.754608 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4fd76-79e8-4ae8-a510-6ab440258125 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:15.758459 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a72e6e-93a8-4458-830d-893ad60e246b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:15.759811 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a72e6e-93a8-4458-830d-893ad60e246b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:15.760101 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a72e6e-93a8-4458-830d-893ad60e246b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:15.760448 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a72e6e-93a8-4458-830d-893ad60e246b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:15.771743 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a72e6e-93a8-4458-830d-893ad60e246b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:15.797444 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a72e6e-93a8-4458-830d-893ad60e246b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:15.814363 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-16a72e6e-93a8-4458-830d-893ad60e246b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:38:15.815439 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 342/683] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:38:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:15.821579 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6c780-fc5c-476a-8c42-768a6bbd32db None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:15.830279 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6c780-fc5c-476a-8c42-768a6bbd32db None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:15.834212 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b09f4-4395-417c-b24a-2b1e670475f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:15.834818 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b09f4-4395-417c-b24a-2b1e670475f6 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:15.835104 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b09f4-4395-417c-b24a-2b1e670475f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:15.835382 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b09f4-4395-417c-b24a-2b1e670475f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:15.836064 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b09f4-4395-417c-b24a-2b1e670475f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:15.836357 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b09f4-4395-417c-b24a-2b1e670475f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:15.862264 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b09f4-4395-417c-b24a-2b1e670475f6 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:15.875374 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 342/684] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:38:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:15.880885 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a72e6e-93a8-4458-830d-893ad60e246b admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:15.890189 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a72e6e-93a8-4458-830d-893ad60e246b admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:15.894037 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f93c8-4107-45ed-9cb0-4e7403e7540f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:15.894615 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f93c8-4107-45ed-9cb0-4e7403e7540f admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:15.894934 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f93c8-4107-45ed-9cb0-4e7403e7540f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:15.895214 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f93c8-4107-45ed-9cb0-4e7403e7540f admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:15.895854 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f93c8-4107-45ed-9cb0-4e7403e7540f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:15.921911 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f93c8-4107-45ed-9cb0-4e7403e7540f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:15.941463 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 343/685] 10.222.0.37 () {60 vars in 1153 bytes} [Wed Dec 29 20:38:15 2021] POST /identity/v3/users => generated 248 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:38:17.888687 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b047545-2ce5-41b7-b929-38ae6645d243 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:17.889091 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b047545-2ce5-41b7-b929-38ae6645d243 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:17.889251 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b047545-2ce5-41b7-b929-38ae6645d243 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:17.890951 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 343/686] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:38:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:38:17.895903 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e4f9e-9e3a-4202-935e-f5eafac6511d None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:17.896296 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e4f9e-9e3a-4202-935e-f5eafac6511d None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:17.896465 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e4f9e-9e3a-4202-935e-f5eafac6511d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:17.917808 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-1c8e4f9e-9e3a-4202-935e-f5eafac6511d None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:38:17.918984 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-1c8e4f9e-9e3a-4202-935e-f5eafac6511d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:38:17.925544 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 344/687] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:38:17 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:38:17.948542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b047545-2ce5-41b7-b929-38ae6645d243 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:17.959751 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b047545-2ce5-41b7-b929-38ae6645d243 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:17.963542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31829829-dd26-4fe5-9916-c2ca81505e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:17.964241 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31829829-dd26-4fe5-9916-c2ca81505e6b admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:17.964524 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31829829-dd26-4fe5-9916-c2ca81505e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:17.964800 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31829829-dd26-4fe5-9916-c2ca81505e6b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:17.975441 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31829829-dd26-4fe5-9916-c2ca81505e6b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:38:17.981865 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-31829829-dd26-4fe5-9916-c2ca81505e6b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 29 20:38:17.982950 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 344/688] 10.222.0.37 () {56 vars in 1123 bytes} [Wed Dec 29 20:38:17 2021] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:17.988551 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e4f9e-9e3a-4202-935e-f5eafac6511d None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:17.997449 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e4f9e-9e3a-4202-935e-f5eafac6511d None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:18.001397 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bc1a5-d8a4-4af6-8cc5-184eddef9708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:18.001974 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bc1a5-d8a4-4af6-8cc5-184eddef9708 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:18.002261 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bc1a5-d8a4-4af6-8cc5-184eddef9708 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:18.002544 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bc1a5-d8a4-4af6-8cc5-184eddef9708 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:18.003282 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bc1a5-d8a4-4af6-8cc5-184eddef9708 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:18.003583 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bc1a5-d8a4-4af6-8cc5-184eddef9708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:18.029349 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bc1a5-d8a4-4af6-8cc5-184eddef9708 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:18.037494 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 345/689] 10.222.0.37 () {56 vars in 1124 bytes} [Wed Dec 29 20:38:17 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:18.043254 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31829829-dd26-4fe5-9916-c2ca81505e6b admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:18.052775 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31829829-dd26-4fe5-9916-c2ca81505e6b admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:18.057587 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03526ddf-3535-42a1-86d4-97256713b4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:18.058280 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03526ddf-3535-42a1-86d4-97256713b4be admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:18.058569 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03526ddf-3535-42a1-86d4-97256713b4be admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:18.058878 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03526ddf-3535-42a1-86d4-97256713b4be admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:18.069860 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03526ddf-3535-42a1-86d4-97256713b4be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:18.095464 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03526ddf-3535-42a1-86d4-97256713b4be admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:18.113746 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-03526ddf-3535-42a1-86d4-97256713b4be admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:38:18.114781 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 345/690] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:38:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:18.121361 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bc1a5-d8a4-4af6-8cc5-184eddef9708 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:18.130445 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bc1a5-d8a4-4af6-8cc5-184eddef9708 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:18.134338 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00808d7-0495-4b0b-aac6-96b147838dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:18.134940 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00808d7-0495-4b0b-aac6-96b147838dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:18.135226 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00808d7-0495-4b0b-aac6-96b147838dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:18.135505 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00808d7-0495-4b0b-aac6-96b147838dc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:18.136176 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00808d7-0495-4b0b-aac6-96b147838dc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:18.136471 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00808d7-0495-4b0b-aac6-96b147838dc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:18.161279 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00808d7-0495-4b0b-aac6-96b147838dc9 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:18.174108 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 346/691] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:38:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:18.179190 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03526ddf-3535-42a1-86d4-97256713b4be admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:18.188858 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03526ddf-3535-42a1-86d4-97256713b4be admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:18.192783 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc841a-eaa1-4061-b360-19404e6db4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:18.193484 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc841a-eaa1-4061-b360-19404e6db4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:18.193770 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc841a-eaa1-4061-b360-19404e6db4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:18.194052 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc841a-eaa1-4061-b360-19404e6db4c9 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:18.206582 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc841a-eaa1-4061-b360-19404e6db4c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:18.232665 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc841a-eaa1-4061-b360-19404e6db4c9 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:18.250274 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-e8dc841a-eaa1-4061-b360-19404e6db4c9 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 29 20:38:18.251335 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 346/692] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:38:18 2021] GET /identity/v3/users/cinder => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:38:18.256649 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00808d7-0495-4b0b-aac6-96b147838dc9 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:18.266145 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00808d7-0495-4b0b-aac6-96b147838dc9 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:18.270017 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4c4cc-1e97-4ebe-aa25-bf7b6a9eea11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:18.270595 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4c4cc-1e97-4ebe-aa25-bf7b6a9eea11 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:18.270915 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4c4cc-1e97-4ebe-aa25-bf7b6a9eea11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:18.271198 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4c4cc-1e97-4ebe-aa25-bf7b6a9eea11 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:18.271972 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4c4cc-1e97-4ebe-aa25-bf7b6a9eea11 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:18.272271 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4c4cc-1e97-4ebe-aa25-bf7b6a9eea11 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:18.298078 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4c4cc-1e97-4ebe-aa25-bf7b6a9eea11 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:18.327749 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 347/693] 10.222.0.37 () {56 vars in 1158 bytes} [Wed Dec 29 20:38:18 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:18.333056 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc841a-eaa1-4061-b360-19404e6db4c9 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:18.342118 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc841a-eaa1-4061-b360-19404e6db4c9 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:18.346028 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8fd9c-4fab-401d-afc4-af9c602c55fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:18.346586 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8fd9c-4fab-401d-afc4-af9c602c55fc admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:18.346903 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8fd9c-4fab-401d-afc4-af9c602c55fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:18.347181 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8fd9c-4fab-401d-afc4-af9c602c55fc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:18.355663 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8fd9c-4fab-401d-afc4-af9c602c55fc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:18.381552 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8fd9c-4fab-401d-afc4-af9c602c55fc admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:18.389714 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 347/694] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:38:18 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:38:18.394873 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4c4cc-1e97-4ebe-aa25-bf7b6a9eea11 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:18.403916 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4c4cc-1e97-4ebe-aa25-bf7b6a9eea11 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:18.407857 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86242e9-6da3-4beb-b390-00760e3cf43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:18.408554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86242e9-6da3-4beb-b390-00760e3cf43a admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:18.408841 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86242e9-6da3-4beb-b390-00760e3cf43a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:18.409122 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86242e9-6da3-4beb-b390-00760e3cf43a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:18.420994 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86242e9-6da3-4beb-b390-00760e3cf43a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:18.446499 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86242e9-6da3-4beb-b390-00760e3cf43a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:18.463831 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-e86242e9-6da3-4beb-b390-00760e3cf43a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:38:18.464867 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 348/695] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:38:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:18.470011 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8fd9c-4fab-401d-afc4-af9c602c55fc admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:18.479003 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8fd9c-4fab-401d-afc4-af9c602c55fc admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:18.483001 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99300e3e-e847-412a-a59a-59cc05912f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:18.483567 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99300e3e-e847-412a-a59a-59cc05912f6e admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:18.483853 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99300e3e-e847-412a-a59a-59cc05912f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:18.484131 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99300e3e-e847-412a-a59a-59cc05912f6e admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:18.484806 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99300e3e-e847-412a-a59a-59cc05912f6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:18.485102 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99300e3e-e847-412a-a59a-59cc05912f6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:18.510470 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99300e3e-e847-412a-a59a-59cc05912f6e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:18.522947 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 348/696] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:38:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:18.528418 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86242e9-6da3-4beb-b390-00760e3cf43a admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:18.537295 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86242e9-6da3-4beb-b390-00760e3cf43a admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:18.541777 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6607c0-ac55-419f-b440-0848f31013ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:18.542468 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6607c0-ac55-419f-b440-0848f31013ca admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:18.542789 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6607c0-ac55-419f-b440-0848f31013ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:18.543065 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6607c0-ac55-419f-b440-0848f31013ca admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:18.551635 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6607c0-ac55-419f-b440-0848f31013ca admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:18.578605 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6607c0-ac55-419f-b440-0848f31013ca admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:18.592236 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-4c6607c0-ac55-419f-b440-0848f31013ca admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:38:18.593276 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 349/697] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:38:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:18.598705 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99300e3e-e847-412a-a59a-59cc05912f6e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:18.608545 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99300e3e-e847-412a-a59a-59cc05912f6e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:18.612489 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c7893-d745-467a-9703-4ac0b8768524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:18.613058 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c7893-d745-467a-9703-4ac0b8768524 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:18.613345 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c7893-d745-467a-9703-4ac0b8768524 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:18.613626 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c7893-d745-467a-9703-4ac0b8768524 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:18.614361 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c7893-d745-467a-9703-4ac0b8768524 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:18.614675 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c7893-d745-467a-9703-4ac0b8768524 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:18.640056 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c7893-d745-467a-9703-4ac0b8768524 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:18.653089 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 349/698] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:38:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:18.658570 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6607c0-ac55-419f-b440-0848f31013ca admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:18.668084 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6607c0-ac55-419f-b440-0848f31013ca admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:18.671938 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e5810-1bd7-4ede-902b-de62f6a777ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:18.672497 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e5810-1bd7-4ede-902b-de62f6a777ea admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:18.672780 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e5810-1bd7-4ede-902b-de62f6a777ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:18.673082 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e5810-1bd7-4ede-902b-de62f6a777ea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:18.673842 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e5810-1bd7-4ede-902b-de62f6a777ea admin admin] RBAC: Adding query filter params (role.id=1c5a8286caa54ded9e44ef97f73f6776, scope.project.id=ed634cf9bb9146f7a9738325a8638b70, user.id=72f5c4b1a0e942ae9a16cda3b34e0cc0) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:18.674138 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e5810-1bd7-4ede-902b-de62f6a777ea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:18.700911 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e5810-1bd7-4ede-902b-de62f6a777ea admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:18.705992 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 350/699] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:38:18 2021] GET /identity/v3/role_assignments?user.id=72f5c4b1a0e942ae9a16cda3b34e0cc0&scope.project.id=ed634cf9bb9146f7a9738325a8638b70&role.id=1c5a8286caa54ded9e44ef97f73f6776 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:20.630232 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d779a11-0434-436f-b645-8b614a9b474a None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:20.630783 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d779a11-0434-436f-b645-8b614a9b474a None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:20.630872 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d779a11-0434-436f-b645-8b614a9b474a None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:20.632507 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 350/700] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:38:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:38:20.637885 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2328f67-cd28-4b91-8133-0c7bf3f6e91a None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:20.638261 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2328f67-cd28-4b91-8133-0c7bf3f6e91a None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:20.638449 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2328f67-cd28-4b91-8133-0c7bf3f6e91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:20.660466 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-c2328f67-cd28-4b91-8133-0c7bf3f6e91a None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:38:20.661575 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c2328f67-cd28-4b91-8133-0c7bf3f6e91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:38:20.668740 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 351/701] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:38:20 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:38:20.690326 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d779a11-0434-436f-b645-8b614a9b474a None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:20.701884 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d779a11-0434-436f-b645-8b614a9b474a None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:20.705642 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da5e71-d588-43f4-992d-0744ea444607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:20.706338 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da5e71-d588-43f4-992d-0744ea444607 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:20.706621 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da5e71-d588-43f4-992d-0744ea444607 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:20.706927 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da5e71-d588-43f4-992d-0744ea444607 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:20.718769 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da5e71-d588-43f4-992d-0744ea444607 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:38:20.725007 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-a3da5e71-d588-43f4-992d-0744ea444607 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 29 20:38:20.726054 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 351/702] 10.222.0.37 () {56 vars in 1123 bytes} [Wed Dec 29 20:38:20 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:20.732179 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2328f67-cd28-4b91-8133-0c7bf3f6e91a None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:20.740620 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2328f67-cd28-4b91-8133-0c7bf3f6e91a None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:20.744846 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a87f9f-09c3-4f85-8d2c-8b0427b9ed6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:20.745420 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a87f9f-09c3-4f85-8d2c-8b0427b9ed6a admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:20.745706 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a87f9f-09c3-4f85-8d2c-8b0427b9ed6a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:20.745984 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a87f9f-09c3-4f85-8d2c-8b0427b9ed6a admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:20.746719 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a87f9f-09c3-4f85-8d2c-8b0427b9ed6a admin admin] RBAC: Adding query filter params (name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:20.747017 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a87f9f-09c3-4f85-8d2c-8b0427b9ed6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:20.774153 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a87f9f-09c3-4f85-8d2c-8b0427b9ed6a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:20.783815 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 352/703] 10.222.0.37 () {56 vars in 1124 bytes} [Wed Dec 29 20:38:20 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:20.789460 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da5e71-d588-43f4-992d-0744ea444607 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:20.799900 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da5e71-d588-43f4-992d-0744ea444607 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:20.804104 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec671cb-44dc-461e-94d9-145e3e51027d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:20.804826 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec671cb-44dc-461e-94d9-145e3e51027d admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:20.805117 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec671cb-44dc-461e-94d9-145e3e51027d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:20.805402 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec671cb-44dc-461e-94d9-145e3e51027d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:20.816498 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec671cb-44dc-461e-94d9-145e3e51027d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:20.843034 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec671cb-44dc-461e-94d9-145e3e51027d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:20.862194 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-2ec671cb-44dc-461e-94d9-145e3e51027d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:38:20.863676 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 352/704] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:38:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:20.869102 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a87f9f-09c3-4f85-8d2c-8b0427b9ed6a admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:20.878480 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a87f9f-09c3-4f85-8d2c-8b0427b9ed6a admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:20.882599 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6c77a-2915-4335-b11a-d1080bea573a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:20.883163 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6c77a-2915-4335-b11a-d1080bea573a admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:20.883447 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6c77a-2915-4335-b11a-d1080bea573a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:20.883730 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6c77a-2915-4335-b11a-d1080bea573a admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:20.884467 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6c77a-2915-4335-b11a-d1080bea573a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:20.884761 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6c77a-2915-4335-b11a-d1080bea573a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:20.910345 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6c77a-2915-4335-b11a-d1080bea573a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:20.924166 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 353/705] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:38:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:20.929690 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec671cb-44dc-461e-94d9-145e3e51027d admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:20.939150 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec671cb-44dc-461e-94d9-145e3e51027d admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:20.943161 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b8986-6369-4c72-a9e6-57576e93c4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:20.943878 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b8986-6369-4c72-a9e6-57576e93c4aa admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:20.944163 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b8986-6369-4c72-a9e6-57576e93c4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:20.944438 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b8986-6369-4c72-a9e6-57576e93c4aa admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:20.957438 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b8986-6369-4c72-a9e6-57576e93c4aa admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:20.984417 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b8986-6369-4c72-a9e6-57576e93c4aa admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:21.002795 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-098b8986-6369-4c72-a9e6-57576e93c4aa admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 29 20:38:21.003917 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 353/706] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:38:20 2021] GET /identity/v3/users/cinder => generated 84 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:21.009740 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6c77a-2915-4335-b11a-d1080bea573a admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:21.018943 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6c77a-2915-4335-b11a-d1080bea573a admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:21.022835 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a219741-9a2a-43b1-8624-d0777d9b2f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:21.023410 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a219741-9a2a-43b1-8624-d0777d9b2f46 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:21.023695 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a219741-9a2a-43b1-8624-d0777d9b2f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:21.023975 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a219741-9a2a-43b1-8624-d0777d9b2f46 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:21.025391 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a219741-9a2a-43b1-8624-d0777d9b2f46 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:21.025689 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a219741-9a2a-43b1-8624-d0777d9b2f46 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:21.051378 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a219741-9a2a-43b1-8624-d0777d9b2f46 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:21.079974 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 354/707] 10.222.0.37 () {56 vars in 1158 bytes} [Wed Dec 29 20:38:21 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:21.085365 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b8986-6369-4c72-a9e6-57576e93c4aa admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:21.095324 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b8986-6369-4c72-a9e6-57576e93c4aa admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:21.099215 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfe899-24a2-4af3-b7e2-c861035caee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:21.099905 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfe899-24a2-4af3-b7e2-c861035caee7 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:21.100189 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfe899-24a2-4af3-b7e2-c861035caee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:21.100470 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfe899-24a2-4af3-b7e2-c861035caee7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:21.113381 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfe899-24a2-4af3-b7e2-c861035caee7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:21.139215 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfe899-24a2-4af3-b7e2-c861035caee7 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:21.155804 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-79cfe899-24a2-4af3-b7e2-c861035caee7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:38:21.156830 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 354/708] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:38:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:38:21.162392 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a219741-9a2a-43b1-8624-d0777d9b2f46 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:21.171784 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a219741-9a2a-43b1-8624-d0777d9b2f46 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:21.175764 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498a232-a0f3-4ee3-87a0-34a062c3de71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:21.176339 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498a232-a0f3-4ee3-87a0-34a062c3de71 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:21.176629 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498a232-a0f3-4ee3-87a0-34a062c3de71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:21.176918 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498a232-a0f3-4ee3-87a0-34a062c3de71 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:21.177596 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498a232-a0f3-4ee3-87a0-34a062c3de71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:21.177896 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498a232-a0f3-4ee3-87a0-34a062c3de71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:21.203835 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498a232-a0f3-4ee3-87a0-34a062c3de71 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:21.216361 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 355/709] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:38:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:21.221441 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfe899-24a2-4af3-b7e2-c861035caee7 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:21.230981 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfe899-24a2-4af3-b7e2-c861035caee7 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:21.234880 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435bc90-823a-450f-8b1d-caea1a6a5707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:21.235571 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435bc90-823a-450f-8b1d-caea1a6a5707 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:21.235852 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435bc90-823a-450f-8b1d-caea1a6a5707 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:21.236122 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435bc90-823a-450f-8b1d-caea1a6a5707 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:21.245295 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435bc90-823a-450f-8b1d-caea1a6a5707 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:21.270641 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435bc90-823a-450f-8b1d-caea1a6a5707 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:21.283711 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-7435bc90-823a-450f-8b1d-caea1a6a5707 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:38:21.284730 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 355/710] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:38:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:21.289999 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498a232-a0f3-4ee3-87a0-34a062c3de71 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:21.299624 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498a232-a0f3-4ee3-87a0-34a062c3de71 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:21.303482 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f9829-897e-40b3-9c14-100771652e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:21.304044 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f9829-897e-40b3-9c14-100771652e68 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:21.304326 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f9829-897e-40b3-9c14-100771652e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:21.304601 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f9829-897e-40b3-9c14-100771652e68 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:21.305321 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f9829-897e-40b3-9c14-100771652e68 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:21.305615 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f9829-897e-40b3-9c14-100771652e68 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:21.331553 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f9829-897e-40b3-9c14-100771652e68 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:21.344082 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 356/711] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:38:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:21.349530 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435bc90-823a-450f-8b1d-caea1a6a5707 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:21.359146 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435bc90-823a-450f-8b1d-caea1a6a5707 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:21.363067 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cfd65-eecc-44a8-ac57-84715f5ed21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:21.363860 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cfd65-eecc-44a8-ac57-84715f5ed21c admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:21.364147 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cfd65-eecc-44a8-ac57-84715f5ed21c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:21.364429 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cfd65-eecc-44a8-ac57-84715f5ed21c admin admin] PATH_INFO: `/v3/projects/ed634cf9bb9146f7a9738325a8638b70/users/72f5c4b1a0e942ae9a16cda3b34e0cc0/roles/1c5a8286caa54ded9e44ef97f73f6776` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:21.384229 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0cfd65-eecc-44a8-ac57-84715f5ed21c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed634cf9bb9146f7a9738325a8638b70, user_id=72f5c4b1a0e942ae9a16cda3b34e0cc0, role_id=1c5a8286caa54ded9e44ef97f73f6776)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:21.410413 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0cfd65-eecc-44a8-ac57-84715f5ed21c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:21.422563 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 356/712] 10.222.0.37 () {58 vars in 1460 bytes} [Wed Dec 29 20:38:21 2021] PUT /identity/v3/projects/ed634cf9bb9146f7a9738325a8638b70/users/72f5c4b1a0e942ae9a16cda3b34e0cc0/roles/1c5a8286caa54ded9e44ef97f73f6776 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:38:23.357655 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4558be-d2b9-47d4-8679-a951a7a6db77 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:23.358155 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4558be-d2b9-47d4-8679-a951a7a6db77 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:23.358266 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4558be-d2b9-47d4-8679-a951a7a6db77 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:23.359910 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 357/713] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:38:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:38:23.364993 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf3eef-ecc9-4d40-a830-ed7b85c35208 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:23.365393 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf3eef-ecc9-4d40-a830-ed7b85c35208 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:23.365558 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf3eef-ecc9-4d40-a830-ed7b85c35208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:23.387825 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-53bf3eef-ecc9-4d40-a830-ed7b85c35208 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:38:23.388954 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-53bf3eef-ecc9-4d40-a830-ed7b85c35208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:38:23.450490 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 357/714] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:38:23 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:38:23.473325 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4558be-d2b9-47d4-8679-a951a7a6db77 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:23.484752 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4558be-d2b9-47d4-8679-a951a7a6db77 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:23.488566 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8018fbd-07d5-4e6c-9163-e257a0ec47ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:23.489266 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8018fbd-07d5-4e6c-9163-e257a0ec47ef admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:23.489553 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8018fbd-07d5-4e6c-9163-e257a0ec47ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:23.489832 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8018fbd-07d5-4e6c-9163-e257a0ec47ef admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:23.500711 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8018fbd-07d5-4e6c-9163-e257a0ec47ef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:38:23.506949 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-f8018fbd-07d5-4e6c-9163-e257a0ec47ef admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 29 20:38:23.508006 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 358/715] 10.222.0.37 () {56 vars in 1123 bytes} [Wed Dec 29 20:38:23 2021] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:38:23.514190 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf3eef-ecc9-4d40-a830-ed7b85c35208 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:23.525586 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf3eef-ecc9-4d40-a830-ed7b85c35208 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:23.530190 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdabba-a812-4e42-892e-bf7317c2ac9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:23.530804 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdabba-a812-4e42-892e-bf7317c2ac9b admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:23.531092 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdabba-a812-4e42-892e-bf7317c2ac9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:23.531371 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdabba-a812-4e42-892e-bf7317c2ac9b admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:23.532074 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdabba-a812-4e42-892e-bf7317c2ac9b admin admin] RBAC: Adding query filter params (name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:23.532366 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdabba-a812-4e42-892e-bf7317c2ac9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:23.557332 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdabba-a812-4e42-892e-bf7317c2ac9b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:23.565582 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 358/716] 10.222.0.37 () {56 vars in 1124 bytes} [Wed Dec 29 20:38:23 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:23.570956 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8018fbd-07d5-4e6c-9163-e257a0ec47ef admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:23.581291 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8018fbd-07d5-4e6c-9163-e257a0ec47ef admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:23.585227 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b265788-8b36-4a02-adb0-c5ae9dc72bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:23.585925 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b265788-8b36-4a02-adb0-c5ae9dc72bde admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:23.586212 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b265788-8b36-4a02-adb0-c5ae9dc72bde admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:23.586492 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b265788-8b36-4a02-adb0-c5ae9dc72bde admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:23.598050 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b265788-8b36-4a02-adb0-c5ae9dc72bde admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:23.623355 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b265788-8b36-4a02-adb0-c5ae9dc72bde admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:23.640885 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-7b265788-8b36-4a02-adb0-c5ae9dc72bde admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:38:23.641932 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 359/717] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:38:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:23.647258 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdabba-a812-4e42-892e-bf7317c2ac9b admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:23.656781 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdabba-a812-4e42-892e-bf7317c2ac9b admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:23.660678 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b0137-dcf0-4216-84bf-ea9f21cfd56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:23.661311 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b0137-dcf0-4216-84bf-ea9f21cfd56e admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:23.661596 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b0137-dcf0-4216-84bf-ea9f21cfd56e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:23.661874 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b0137-dcf0-4216-84bf-ea9f21cfd56e admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:23.662555 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b0137-dcf0-4216-84bf-ea9f21cfd56e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:23.662889 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b0137-dcf0-4216-84bf-ea9f21cfd56e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:23.688703 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b0137-dcf0-4216-84bf-ea9f21cfd56e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:23.701999 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 359/718] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:38:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:23.707253 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b265788-8b36-4a02-adb0-c5ae9dc72bde admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:23.716677 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b265788-8b36-4a02-adb0-c5ae9dc72bde admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:23.720609 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28727f9e-3d8d-4c16-a5cb-691e120c0963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:23.721308 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28727f9e-3d8d-4c16-a5cb-691e120c0963 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:23.721595 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28727f9e-3d8d-4c16-a5cb-691e120c0963 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:23.721874 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28727f9e-3d8d-4c16-a5cb-691e120c0963 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:23.734276 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28727f9e-3d8d-4c16-a5cb-691e120c0963 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:23.761063 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28727f9e-3d8d-4c16-a5cb-691e120c0963 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:23.777982 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-28727f9e-3d8d-4c16-a5cb-691e120c0963 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 29 20:38:23.779041 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 360/719] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:38:23 2021] GET /identity/v3/users/cinder => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:23.784346 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b0137-dcf0-4216-84bf-ea9f21cfd56e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:23.793641 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b0137-dcf0-4216-84bf-ea9f21cfd56e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:23.797692 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9d1f2-5efc-4644-a009-231e7aa5153e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:23.798268 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9d1f2-5efc-4644-a009-231e7aa5153e admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:23.798552 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9d1f2-5efc-4644-a009-231e7aa5153e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:23.798863 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9d1f2-5efc-4644-a009-231e7aa5153e admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:23.799644 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9d1f2-5efc-4644-a009-231e7aa5153e admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:23.799943 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9d1f2-5efc-4644-a009-231e7aa5153e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:23.826445 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9d1f2-5efc-4644-a009-231e7aa5153e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:23.854277 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 360/720] 10.222.0.37 () {56 vars in 1158 bytes} [Wed Dec 29 20:38:23 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:38:23.859749 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28727f9e-3d8d-4c16-a5cb-691e120c0963 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:23.870175 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28727f9e-3d8d-4c16-a5cb-691e120c0963 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:23.874141 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8cb30-7708-483f-a8ae-e8896e109e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:23.874645 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8cb30-7708-483f-a8ae-e8896e109e5e admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:23.874958 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8cb30-7708-483f-a8ae-e8896e109e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:23.875234 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8cb30-7708-483f-a8ae-e8896e109e5e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:23.882642 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8cb30-7708-483f-a8ae-e8896e109e5e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:23.908534 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8cb30-7708-483f-a8ae-e8896e109e5e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:23.916968 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 361/721] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:38:23 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:38:23.922249 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9d1f2-5efc-4644-a009-231e7aa5153e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:23.931814 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9d1f2-5efc-4644-a009-231e7aa5153e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:23.935756 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e539983-1453-4f70-9d7f-87b3803fe24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:23.936455 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e539983-1453-4f70-9d7f-87b3803fe24e admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:23.936737 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e539983-1453-4f70-9d7f-87b3803fe24e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:23.937013 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e539983-1453-4f70-9d7f-87b3803fe24e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:23.949184 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e539983-1453-4f70-9d7f-87b3803fe24e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:23.974455 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e539983-1453-4f70-9d7f-87b3803fe24e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:23.990533 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-4e539983-1453-4f70-9d7f-87b3803fe24e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:38:23.991592 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 361/722] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:38:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:23.997353 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8cb30-7708-483f-a8ae-e8896e109e5e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:24.005636 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8cb30-7708-483f-a8ae-e8896e109e5e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:24.010277 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25f649-94c9-4c4d-bc55-f9e1c12c5b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:24.010869 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25f649-94c9-4c4d-bc55-f9e1c12c5b51 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:24.011156 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25f649-94c9-4c4d-bc55-f9e1c12c5b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:24.011432 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25f649-94c9-4c4d-bc55-f9e1c12c5b51 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:24.012099 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25f649-94c9-4c4d-bc55-f9e1c12c5b51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:24.012396 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25f649-94c9-4c4d-bc55-f9e1c12c5b51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:24.037266 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25f649-94c9-4c4d-bc55-f9e1c12c5b51 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:24.051709 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 362/723] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:38:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:24.057450 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e539983-1453-4f70-9d7f-87b3803fe24e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:24.066382 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e539983-1453-4f70-9d7f-87b3803fe24e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:24.070287 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260253ba-e050-4c39-aca3-d489463b3e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:24.071014 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260253ba-e050-4c39-aca3-d489463b3e42 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:24.071322 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260253ba-e050-4c39-aca3-d489463b3e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:24.071590 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260253ba-e050-4c39-aca3-d489463b3e42 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:24.080444 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260253ba-e050-4c39-aca3-d489463b3e42 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:24.106315 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260253ba-e050-4c39-aca3-d489463b3e42 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:24.119787 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-260253ba-e050-4c39-aca3-d489463b3e42 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:38:24.120798 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 362/724] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:38:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:24.126267 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25f649-94c9-4c4d-bc55-f9e1c12c5b51 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:24.135275 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25f649-94c9-4c4d-bc55-f9e1c12c5b51 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:24.139152 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd4cf7-b75d-49a9-ad78-e5550904851c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:24.139712 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd4cf7-b75d-49a9-ad78-e5550904851c admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:24.139994 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd4cf7-b75d-49a9-ad78-e5550904851c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:24.140269 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd4cf7-b75d-49a9-ad78-e5550904851c admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:24.140995 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd4cf7-b75d-49a9-ad78-e5550904851c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:24.141288 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd4cf7-b75d-49a9-ad78-e5550904851c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:24.167361 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd4cf7-b75d-49a9-ad78-e5550904851c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:24.179953 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 363/725] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:38:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:24.186562 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260253ba-e050-4c39-aca3-d489463b3e42 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:24.195411 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260253ba-e050-4c39-aca3-d489463b3e42 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:24.199796 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474bd29-3adb-4f2f-812e-a319435db8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:24.200348 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474bd29-3adb-4f2f-812e-a319435db8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:24.200631 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474bd29-3adb-4f2f-812e-a319435db8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:24.200905 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474bd29-3adb-4f2f-812e-a319435db8e2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:24.201666 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474bd29-3adb-4f2f-812e-a319435db8e2 admin admin] RBAC: Adding query filter params (role.id=1c5a8286caa54ded9e44ef97f73f6776, scope.project.id=ed634cf9bb9146f7a9738325a8638b70, user.id=72f5c4b1a0e942ae9a16cda3b34e0cc0) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:24.201962 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474bd29-3adb-4f2f-812e-a319435db8e2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:24.227167 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474bd29-3adb-4f2f-812e-a319435db8e2 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:24.233289 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 363/726] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:38:24 2021] GET /identity/v3/role_assignments?user.id=72f5c4b1a0e942ae9a16cda3b34e0cc0&scope.project.id=ed634cf9bb9146f7a9738325a8638b70&role.id=1c5a8286caa54ded9e44ef97f73f6776 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:26.194620 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9df2e1-c5b4-49ca-99da-0237415f719a None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:26.195160 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9df2e1-c5b4-49ca-99da-0237415f719a None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:26.195160 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9df2e1-c5b4-49ca-99da-0237415f719a None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:26.196909 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 364/727] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:38:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:38:26.202157 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6147c-fecd-4c77-9d55-979d809c581f None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:26.202588 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6147c-fecd-4c77-9d55-979d809c581f None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:26.202734 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6147c-fecd-4c77-9d55-979d809c581f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:26.224987 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-6ec6147c-fecd-4c77-9d55-979d809c581f None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:38:26.226098 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-6ec6147c-fecd-4c77-9d55-979d809c581f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:38:26.233468 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 364/728] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:38:26 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:38:26.254870 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9df2e1-c5b4-49ca-99da-0237415f719a None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:26.266630 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9df2e1-c5b4-49ca-99da-0237415f719a None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:26.270442 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049642d4-a609-4c8f-b79f-904bd5bd4383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:26.271177 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049642d4-a609-4c8f-b79f-904bd5bd4383 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:26.271462 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049642d4-a609-4c8f-b79f-904bd5bd4383 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:26.271737 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049642d4-a609-4c8f-b79f-904bd5bd4383 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:26.272351 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049642d4-a609-4c8f-b79f-904bd5bd4383 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:26.298469 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049642d4-a609-4c8f-b79f-904bd5bd4383 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:26.309000 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-049642d4-a609-4c8f-b79f-904bd5bd4383 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 29 20:38:26.310027 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 365/729] 10.222.0.37 () {56 vars in 1150 bytes} [Wed Dec 29 20:38:26 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:26.315433 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6147c-fecd-4c77-9d55-979d809c581f None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:26.324838 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6147c-fecd-4c77-9d55-979d809c581f None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:26.328938 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1f932-779c-4e7b-a34e-81d8d84d4880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:26.329519 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1f932-779c-4e7b-a34e-81d8d84d4880 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:26.329804 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1f932-779c-4e7b-a34e-81d8d84d4880 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:26.330079 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1f932-779c-4e7b-a34e-81d8d84d4880 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:26.330781 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1f932-779c-4e7b-a34e-81d8d84d4880 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:26.331078 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1f932-779c-4e7b-a34e-81d8d84d4880 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:26.356850 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1f932-779c-4e7b-a34e-81d8d84d4880 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:26.361253 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 365/730] 10.222.0.37 () {56 vars in 1145 bytes} [Wed Dec 29 20:38:26 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:26.366265 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049642d4-a609-4c8f-b79f-904bd5bd4383 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:26.375275 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049642d4-a609-4c8f-b79f-904bd5bd4383 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:26.379188 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186c2dd-0e0b-4098-ad54-5021f6d0f81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:26.379751 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186c2dd-0e0b-4098-ad54-5021f6d0f81b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:26.380040 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186c2dd-0e0b-4098-ad54-5021f6d0f81b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:26.380321 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186c2dd-0e0b-4098-ad54-5021f6d0f81b admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:26.380976 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186c2dd-0e0b-4098-ad54-5021f6d0f81b admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:26.381272 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186c2dd-0e0b-4098-ad54-5021f6d0f81b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:26.407515 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186c2dd-0e0b-4098-ad54-5021f6d0f81b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:26.411656 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 366/731] 10.222.0.37 () {56 vars in 1145 bytes} [Wed Dec 29 20:38:26 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:38:28.357086 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd9dc9-90db-4db8-83df-be72853a4499 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:28.357639 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd9dc9-90db-4db8-83df-be72853a4499 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:28.357639 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd9dc9-90db-4db8-83df-be72853a4499 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:28.359322 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 366/732] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:38:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:38:28.364309 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b8592-62a9-4df2-9fb3-262b2a011484 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:28.364732 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b8592-62a9-4df2-9fb3-262b2a011484 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:28.364869 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b8592-62a9-4df2-9fb3-262b2a011484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:28.387501 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-f49b8592-62a9-4df2-9fb3-262b2a011484 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:38:28.388614 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-f49b8592-62a9-4df2-9fb3-262b2a011484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:38:28.395076 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 367/733] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:38:28 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:38:28.416826 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd9dc9-90db-4db8-83df-be72853a4499 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:28.428033 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd9dc9-90db-4db8-83df-be72853a4499 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:28.432380 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cff523-5f21-4a81-81e3-514226d4896c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:28.432949 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cff523-5f21-4a81-81e3-514226d4896c admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:28.433235 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cff523-5f21-4a81-81e3-514226d4896c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:28.433511 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cff523-5f21-4a81-81e3-514226d4896c admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:28.434184 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cff523-5f21-4a81-81e3-514226d4896c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:28.460252 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cff523-5f21-4a81-81e3-514226d4896c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:28.472957 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 367/734] 10.222.0.37 () {60 vars in 1162 bytes} [Wed Dec 29 20:38:28 2021] POST /identity/v3/services => generated 251 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:38:30.425572 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330a64e-5773-480f-a8f5-3985b778dddd None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:30.426113 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330a64e-5773-480f-a8f5-3985b778dddd None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:30.426113 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330a64e-5773-480f-a8f5-3985b778dddd None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:30.427828 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 368/735] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:38:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:38:30.433463 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a1e4c-ee6a-458e-a0c5-a8296dbc270c None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:30.433886 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a1e4c-ee6a-458e-a0c5-a8296dbc270c None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:30.434019 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a1e4c-ee6a-458e-a0c5-a8296dbc270c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:30.457453 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-093a1e4c-ee6a-458e-a0c5-a8296dbc270c None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:38:30.458576 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-093a1e4c-ee6a-458e-a0c5-a8296dbc270c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:38:30.474808 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 368/736] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:38:30 2021] POST /identity/v3/auth/tokens => generated 1965 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:38:30.497183 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330a64e-5773-480f-a8f5-3985b778dddd None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:30.508578 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330a64e-5773-480f-a8f5-3985b778dddd None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:30.512489 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20326a-bdac-4b8d-b9e3-07c062fa0ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:30.513204 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20326a-bdac-4b8d-b9e3-07c062fa0ead admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:30.513493 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20326a-bdac-4b8d-b9e3-07c062fa0ead admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:30.513774 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20326a-bdac-4b8d-b9e3-07c062fa0ead admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:30.514390 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20326a-bdac-4b8d-b9e3-07c062fa0ead admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:30.541093 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20326a-bdac-4b8d-b9e3-07c062fa0ead admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:30.551452 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-9e20326a-bdac-4b8d-b9e3-07c062fa0ead admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 29 20:38:30.552481 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 369/737] 10.222.0.37 () {56 vars in 1150 bytes} [Wed Dec 29 20:38:30 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:30.557859 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a1e4c-ee6a-458e-a0c5-a8296dbc270c None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:30.566117 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a1e4c-ee6a-458e-a0c5-a8296dbc270c None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:30.570014 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d5fec-6c9d-49f4-a063-3338b065bcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:30.570583 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d5fec-6c9d-49f4-a063-3338b065bcc7 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:30.571035 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d5fec-6c9d-49f4-a063-3338b065bcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:30.571372 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d5fec-6c9d-49f4-a063-3338b065bcc7 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:30.572034 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d5fec-6c9d-49f4-a063-3338b065bcc7 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:30.572594 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d5fec-6c9d-49f4-a063-3338b065bcc7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:30.598161 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d5fec-6c9d-49f4-a063-3338b065bcc7 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:30.603335 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 369/738] 10.222.0.37 () {56 vars in 1145 bytes} [Wed Dec 29 20:38:30 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:30.608539 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20326a-bdac-4b8d-b9e3-07c062fa0ead admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:30.617443 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20326a-bdac-4b8d-b9e3-07c062fa0ead admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:30.621566 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3060450-9e41-4875-9abd-4e66f44fd008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:30.622128 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3060450-9e41-4875-9abd-4e66f44fd008 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:30.622411 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3060450-9e41-4875-9abd-4e66f44fd008 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:30.622721 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3060450-9e41-4875-9abd-4e66f44fd008 admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:30.623379 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3060450-9e41-4875-9abd-4e66f44fd008 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:30.623672 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3060450-9e41-4875-9abd-4e66f44fd008 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:30.649473 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3060450-9e41-4875-9abd-4e66f44fd008 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:30.654113 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 370/739] 10.222.0.37 () {56 vars in 1145 bytes} [Wed Dec 29 20:38:30 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:30.659269 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d5fec-6c9d-49f4-a063-3338b065bcc7 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:30.669014 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d5fec-6c9d-49f4-a063-3338b065bcc7 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:30.673097 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a923b-8523-4991-a464-1eb167f5d1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:30.673662 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a923b-8523-4991-a464-1eb167f5d1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:30.673951 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a923b-8523-4991-a464-1eb167f5d1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:30.674235 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a923b-8523-4991-a464-1eb167f5d1c6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:30.675011 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a923b-8523-4991-a464-1eb167f5d1c6 admin admin] RBAC: Adding query filter params (interface=public, service_id=f218ebe7f84e4bf5a8ba133c28ff26df, region_id=RegionOne) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:30.675313 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a923b-8523-4991-a464-1eb167f5d1c6 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:30.701074 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a923b-8523-4991-a464-1eb167f5d1c6 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:30.706034 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 370/740] 10.222.0.37 () {56 vars in 1272 bytes} [Wed Dec 29 20:38:30 2021] GET /identity/v3/endpoints?service_id=f218ebe7f84e4bf5a8ba133c28ff26df&interface=public®ion_id=RegionOne => generated 194 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:38:30.711038 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3060450-9e41-4875-9abd-4e66f44fd008 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:30.720379 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3060450-9e41-4875-9abd-4e66f44fd008 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:30.724250 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6169a-29a9-4408-bdbc-c8cd71d9d764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:30.724814 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6169a-29a9-4408-bdbc-c8cd71d9d764 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:30.725104 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6169a-29a9-4408-bdbc-c8cd71d9d764 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:30.725379 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6169a-29a9-4408-bdbc-c8cd71d9d764 admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:30.725999 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6169a-29a9-4408-bdbc-c8cd71d9d764 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:30.751430 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6169a-29a9-4408-bdbc-c8cd71d9d764 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:30.756834 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 371/741] 10.222.0.37 () {56 vars in 1108 bytes} [Wed Dec 29 20:38:30 2021] GET /identity/v3/services => generated 1261 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:38:32.787275 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb87350-5d7e-448d-b5c2-cc94b3755991 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:32.787826 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb87350-5d7e-448d-b5c2-cc94b3755991 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:32.787826 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb87350-5d7e-448d-b5c2-cc94b3755991 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:32.790178 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 371/742] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:38:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:38:32.795158 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ad526-b7e8-4dad-adc6-e2adb442bfc7 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:32.795567 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ad526-b7e8-4dad-adc6-e2adb442bfc7 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:32.795728 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ad526-b7e8-4dad-adc6-e2adb442bfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:32.817674 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-2e3ad526-b7e8-4dad-adc6-e2adb442bfc7 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:38:32.818821 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-2e3ad526-b7e8-4dad-adc6-e2adb442bfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:38:32.825694 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 372/743] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:38:32 2021] POST /identity/v3/auth/tokens => generated 1965 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:38:32.848681 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb87350-5d7e-448d-b5c2-cc94b3755991 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:32.860880 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb87350-5d7e-448d-b5c2-cc94b3755991 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:32.864825 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e597c15-1a62-4ce5-928e-3c768d7d9463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:32.865548 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e597c15-1a62-4ce5-928e-3c768d7d9463 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:32.865836 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e597c15-1a62-4ce5-928e-3c768d7d9463 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:32.866118 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e597c15-1a62-4ce5-928e-3c768d7d9463 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:32.866770 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e597c15-1a62-4ce5-928e-3c768d7d9463 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:32.891977 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e597c15-1a62-4ce5-928e-3c768d7d9463 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:32.903076 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-3e597c15-1a62-4ce5-928e-3c768d7d9463 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 29 20:38:32.904123 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 372/744] 10.222.0.37 () {56 vars in 1150 bytes} [Wed Dec 29 20:38:32 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:32.909715 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ad526-b7e8-4dad-adc6-e2adb442bfc7 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:32.918987 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ad526-b7e8-4dad-adc6-e2adb442bfc7 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:32.922977 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c62d1f-e3b9-4765-94f9-6c01e2e48914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:32.923557 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c62d1f-e3b9-4765-94f9-6c01e2e48914 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:32.923849 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c62d1f-e3b9-4765-94f9-6c01e2e48914 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:32.924133 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c62d1f-e3b9-4765-94f9-6c01e2e48914 admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:32.924798 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c62d1f-e3b9-4765-94f9-6c01e2e48914 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:32.925099 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c62d1f-e3b9-4765-94f9-6c01e2e48914 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:32.950886 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c62d1f-e3b9-4765-94f9-6c01e2e48914 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:32.955376 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 373/745] 10.222.0.37 () {56 vars in 1145 bytes} [Wed Dec 29 20:38:32 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:32.960637 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e597c15-1a62-4ce5-928e-3c768d7d9463 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:32.970264 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e597c15-1a62-4ce5-928e-3c768d7d9463 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:32.974289 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bab09f-2291-4288-9acf-2ea717a71d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:32.974897 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bab09f-2291-4288-9acf-2ea717a71d4b admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:32.975186 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bab09f-2291-4288-9acf-2ea717a71d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:32.975467 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bab09f-2291-4288-9acf-2ea717a71d4b admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:32.976131 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bab09f-2291-4288-9acf-2ea717a71d4b admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:32.976428 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bab09f-2291-4288-9acf-2ea717a71d4b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:33.002186 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bab09f-2291-4288-9acf-2ea717a71d4b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:33.006873 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 373/746] 10.222.0.37 () {56 vars in 1145 bytes} [Wed Dec 29 20:38:32 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:38:33.012156 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c62d1f-e3b9-4765-94f9-6c01e2e48914 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:33.021147 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c62d1f-e3b9-4765-94f9-6c01e2e48914 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:33.025735 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1d23e-1bb0-4026-8731-96ddd0b37d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:33.026300 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1d23e-1bb0-4026-8731-96ddd0b37d60 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:33.026588 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1d23e-1bb0-4026-8731-96ddd0b37d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:33.026898 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1d23e-1bb0-4026-8731-96ddd0b37d60 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:33.027570 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1d23e-1bb0-4026-8731-96ddd0b37d60 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:33.053239 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1d23e-1bb0-4026-8731-96ddd0b37d60 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:33.071550 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 374/747] 10.222.0.37 () {60 vars in 1165 bytes} [Wed Dec 29 20:38:33 2021] POST /identity/v3/endpoints => generated 346 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:38:35.038566 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b79ec-9297-4dd6-9b2c-2b2068e04268 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:35.039094 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b79ec-9297-4dd6-9b2c-2b2068e04268 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:35.039252 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b79ec-9297-4dd6-9b2c-2b2068e04268 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:35.040892 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 374/748] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:38:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:38:35.046115 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ea57b-cb93-4262-b984-c8457457989c None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:35.046532 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ea57b-cb93-4262-b984-c8457457989c None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:35.046697 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ea57b-cb93-4262-b984-c8457457989c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:35.068947 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-aa7ea57b-cb93-4262-b984-c8457457989c None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:38:35.070074 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-aa7ea57b-cb93-4262-b984-c8457457989c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:38:35.088058 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 375/749] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:38:35 2021] POST /identity/v3/auth/tokens => generated 2151 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:38:35.109007 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b79ec-9297-4dd6-9b2c-2b2068e04268 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:35.121164 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b79ec-9297-4dd6-9b2c-2b2068e04268 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:35.124953 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019548a-845f-47ba-9b13-8d83df5e7b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:35.125689 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019548a-845f-47ba-9b13-8d83df5e7b82 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:35.125981 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019548a-845f-47ba-9b13-8d83df5e7b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:35.126259 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019548a-845f-47ba-9b13-8d83df5e7b82 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:35.126907 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019548a-845f-47ba-9b13-8d83df5e7b82 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:35.152709 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019548a-845f-47ba-9b13-8d83df5e7b82 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:35.162886 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-0019548a-845f-47ba-9b13-8d83df5e7b82 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Dec 29 20:38:35.163911 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 375/750] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:38:35 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:35.169385 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ea57b-cb93-4262-b984-c8457457989c None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:35.177855 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ea57b-cb93-4262-b984-c8457457989c None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:35.182301 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b743d-4a8a-44d3-a39f-21165edccf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:35.182909 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b743d-4a8a-44d3-a39f-21165edccf8c admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:35.183200 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b743d-4a8a-44d3-a39f-21165edccf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:35.183482 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b743d-4a8a-44d3-a39f-21165edccf8c admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:35.184145 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b743d-4a8a-44d3-a39f-21165edccf8c admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:35.184441 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b743d-4a8a-44d3-a39f-21165edccf8c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:35.210217 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b743d-4a8a-44d3-a39f-21165edccf8c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:35.214760 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 376/751] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:38:35 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:35.220000 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019548a-845f-47ba-9b13-8d83df5e7b82 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:35.230032 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019548a-845f-47ba-9b13-8d83df5e7b82 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:35.234044 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e6d48-eed6-4936-88ec-ae65a1e3ffd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:35.234613 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e6d48-eed6-4936-88ec-ae65a1e3ffd8 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:35.234935 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e6d48-eed6-4936-88ec-ae65a1e3ffd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:35.235219 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e6d48-eed6-4936-88ec-ae65a1e3ffd8 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:35.235880 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e6d48-eed6-4936-88ec-ae65a1e3ffd8 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:35.236226 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e6d48-eed6-4936-88ec-ae65a1e3ffd8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:35.262269 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e6d48-eed6-4936-88ec-ae65a1e3ffd8 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:35.266419 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 376/752] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:38:35 2021] GET /identity/v3/services?type=volumev2 => generated 125 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:37.196444 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ceecf-2a8a-48f2-9f03-e307b01e3bcd None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:37.196950 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ceecf-2a8a-48f2-9f03-e307b01e3bcd None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:37.196950 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ceecf-2a8a-48f2-9f03-e307b01e3bcd None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:37.198855 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 377/753] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:38:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:38:37.203983 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335b270-3e75-4650-9149-1a6f2999da81 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:37.204364 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335b270-3e75-4650-9149-1a6f2999da81 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:37.204554 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335b270-3e75-4650-9149-1a6f2999da81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:37.227739 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-3335b270-3e75-4650-9149-1a6f2999da81 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:38:37.228875 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-3335b270-3e75-4650-9149-1a6f2999da81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:38:37.235692 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 377/754] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:38:37 2021] POST /identity/v3/auth/tokens => generated 2151 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:38:37.257254 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ceecf-2a8a-48f2-9f03-e307b01e3bcd None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:37.268653 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ceecf-2a8a-48f2-9f03-e307b01e3bcd None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:37.272434 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b18c23-e9e9-49b4-b759-87bcaedbc134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:37.272998 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b18c23-e9e9-49b4-b759-87bcaedbc134 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:37.273282 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b18c23-e9e9-49b4-b759-87bcaedbc134 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:37.274100 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b18c23-e9e9-49b4-b759-87bcaedbc134 admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:37.274932 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b18c23-e9e9-49b4-b759-87bcaedbc134 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:37.300274 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b18c23-e9e9-49b4-b759-87bcaedbc134 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:37.312813 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 378/755] 10.222.0.37 () {60 vars in 1162 bytes} [Wed Dec 29 20:38:37 2021] POST /identity/v3/services => generated 251 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:38:39.257726 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1f670-142d-490d-bcf1-2afdb8936b33 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:39.258237 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1f670-142d-490d-bcf1-2afdb8936b33 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:39.258237 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1f670-142d-490d-bcf1-2afdb8936b33 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:39.259904 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 378/756] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:38:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:38:39.264966 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b332604-32a1-4d8e-8b09-e1591383b62e None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:39.265390 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b332604-32a1-4d8e-8b09-e1591383b62e None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:39.265530 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b332604-32a1-4d8e-8b09-e1591383b62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:39.287234 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-3b332604-32a1-4d8e-8b09-e1591383b62e None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:38:39.288353 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-3b332604-32a1-4d8e-8b09-e1591383b62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:38:39.305615 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 379/757] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:38:39 2021] POST /identity/v3/auth/tokens => generated 2252 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:38:39.327374 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1f670-142d-490d-bcf1-2afdb8936b33 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:39.338943 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1f670-142d-490d-bcf1-2afdb8936b33 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:39.342802 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae806ca-0fac-4760-91be-f10cd1981ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:39.343510 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae806ca-0fac-4760-91be-f10cd1981ffa admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:39.343796 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae806ca-0fac-4760-91be-f10cd1981ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:39.344074 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae806ca-0fac-4760-91be-f10cd1981ffa admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:39.344695 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae806ca-0fac-4760-91be-f10cd1981ffa admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:39.371581 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae806ca-0fac-4760-91be-f10cd1981ffa admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:39.381846 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-3ae806ca-0fac-4760-91be-f10cd1981ffa admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Dec 29 20:38:39.383649 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 379/758] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:38:39 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:39.389126 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b332604-32a1-4d8e-8b09-e1591383b62e None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:39.397535 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b332604-32a1-4d8e-8b09-e1591383b62e None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:39.402030 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006841d-b19d-46fe-ae6c-9a7cbd52ec47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:39.402599 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006841d-b19d-46fe-ae6c-9a7cbd52ec47 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:39.402918 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006841d-b19d-46fe-ae6c-9a7cbd52ec47 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:39.403197 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006841d-b19d-46fe-ae6c-9a7cbd52ec47 admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:39.403854 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006841d-b19d-46fe-ae6c-9a7cbd52ec47 admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:39.404148 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006841d-b19d-46fe-ae6c-9a7cbd52ec47 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:39.430843 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006841d-b19d-46fe-ae6c-9a7cbd52ec47 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:39.435311 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 380/759] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:38:39 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:39.440516 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae806ca-0fac-4760-91be-f10cd1981ffa admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:39.450881 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae806ca-0fac-4760-91be-f10cd1981ffa admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:39.454865 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6addb-99b4-419e-bcb7-b7321461a651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:39.455435 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6addb-99b4-419e-bcb7-b7321461a651 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:39.455716 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6addb-99b4-419e-bcb7-b7321461a651 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:39.455992 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6addb-99b4-419e-bcb7-b7321461a651 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:39.456652 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6addb-99b4-419e-bcb7-b7321461a651 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:39.456947 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6addb-99b4-419e-bcb7-b7321461a651 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:39.482322 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6addb-99b4-419e-bcb7-b7321461a651 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:39.486879 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 380/760] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:38:39 2021] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:39.492746 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006841d-b19d-46fe-ae6c-9a7cbd52ec47 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:39.501726 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006841d-b19d-46fe-ae6c-9a7cbd52ec47 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:39.505653 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b02161-b8d0-4dbd-9646-2e0988a0c22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:39.506215 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b02161-b8d0-4dbd-9646-2e0988a0c22c admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:39.506500 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b02161-b8d0-4dbd-9646-2e0988a0c22c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:39.506824 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b02161-b8d0-4dbd-9646-2e0988a0c22c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:39.507554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b02161-b8d0-4dbd-9646-2e0988a0c22c admin admin] RBAC: Adding query filter params (interface=public, service_id=2519518b407a4672a832b8cf7ca66cf5, region_id=RegionOne) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:39.508568 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b02161-b8d0-4dbd-9646-2e0988a0c22c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:39.533691 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b02161-b8d0-4dbd-9646-2e0988a0c22c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:39.538726 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 381/761] 10.222.0.37 () {56 vars in 1272 bytes} [Wed Dec 29 20:38:39 2021] GET /identity/v3/endpoints?service_id=2519518b407a4672a832b8cf7ca66cf5&interface=public®ion_id=RegionOne => generated 194 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:39.543761 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6addb-99b4-419e-bcb7-b7321461a651 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:39.552542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6addb-99b4-419e-bcb7-b7321461a651 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:39.557005 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfb258-219a-4da4-aa38-22197cc57153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:39.557567 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfb258-219a-4da4-aa38-22197cc57153 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:39.557849 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfb258-219a-4da4-aa38-22197cc57153 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:39.558127 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfb258-219a-4da4-aa38-22197cc57153 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:39.558805 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfb258-219a-4da4-aa38-22197cc57153 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:39.585076 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfb258-219a-4da4-aa38-22197cc57153 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:39.591194 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 381/762] 10.222.0.37 () {56 vars in 1108 bytes} [Wed Dec 29 20:38:39 2021] GET /identity/v3/services => generated 1500 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:38:41.507104 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f094a-366a-4d20-96a5-4ddd1e5b4c8d None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:41.507679 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f094a-366a-4d20-96a5-4ddd1e5b4c8d None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:41.507679 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f094a-366a-4d20-96a5-4ddd1e5b4c8d None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:41.509445 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 382/763] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:38:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:38:41.514425 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac7a4b-23b4-4454-9fc3-45740a887f72 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:41.514856 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac7a4b-23b4-4454-9fc3-45740a887f72 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:41.515014 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac7a4b-23b4-4454-9fc3-45740a887f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:41.536915 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-3dac7a4b-23b4-4454-9fc3-45740a887f72 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:38:41.538025 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-3dac7a4b-23b4-4454-9fc3-45740a887f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:38:41.545103 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 382/764] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:38:41 2021] POST /identity/v3/auth/tokens => generated 2252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:38:41.566968 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f094a-366a-4d20-96a5-4ddd1e5b4c8d None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:41.578478 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f094a-366a-4d20-96a5-4ddd1e5b4c8d None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:41.582299 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841a236-62b4-4384-8c2a-d7cce0e6d3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:41.583024 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841a236-62b4-4384-8c2a-d7cce0e6d3ec admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:41.583308 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841a236-62b4-4384-8c2a-d7cce0e6d3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:41.583586 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841a236-62b4-4384-8c2a-d7cce0e6d3ec admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:41.584202 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841a236-62b4-4384-8c2a-d7cce0e6d3ec admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:41.621495 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841a236-62b4-4384-8c2a-d7cce0e6d3ec admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:41.631622 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-2841a236-62b4-4384-8c2a-d7cce0e6d3ec admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Dec 29 20:38:41.632880 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 383/765] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:38:41 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:41.638306 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac7a4b-23b4-4454-9fc3-45740a887f72 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:41.646685 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac7a4b-23b4-4454-9fc3-45740a887f72 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:41.650802 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cb9e3-292f-4631-bb1a-cfa02b0ebcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:41.651373 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cb9e3-292f-4631-bb1a-cfa02b0ebcfd admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:41.651657 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cb9e3-292f-4631-bb1a-cfa02b0ebcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:41.651933 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cb9e3-292f-4631-bb1a-cfa02b0ebcfd admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:41.652596 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cb9e3-292f-4631-bb1a-cfa02b0ebcfd admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:41.652886 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cb9e3-292f-4631-bb1a-cfa02b0ebcfd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:41.678526 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cb9e3-292f-4631-bb1a-cfa02b0ebcfd admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:41.683547 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 383/766] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:38:41 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:41.688643 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841a236-62b4-4384-8c2a-d7cce0e6d3ec admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:41.697818 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841a236-62b4-4384-8c2a-d7cce0e6d3ec admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:41.701732 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff829e-83f6-43bc-bb12-ea76a9dbd995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:41.702292 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff829e-83f6-43bc-bb12-ea76a9dbd995 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:41.702575 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff829e-83f6-43bc-bb12-ea76a9dbd995 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:41.702893 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff829e-83f6-43bc-bb12-ea76a9dbd995 admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:41.703549 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff829e-83f6-43bc-bb12-ea76a9dbd995 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:41.703844 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff829e-83f6-43bc-bb12-ea76a9dbd995 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:41.730076 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff829e-83f6-43bc-bb12-ea76a9dbd995 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:41.734554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 384/767] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:38:41 2021] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:38:41.739797 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cb9e3-292f-4631-bb1a-cfa02b0ebcfd admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:41.748896 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cb9e3-292f-4631-bb1a-cfa02b0ebcfd admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:41.752846 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a7fce-36c1-4e00-b049-452bf1ba904e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:41.753402 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a7fce-36c1-4e00-b049-452bf1ba904e admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:41.753687 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a7fce-36c1-4e00-b049-452bf1ba904e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:41.753964 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a7fce-36c1-4e00-b049-452bf1ba904e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:41.754645 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a7fce-36c1-4e00-b049-452bf1ba904e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:41.780247 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a7fce-36c1-4e00-b049-452bf1ba904e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:41.797310 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 384/768] 10.222.0.37 () {60 vars in 1165 bytes} [Wed Dec 29 20:38:41 2021] POST /identity/v3/endpoints => generated 346 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:38:43.746210 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a505edf-1ce2-48f4-9f7e-807b3c1173d6 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:43.746774 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a505edf-1ce2-48f4-9f7e-807b3c1173d6 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:43.746865 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a505edf-1ce2-48f4-9f7e-807b3c1173d6 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:43.748462 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 385/769] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:38:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:38:43.753536 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544d514-60be-4f8d-a51f-6256d550f3b5 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:43.753913 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544d514-60be-4f8d-a51f-6256d550f3b5 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:43.754101 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544d514-60be-4f8d-a51f-6256d550f3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:43.775802 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-6544d514-60be-4f8d-a51f-6256d550f3b5 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:38:43.776913 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-6544d514-60be-4f8d-a51f-6256d550f3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:38:43.793418 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 385/770] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:38:43 2021] POST /identity/v3/auth/tokens => generated 2438 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:38:43.814779 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a505edf-1ce2-48f4-9f7e-807b3c1173d6 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:43.826615 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a505edf-1ce2-48f4-9f7e-807b3c1173d6 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:43.830464 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fe262-a01c-4db3-80c4-f838fa933ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:43.831195 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fe262-a01c-4db3-80c4-f838fa933ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:43.831483 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fe262-a01c-4db3-80c4-f838fa933ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:43.831760 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fe262-a01c-4db3-80c4-f838fa933ea4 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:43.832366 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99fe262-a01c-4db3-80c4-f838fa933ea4 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:43.857935 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99fe262-a01c-4db3-80c4-f838fa933ea4 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:43.868994 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-b99fe262-a01c-4db3-80c4-f838fa933ea4 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 29 20:38:43.870055 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 386/771] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:38:43 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:43.875928 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544d514-60be-4f8d-a51f-6256d550f3b5 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:43.884619 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544d514-60be-4f8d-a51f-6256d550f3b5 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:43.888656 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10390531-b34e-4626-97ce-08c843496ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:43.889232 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10390531-b34e-4626-97ce-08c843496ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:43.889517 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10390531-b34e-4626-97ce-08c843496ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:43.889796 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10390531-b34e-4626-97ce-08c843496ad6 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:43.890458 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10390531-b34e-4626-97ce-08c843496ad6 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:43.890779 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10390531-b34e-4626-97ce-08c843496ad6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:43.916696 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10390531-b34e-4626-97ce-08c843496ad6 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:43.921178 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 386/772] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:38:43 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:43.926451 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fe262-a01c-4db3-80c4-f838fa933ea4 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:43.937041 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fe262-a01c-4db3-80c4-f838fa933ea4 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:43.941035 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33743ce-f420-4e7c-a20e-ee3f9add3a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:43.941598 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33743ce-f420-4e7c-a20e-ee3f9add3a49 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:43.941888 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33743ce-f420-4e7c-a20e-ee3f9add3a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:43.942170 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33743ce-f420-4e7c-a20e-ee3f9add3a49 admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:43.942867 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33743ce-f420-4e7c-a20e-ee3f9add3a49 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:43.943172 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33743ce-f420-4e7c-a20e-ee3f9add3a49 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:43.969093 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33743ce-f420-4e7c-a20e-ee3f9add3a49 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:43.973236 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 387/773] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:38:43 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:38:45.890399 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7efa4a-dfb1-4160-b1ba-cbf545191cf9 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:45.890886 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7efa4a-dfb1-4160-b1ba-cbf545191cf9 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:45.890994 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7efa4a-dfb1-4160-b1ba-cbf545191cf9 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:45.892629 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 387/774] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:38:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:38:45.897657 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dae56f-df9d-4d56-815f-567171a44b72 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:45.898718 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dae56f-df9d-4d56-815f-567171a44b72 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:45.898929 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dae56f-df9d-4d56-815f-567171a44b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:45.920654 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-69dae56f-df9d-4d56-815f-567171a44b72 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:38:45.921774 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-69dae56f-df9d-4d56-815f-567171a44b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:38:45.928377 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 388/775] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:38:45 2021] POST /identity/v3/auth/tokens => generated 2438 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:38:45.951254 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7efa4a-dfb1-4160-b1ba-cbf545191cf9 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:45.963445 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7efa4a-dfb1-4160-b1ba-cbf545191cf9 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:45.967327 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ea7f8-194a-464f-9f27-88ba52828c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:45.967892 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ea7f8-194a-464f-9f27-88ba52828c23 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:45.968186 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ea7f8-194a-464f-9f27-88ba52828c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:45.968466 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ea7f8-194a-464f-9f27-88ba52828c23 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:45.969133 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ea7f8-194a-464f-9f27-88ba52828c23 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:45.994584 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ea7f8-194a-464f-9f27-88ba52828c23 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:46.006578 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 388/776] 10.222.0.37 () {60 vars in 1162 bytes} [Wed Dec 29 20:38:45 2021] POST /identity/v3/services => generated 251 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:38:47.946674 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83797913-20e9-4fe6-9d01-2137d29a2fad None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:47.947408 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83797913-20e9-4fe6-9d01-2137d29a2fad None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:47.947592 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83797913-20e9-4fe6-9d01-2137d29a2fad None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:47.949152 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 389/777] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:38:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:38:47.954103 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33ec14-76e1-4d9e-9a99-c56f2d9d2c97 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:47.954502 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33ec14-76e1-4d9e-9a99-c56f2d9d2c97 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:47.954683 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33ec14-76e1-4d9e-9a99-c56f2d9d2c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:47.976808 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-df33ec14-76e1-4d9e-9a99-c56f2d9d2c97 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:38:47.977927 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-df33ec14-76e1-4d9e-9a99-c56f2d9d2c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:38:47.994548 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 389/778] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:38:47 2021] POST /identity/v3/auth/tokens => generated 2539 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:38:48.016562 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83797913-20e9-4fe6-9d01-2137d29a2fad None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:48.027927 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83797913-20e9-4fe6-9d01-2137d29a2fad None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:48.031744 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcbdf6-805a-429b-8e51-fe870fddbc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:48.032443 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcbdf6-805a-429b-8e51-fe870fddbc2a admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:48.032730 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcbdf6-805a-429b-8e51-fe870fddbc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:48.033008 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcbdf6-805a-429b-8e51-fe870fddbc2a admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:48.033622 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dcbdf6-805a-429b-8e51-fe870fddbc2a admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:48.059790 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dcbdf6-805a-429b-8e51-fe870fddbc2a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:48.069933 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-86dcbdf6-805a-429b-8e51-fe870fddbc2a admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 29 20:38:48.070987 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 390/779] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:38:48 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:48.077033 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33ec14-76e1-4d9e-9a99-c56f2d9d2c97 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:48.085458 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33ec14-76e1-4d9e-9a99-c56f2d9d2c97 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:48.089444 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb118db-018c-44db-8a81-cec7c7e02c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:48.090025 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb118db-018c-44db-8a81-cec7c7e02c13 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:48.090312 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb118db-018c-44db-8a81-cec7c7e02c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:48.090593 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb118db-018c-44db-8a81-cec7c7e02c13 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:48.091300 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb118db-018c-44db-8a81-cec7c7e02c13 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:48.091600 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb118db-018c-44db-8a81-cec7c7e02c13 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:48.118005 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb118db-018c-44db-8a81-cec7c7e02c13 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:48.122480 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 390/780] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:38:48 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:48.127834 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcbdf6-805a-429b-8e51-fe870fddbc2a admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:48.136924 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcbdf6-805a-429b-8e51-fe870fddbc2a admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:48.140953 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373aabc3-2295-4d88-be07-f0ef764cbca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:48.141517 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373aabc3-2295-4d88-be07-f0ef764cbca4 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:48.141801 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373aabc3-2295-4d88-be07-f0ef764cbca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:48.142078 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373aabc3-2295-4d88-be07-f0ef764cbca4 admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:48.142770 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373aabc3-2295-4d88-be07-f0ef764cbca4 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:48.143066 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373aabc3-2295-4d88-be07-f0ef764cbca4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:48.168646 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373aabc3-2295-4d88-be07-f0ef764cbca4 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:48.173152 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 391/781] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:38:48 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:38:48.178509 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb118db-018c-44db-8a81-cec7c7e02c13 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:48.188148 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb118db-018c-44db-8a81-cec7c7e02c13 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:48.192152 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa41aef-70ae-44f2-83d0-de23e5080089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:48.192713 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa41aef-70ae-44f2-83d0-de23e5080089 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:48.192998 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa41aef-70ae-44f2-83d0-de23e5080089 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:48.193349 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa41aef-70ae-44f2-83d0-de23e5080089 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:48.194080 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa41aef-70ae-44f2-83d0-de23e5080089 admin admin] RBAC: Adding query filter params (interface=public, service_id=ab0c5cc1d8644701b28b5720cbea0022, region_id=RegionOne) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:48.194382 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa41aef-70ae-44f2-83d0-de23e5080089 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:48.220209 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa41aef-70ae-44f2-83d0-de23e5080089 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:48.225175 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 391/782] 10.222.0.37 () {56 vars in 1272 bytes} [Wed Dec 29 20:38:48 2021] GET /identity/v3/endpoints?service_id=ab0c5cc1d8644701b28b5720cbea0022&interface=public®ion_id=RegionOne => generated 194 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:48.230622 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373aabc3-2295-4d88-be07-f0ef764cbca4 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:48.239461 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373aabc3-2295-4d88-be07-f0ef764cbca4 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:48.243982 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d737b1-9fc5-4bc1-9d56-7ac86228b087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:48.244538 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d737b1-9fc5-4bc1-9d56-7ac86228b087 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:48.244821 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d737b1-9fc5-4bc1-9d56-7ac86228b087 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:48.245098 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d737b1-9fc5-4bc1-9d56-7ac86228b087 admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:48.245720 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d737b1-9fc5-4bc1-9d56-7ac86228b087 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:48.270490 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d737b1-9fc5-4bc1-9d56-7ac86228b087 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:48.277089 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 392/783] 10.222.0.37 () {56 vars in 1108 bytes} [Wed Dec 29 20:38:48 2021] GET /identity/v3/services => generated 1739 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:38:50.206269 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80768c-86a2-4bb6-aa5c-d42763d5ced1 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:50.206807 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80768c-86a2-4bb6-aa5c-d42763d5ced1 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:50.206807 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80768c-86a2-4bb6-aa5c-d42763d5ced1 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:50.208417 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 392/784] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:38:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:38:50.213687 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75201fe9-1af1-4c85-8ce5-f3f16831d73f None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:50.214079 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75201fe9-1af1-4c85-8ce5-f3f16831d73f None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:50.214393 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75201fe9-1af1-4c85-8ce5-f3f16831d73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:50.236289 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-75201fe9-1af1-4c85-8ce5-f3f16831d73f None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:38:50.237430 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-75201fe9-1af1-4c85-8ce5-f3f16831d73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:38:50.244636 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 393/785] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:38:50 2021] POST /identity/v3/auth/tokens => generated 2539 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:38:50.266477 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80768c-86a2-4bb6-aa5c-d42763d5ced1 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:50.278397 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80768c-86a2-4bb6-aa5c-d42763d5ced1 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:50.282243 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374517e-77a8-4bb9-be94-67249e2f78c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:50.282980 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374517e-77a8-4bb9-be94-67249e2f78c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:50.283264 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374517e-77a8-4bb9-be94-67249e2f78c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:50.283541 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374517e-77a8-4bb9-be94-67249e2f78c0 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:50.284152 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374517e-77a8-4bb9-be94-67249e2f78c0 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:50.310248 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374517e-77a8-4bb9-be94-67249e2f78c0 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:50.320302 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-2374517e-77a8-4bb9-be94-67249e2f78c0 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 29 20:38:50.321323 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 393/786] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:38:50 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:50.327136 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75201fe9-1af1-4c85-8ce5-f3f16831d73f None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:50.335675 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75201fe9-1af1-4c85-8ce5-f3f16831d73f None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:50.339913 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e61301-8295-4e9c-a949-9fbf272244ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:50.340497 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e61301-8295-4e9c-a949-9fbf272244ce admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:50.340784 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e61301-8295-4e9c-a949-9fbf272244ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:50.341065 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e61301-8295-4e9c-a949-9fbf272244ce admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:50.341729 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e61301-8295-4e9c-a949-9fbf272244ce admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:50.342026 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e61301-8295-4e9c-a949-9fbf272244ce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:50.368449 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e61301-8295-4e9c-a949-9fbf272244ce admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:50.373102 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 394/787] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:38:50 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:50.378205 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374517e-77a8-4bb9-be94-67249e2f78c0 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:50.387212 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374517e-77a8-4bb9-be94-67249e2f78c0 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:50.391213 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ccf80-ae27-4ea6-987b-65b92189b0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:50.391779 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ccf80-ae27-4ea6-987b-65b92189b0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:50.392069 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ccf80-ae27-4ea6-987b-65b92189b0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:50.392348 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ccf80-ae27-4ea6-987b-65b92189b0b6 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:50.393010 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ccf80-ae27-4ea6-987b-65b92189b0b6 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:50.393309 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ccf80-ae27-4ea6-987b-65b92189b0b6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:50.419138 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ccf80-ae27-4ea6-987b-65b92189b0b6 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:50.423701 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 394/788] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:38:50 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:50.428691 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e61301-8295-4e9c-a949-9fbf272244ce admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:50.438117 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e61301-8295-4e9c-a949-9fbf272244ce admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:50.442071 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9200c-e8ae-4f65-83b2-e64fbf104a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:50.442626 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9200c-e8ae-4f65-83b2-e64fbf104a36 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:50.442935 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9200c-e8ae-4f65-83b2-e64fbf104a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:50.443213 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9200c-e8ae-4f65-83b2-e64fbf104a36 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:50.443901 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9200c-e8ae-4f65-83b2-e64fbf104a36 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:50.469224 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9200c-e8ae-4f65-83b2-e64fbf104a36 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:50.487474 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 395/789] 10.222.0.37 () {60 vars in 1165 bytes} [Wed Dec 29 20:38:50 2021] POST /identity/v3/endpoints => generated 346 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:38:52.446561 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48a4d2-bf33-4901-aa91-da74f0bc8f51 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:52.447369 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48a4d2-bf33-4901-aa91-da74f0bc8f51 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:52.447453 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48a4d2-bf33-4901-aa91-da74f0bc8f51 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:52.449052 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 395/790] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:38:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 29 20:38:52.454124 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ea2ce-ab6b-4840-9f0a-9f76441ccb49 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:52.454555 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ea2ce-ab6b-4840-9f0a-9f76441ccb49 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:52.454723 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ea2ce-ab6b-4840-9f0a-9f76441ccb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:52.478022 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-7b8ea2ce-ab6b-4840-9f0a-9f76441ccb49 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:38:52.479183 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-7b8ea2ce-ab6b-4840-9f0a-9f76441ccb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:38:52.495478 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 396/791] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:38:52 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:38:52.517046 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48a4d2-bf33-4901-aa91-da74f0bc8f51 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:52.528898 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48a4d2-bf33-4901-aa91-da74f0bc8f51 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:52.532690 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43eccc-9faa-417b-a9b2-33015b06f4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:52.533253 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43eccc-9faa-417b-a9b2-33015b06f4f9 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:52.533534 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43eccc-9faa-417b-a9b2-33015b06f4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:52.533809 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43eccc-9faa-417b-a9b2-33015b06f4f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:52.534452 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43eccc-9faa-417b-a9b2-33015b06f4f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:52.560522 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43eccc-9faa-417b-a9b2-33015b06f4f9 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:52.561857 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.common [None req-0f43eccc-9faa-417b-a9b2-33015b06f4f9 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Dec 29 20:38:52.580298 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.sql.core [None req-0f43eccc-9faa-417b-a9b2-33015b06f4f9 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Dec 29 20:38:52.580298 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Dec 29 20:38:52.580298 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [parameters: {'id': '4d78c3eee3e34923bab8c4a57cffbfd2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Dec 29 20:38:52.580298 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66050) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Dec 29 20:38:52.594643 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-0f43eccc-9faa-417b-a9b2-33015b06f4f9 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4d78c3eee3e34923bab8c4a57cffbfd2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4d78c3eee3e34923bab8c4a57cffbfd2. Dec 29 20:38:52.595855 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 396/792] 10.222.0.37 () {60 vars in 1161 bytes} [Wed Dec 29 20:38:52 2021] POST /identity/v3/projects => generated 262 bytes in 79 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:52.601980 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ea2ce-ab6b-4840-9f0a-9f76441ccb49 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:52.610620 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ea2ce-ab6b-4840-9f0a-9f76441ccb49 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:52.614712 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78e938-0323-453b-b305-e78fdc1c9975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:52.615421 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78e938-0323-453b-b305-e78fdc1c9975 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:52.615711 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78e938-0323-453b-b305-e78fdc1c9975 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:52.615999 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78e938-0323-453b-b305-e78fdc1c9975 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:52.624008 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78e938-0323-453b-b305-e78fdc1c9975 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:52.650362 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78e938-0323-453b-b305-e78fdc1c9975 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:52.664207 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-4f78e938-0323-453b-b305-e78fdc1c9975 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:38:52.665240 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 397/793] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:38:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:52.671077 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43eccc-9faa-417b-a9b2-33015b06f4f9 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:52.680647 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43eccc-9faa-417b-a9b2-33015b06f4f9 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:52.684639 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c663d-d319-46fa-906e-db61878d0c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:52.685207 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c663d-d319-46fa-906e-db61878d0c34 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:52.685491 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c663d-d319-46fa-906e-db61878d0c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:52.685767 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c663d-d319-46fa-906e-db61878d0c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:52.686475 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c663d-d319-46fa-906e-db61878d0c34 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:52.686807 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c663d-d319-46fa-906e-db61878d0c34 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:52.714007 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c663d-d319-46fa-906e-db61878d0c34 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:52.730625 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 397/794] 10.222.0.37 () {56 vars in 1133 bytes} [Wed Dec 29 20:38:52 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:38:54.722157 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4b24c-d68b-4760-8f56-8677942d1661 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:54.722702 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4b24c-d68b-4760-8f56-8677942d1661 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:54.722793 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4b24c-d68b-4760-8f56-8677942d1661 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:54.724438 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 398/795] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:38:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:38:54.730264 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6db37-abcf-4f01-8228-b1606317d1d6 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:54.730639 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6db37-abcf-4f01-8228-b1606317d1d6 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:54.730857 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6db37-abcf-4f01-8228-b1606317d1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:54.752572 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-c8e6db37-abcf-4f01-8228-b1606317d1d6 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:38:54.754008 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-c8e6db37-abcf-4f01-8228-b1606317d1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:38:54.760830 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 398/796] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:38:54 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:38:54.784171 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4b24c-d68b-4760-8f56-8677942d1661 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:54.796037 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4b24c-d68b-4760-8f56-8677942d1661 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:54.799896 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1e8b9-418f-454c-9c13-5c6362faabb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:54.800471 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1e8b9-418f-454c-9c13-5c6362faabb7 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:54.800757 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1e8b9-418f-454c-9c13-5c6362faabb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:54.801037 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1e8b9-418f-454c-9c13-5c6362faabb7 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:54.801669 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1e8b9-418f-454c-9c13-5c6362faabb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:54.827986 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1e8b9-418f-454c-9c13-5c6362faabb7 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:54.829282 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.common [None req-33d1e8b9-418f-454c-9c13-5c6362faabb7 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Dec 29 20:38:54.842014 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.sql.core [None req-33d1e8b9-418f-454c-9c13-5c6362faabb7 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Dec 29 20:38:54.842014 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Dec 29 20:38:54.842014 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [parameters: {'user_id': '515a5d5a2078400eb5ffb943a0a3a47e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Dec 29 20:38:54.842014 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66051) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Dec 29 20:38:54.855031 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-33d1e8b9-418f-454c-9c13-5c6362faabb7 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Dec 29 20:38:54.856241 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 399/797] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:38:54 2021] POST /identity/v3/users => generated 160 bytes in 72 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:54.862239 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6db37-abcf-4f01-8228-b1606317d1d6 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:54.871068 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6db37-abcf-4f01-8228-b1606317d1d6 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:54.875091 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec886a-b9aa-4f0b-82e5-6aa56d145de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:54.875800 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec886a-b9aa-4f0b-82e5-6aa56d145de8 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:54.876087 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec886a-b9aa-4f0b-82e5-6aa56d145de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:54.876369 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec886a-b9aa-4f0b-82e5-6aa56d145de8 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:54.889395 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec886a-b9aa-4f0b-82e5-6aa56d145de8 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:54.915700 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec886a-b9aa-4f0b-82e5-6aa56d145de8 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:54.932935 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-a8ec886a-b9aa-4f0b-82e5-6aa56d145de8 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 29 20:38:54.933988 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 399/798] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:38:54 2021] GET /identity/v3/users/cinder => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:38:54.940082 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1e8b9-418f-454c-9c13-5c6362faabb7 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:54.952241 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1e8b9-418f-454c-9c13-5c6362faabb7 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:54.956304 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71dd6a-5018-4625-acfb-4853720d9492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:54.956908 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71dd6a-5018-4625-acfb-4853720d9492 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:54.957194 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71dd6a-5018-4625-acfb-4853720d9492 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:54.957477 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71dd6a-5018-4625-acfb-4853720d9492 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:54.958239 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71dd6a-5018-4625-acfb-4853720d9492 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:54.958540 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71dd6a-5018-4625-acfb-4853720d9492 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:54.985253 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71dd6a-5018-4625-acfb-4853720d9492 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:55.018142 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 400/799] 10.222.0.37 () {56 vars in 1122 bytes} [Wed Dec 29 20:38:54 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:57.043893 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e2cd8-63e9-42bf-b1ad-87e048981ef1 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:57.044427 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e2cd8-63e9-42bf-b1ad-87e048981ef1 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:57.044524 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e2cd8-63e9-42bf-b1ad-87e048981ef1 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:57.046129 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 400/800] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:38:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:38:57.051289 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615086eb-ab78-4374-a3c3-86a122e67225 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:57.051655 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615086eb-ab78-4374-a3c3-86a122e67225 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:57.051856 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615086eb-ab78-4374-a3c3-86a122e67225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:57.074913 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-615086eb-ab78-4374-a3c3-86a122e67225 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:38:57.076359 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-615086eb-ab78-4374-a3c3-86a122e67225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:38:57.082992 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 401/801] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:38:57 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:38:57.106620 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e2cd8-63e9-42bf-b1ad-87e048981ef1 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:57.118053 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e2cd8-63e9-42bf-b1ad-87e048981ef1 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:57.121875 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e22d4-15ca-45b5-b04f-9b96f490488c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:57.122574 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e22d4-15ca-45b5-b04f-9b96f490488c admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:57.122891 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e22d4-15ca-45b5-b04f-9b96f490488c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:57.123169 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e22d4-15ca-45b5-b04f-9b96f490488c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:57.135712 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e22d4-15ca-45b5-b04f-9b96f490488c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:57.161883 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e22d4-15ca-45b5-b04f-9b96f490488c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:57.178458 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-c47e22d4-15ca-45b5-b04f-9b96f490488c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:38:57.179533 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 401/802] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:38:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:57.185154 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615086eb-ab78-4374-a3c3-86a122e67225 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:57.193490 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615086eb-ab78-4374-a3c3-86a122e67225 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:57.198525 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fc7cd-1594-4581-bf52-f394905a547a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:57.199133 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fc7cd-1594-4581-bf52-f394905a547a admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:57.199420 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fc7cd-1594-4581-bf52-f394905a547a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:57.199696 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fc7cd-1594-4581-bf52-f394905a547a admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:57.200496 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66fc7cd-1594-4581-bf52-f394905a547a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:57.200792 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66fc7cd-1594-4581-bf52-f394905a547a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:57.227011 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66fc7cd-1594-4581-bf52-f394905a547a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:57.239288 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 402/803] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:38:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:57.244662 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e22d4-15ca-45b5-b04f-9b96f490488c admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:57.253705 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e22d4-15ca-45b5-b04f-9b96f490488c admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:57.258594 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd215e32-5dc3-4dbd-a1a9-8d92b5376bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:57.259202 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd215e32-5dc3-4dbd-a1a9-8d92b5376bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:57.259490 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd215e32-5dc3-4dbd-a1a9-8d92b5376bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:57.259771 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd215e32-5dc3-4dbd-a1a9-8d92b5376bc5 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:57.260424 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd215e32-5dc3-4dbd-a1a9-8d92b5376bc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:57.286343 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd215e32-5dc3-4dbd-a1a9-8d92b5376bc5 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:57.306711 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 402/804] 10.222.0.37 () {60 vars in 1153 bytes} [Wed Dec 29 20:38:57 2021] POST /identity/v3/users => generated 249 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:38:59.283565 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db218f-6020-4f4c-af65-918d08001fdd None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:59.284113 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db218f-6020-4f4c-af65-918d08001fdd None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:59.284113 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db218f-6020-4f4c-af65-918d08001fdd None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:59.285682 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 403/805] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:38:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:38:59.291451 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc61bf-e951-4ecd-8a39-3ae22acf0abf None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:59.291855 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc61bf-e951-4ecd-8a39-3ae22acf0abf None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:59.292024 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc61bf-e951-4ecd-8a39-3ae22acf0abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:59.315470 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-a1bc61bf-e951-4ecd-8a39-3ae22acf0abf None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:38:59.316608 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-a1bc61bf-e951-4ecd-8a39-3ae22acf0abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:38:59.324121 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 403/806] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:38:59 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:38:59.346512 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db218f-6020-4f4c-af65-918d08001fdd None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:59.357804 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db218f-6020-4f4c-af65-918d08001fdd None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:59.361613 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10436eb1-eab4-4934-b76f-b1bad42b4df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:59.362312 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10436eb1-eab4-4934-b76f-b1bad42b4df1 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:59.362597 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10436eb1-eab4-4934-b76f-b1bad42b4df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:59.362972 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10436eb1-eab4-4934-b76f-b1bad42b4df1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:59.373696 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10436eb1-eab4-4934-b76f-b1bad42b4df1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:38:59.379892 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-10436eb1-eab4-4934-b76f-b1bad42b4df1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 29 20:38:59.380938 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 404/807] 10.222.0.37 () {56 vars in 1123 bytes} [Wed Dec 29 20:38:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:59.386953 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc61bf-e951-4ecd-8a39-3ae22acf0abf None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:59.395257 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc61bf-e951-4ecd-8a39-3ae22acf0abf None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:59.399246 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a9900-4b31-4d31-9f0b-6dbcd7096689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:59.399822 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a9900-4b31-4d31-9f0b-6dbcd7096689 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:59.400108 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a9900-4b31-4d31-9f0b-6dbcd7096689 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:59.400387 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a9900-4b31-4d31-9f0b-6dbcd7096689 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:59.401083 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a9900-4b31-4d31-9f0b-6dbcd7096689 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:59.401376 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a9900-4b31-4d31-9f0b-6dbcd7096689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:59.427071 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a9900-4b31-4d31-9f0b-6dbcd7096689 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:59.436099 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 404/808] 10.222.0.37 () {56 vars in 1124 bytes} [Wed Dec 29 20:38:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:59.441376 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10436eb1-eab4-4934-b76f-b1bad42b4df1 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:59.451105 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10436eb1-eab4-4934-b76f-b1bad42b4df1 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:59.455067 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba0569-a0b6-4784-85e2-5ca4a658e699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:59.455754 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba0569-a0b6-4784-85e2-5ca4a658e699 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:59.456037 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba0569-a0b6-4784-85e2-5ca4a658e699 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:59.456313 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba0569-a0b6-4784-85e2-5ca4a658e699 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:59.467373 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba0569-a0b6-4784-85e2-5ca4a658e699 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:59.493587 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba0569-a0b6-4784-85e2-5ca4a658e699 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:59.510159 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-34ba0569-a0b6-4784-85e2-5ca4a658e699 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:38:59.511207 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 405/809] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:38:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:59.516467 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a9900-4b31-4d31-9f0b-6dbcd7096689 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:59.525728 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a9900-4b31-4d31-9f0b-6dbcd7096689 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:59.529683 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d5a52-9eba-42ff-8287-bc6a31439699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:59.530253 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d5a52-9eba-42ff-8287-bc6a31439699 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:59.530538 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d5a52-9eba-42ff-8287-bc6a31439699 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:59.530853 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d5a52-9eba-42ff-8287-bc6a31439699 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:59.531531 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d5a52-9eba-42ff-8287-bc6a31439699 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:59.531825 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d5a52-9eba-42ff-8287-bc6a31439699 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:59.558487 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d5a52-9eba-42ff-8287-bc6a31439699 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:59.570790 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 405/810] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:38:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:59.576186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba0569-a0b6-4784-85e2-5ca4a658e699 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:59.585270 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba0569-a0b6-4784-85e2-5ca4a658e699 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:59.589242 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d682862-a73b-4a82-9809-c4f1449004aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:59.589939 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d682862-a73b-4a82-9809-c4f1449004aa admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:59.590223 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d682862-a73b-4a82-9809-c4f1449004aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:59.590500 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d682862-a73b-4a82-9809-c4f1449004aa admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:59.603603 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d682862-a73b-4a82-9809-c4f1449004aa admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:59.629110 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d682862-a73b-4a82-9809-c4f1449004aa admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:59.646774 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-6d682862-a73b-4a82-9809-c4f1449004aa admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 29 20:38:59.648351 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 406/811] 10.222.0.37 () {56 vars in 1123 bytes} [Wed Dec 29 20:38:59 2021] GET /identity/v3/users/neutron => generated 85 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:59.653824 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d5a52-9eba-42ff-8287-bc6a31439699 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:59.662930 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d5a52-9eba-42ff-8287-bc6a31439699 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:59.666954 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600b973-673e-4b8e-bc9d-71a1b107bbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:59.667533 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600b973-673e-4b8e-bc9d-71a1b107bbc3 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:59.667819 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600b973-673e-4b8e-bc9d-71a1b107bbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:59.668095 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600b973-673e-4b8e-bc9d-71a1b107bbc3 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:59.668871 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600b973-673e-4b8e-bc9d-71a1b107bbc3 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:59.669168 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600b973-673e-4b8e-bc9d-71a1b107bbc3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:59.695810 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600b973-673e-4b8e-bc9d-71a1b107bbc3 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:59.723860 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 406/812] 10.222.0.37 () {56 vars in 1160 bytes} [Wed Dec 29 20:38:59 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:59.729560 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d682862-a73b-4a82-9809-c4f1449004aa admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:59.738631 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d682862-a73b-4a82-9809-c4f1449004aa admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:59.743383 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d4dfd-e9f9-4620-83cb-2ec1de4d8e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:59.743956 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d4dfd-e9f9-4620-83cb-2ec1de4d8e7e admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:59.744226 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d4dfd-e9f9-4620-83cb-2ec1de4d8e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:59.744503 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d4dfd-e9f9-4620-83cb-2ec1de4d8e7e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:59.752132 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d4dfd-e9f9-4620-83cb-2ec1de4d8e7e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:59.778443 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d4dfd-e9f9-4620-83cb-2ec1de4d8e7e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:59.788003 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 407/813] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:38:59 2021] GET /identity/v3/auth/tokens => generated 2725 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:38:59.793590 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600b973-673e-4b8e-bc9d-71a1b107bbc3 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:59.802684 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600b973-673e-4b8e-bc9d-71a1b107bbc3 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:59.807461 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f7895-ecb3-4633-954a-f43149ae85ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:59.808170 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f7895-ecb3-4633-954a-f43149ae85ae admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:59.808459 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f7895-ecb3-4633-954a-f43149ae85ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:59.808807 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f7895-ecb3-4633-954a-f43149ae85ae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:59.820705 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f7895-ecb3-4633-954a-f43149ae85ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:59.846310 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f7895-ecb3-4633-954a-f43149ae85ae admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:59.863147 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-147f7895-ecb3-4633-954a-f43149ae85ae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:38:59.863957 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 407/814] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:38:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:38:59.870003 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d4dfd-e9f9-4620-83cb-2ec1de4d8e7e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:59.878456 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d4dfd-e9f9-4620-83cb-2ec1de4d8e7e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:59.883170 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a11264-7894-4051-adfc-f93393f2c3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:59.883739 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a11264-7894-4051-adfc-f93393f2c3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:59.884026 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a11264-7894-4051-adfc-f93393f2c3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:59.884307 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a11264-7894-4051-adfc-f93393f2c3d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:59.884977 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a11264-7894-4051-adfc-f93393f2c3d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:38:59.885275 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a11264-7894-4051-adfc-f93393f2c3d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:59.910423 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a11264-7894-4051-adfc-f93393f2c3d2 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:59.923052 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 408/815] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:38:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:38:59.928849 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f7895-ecb3-4633-954a-f43149ae85ae admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:38:59.937953 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f7895-ecb3-4633-954a-f43149ae85ae admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:38:59.941951 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0f483-2351-4e5d-b2de-8468f82ab649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:38:59.942670 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0f483-2351-4e5d-b2de-8468f82ab649 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:38:59.942974 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0f483-2351-4e5d-b2de-8468f82ab649 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:38:59.943256 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0f483-2351-4e5d-b2de-8468f82ab649 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:38:59.952877 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0f483-2351-4e5d-b2de-8468f82ab649 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:38:59.978837 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0f483-2351-4e5d-b2de-8468f82ab649 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:38:59.992559 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-f8a0f483-2351-4e5d-b2de-8468f82ab649 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:38:59.993593 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 408/816] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:38:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:38:59.999180 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a11264-7894-4051-adfc-f93393f2c3d2 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:00.008860 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a11264-7894-4051-adfc-f93393f2c3d2 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:00.012856 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fc317-28cb-4eaf-ae68-8ebf3e58c821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:00.013419 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fc317-28cb-4eaf-ae68-8ebf3e58c821 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:00.013704 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fc317-28cb-4eaf-ae68-8ebf3e58c821 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:00.013982 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fc317-28cb-4eaf-ae68-8ebf3e58c821 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:00.014742 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3fc317-28cb-4eaf-ae68-8ebf3e58c821 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:00.015041 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3fc317-28cb-4eaf-ae68-8ebf3e58c821 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:00.041113 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3fc317-28cb-4eaf-ae68-8ebf3e58c821 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:00.054139 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 409/817] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:38:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:00.059808 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0f483-2351-4e5d-b2de-8468f82ab649 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:00.068758 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0f483-2351-4e5d-b2de-8468f82ab649 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:00.072999 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1280d-b8a3-4052-95d1-88f5c611ba64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:00.073565 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1280d-b8a3-4052-95d1-88f5c611ba64 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:00.073853 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1280d-b8a3-4052-95d1-88f5c611ba64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:00.074135 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1280d-b8a3-4052-95d1-88f5c611ba64 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:00.074935 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1280d-b8a3-4052-95d1-88f5c611ba64 admin admin] RBAC: Adding query filter params (role.id=1c5a8286caa54ded9e44ef97f73f6776, scope.project.id=ed634cf9bb9146f7a9738325a8638b70, user.id=55d700adb7db4848a97bab6cf4105481) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:00.075241 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1280d-b8a3-4052-95d1-88f5c611ba64 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:00.101425 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1280d-b8a3-4052-95d1-88f5c611ba64 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:00.106577 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 409/818] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:39:00 2021] GET /identity/v3/role_assignments?user.id=55d700adb7db4848a97bab6cf4105481&scope.project.id=ed634cf9bb9146f7a9738325a8638b70&role.id=1c5a8286caa54ded9e44ef97f73f6776 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:39:02.035085 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6187a5-51da-4e00-be4b-45c12b039b93 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:02.035613 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6187a5-51da-4e00-be4b-45c12b039b93 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:02.035712 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6187a5-51da-4e00-be4b-45c12b039b93 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:02.037286 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 410/819] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:39:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:39:02.042674 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16745598-d775-44cc-b70b-3be8ea19cacb None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:02.043086 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16745598-d775-44cc-b70b-3be8ea19cacb None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:02.043251 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16745598-d775-44cc-b70b-3be8ea19cacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:02.065636 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-16745598-d775-44cc-b70b-3be8ea19cacb None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:39:02.066788 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-16745598-d775-44cc-b70b-3be8ea19cacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:39:02.074497 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 410/820] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:39:02 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:39:02.095734 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6187a5-51da-4e00-be4b-45c12b039b93 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:02.107056 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6187a5-51da-4e00-be4b-45c12b039b93 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:02.110912 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197dfb9-ccf7-427d-8368-551fb6914d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:02.111746 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197dfb9-ccf7-427d-8368-551fb6914d25 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:02.111985 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197dfb9-ccf7-427d-8368-551fb6914d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:02.112261 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197dfb9-ccf7-427d-8368-551fb6914d25 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:02.123664 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197dfb9-ccf7-427d-8368-551fb6914d25 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:39:02.129840 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-7197dfb9-ccf7-427d-8368-551fb6914d25 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 29 20:39:02.130917 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 411/821] 10.222.0.37 () {56 vars in 1123 bytes} [Wed Dec 29 20:39:02 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:02.136922 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16745598-d775-44cc-b70b-3be8ea19cacb None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:02.145273 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16745598-d775-44cc-b70b-3be8ea19cacb None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:02.149403 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497dd5b-381f-4fe8-bddb-89afe120cdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:02.149986 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497dd5b-381f-4fe8-bddb-89afe120cdea admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:02.150274 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497dd5b-381f-4fe8-bddb-89afe120cdea admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:02.150555 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497dd5b-381f-4fe8-bddb-89afe120cdea admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:02.151300 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497dd5b-381f-4fe8-bddb-89afe120cdea admin admin] RBAC: Adding query filter params (name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:02.151599 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497dd5b-381f-4fe8-bddb-89afe120cdea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:02.176683 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497dd5b-381f-4fe8-bddb-89afe120cdea admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:02.185525 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 411/822] 10.222.0.37 () {56 vars in 1124 bytes} [Wed Dec 29 20:39:02 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:02.190905 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197dfb9-ccf7-427d-8368-551fb6914d25 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:02.201648 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197dfb9-ccf7-427d-8368-551fb6914d25 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:02.205651 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcaf20e-c47f-4351-9880-12bf55ca5d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:02.206367 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaf20e-c47f-4351-9880-12bf55ca5d54 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:02.206736 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaf20e-c47f-4351-9880-12bf55ca5d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:02.206963 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaf20e-c47f-4351-9880-12bf55ca5d54 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:02.218086 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcaf20e-c47f-4351-9880-12bf55ca5d54 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:02.244014 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcaf20e-c47f-4351-9880-12bf55ca5d54 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:02.261678 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-8dcaf20e-c47f-4351-9880-12bf55ca5d54 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:39:02.262738 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 412/823] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:39:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:02.268074 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497dd5b-381f-4fe8-bddb-89afe120cdea admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:02.277082 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497dd5b-381f-4fe8-bddb-89afe120cdea admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:02.281040 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ddd3f-9b6f-470d-b8da-c54f0ef60b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:02.281620 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ddd3f-9b6f-470d-b8da-c54f0ef60b7b admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:02.281908 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ddd3f-9b6f-470d-b8da-c54f0ef60b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:02.282189 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ddd3f-9b6f-470d-b8da-c54f0ef60b7b admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:02.282902 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ddd3f-9b6f-470d-b8da-c54f0ef60b7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:02.283203 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ddd3f-9b6f-470d-b8da-c54f0ef60b7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:02.309661 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ddd3f-9b6f-470d-b8da-c54f0ef60b7b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:02.322394 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 412/824] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:39:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:02.327576 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcaf20e-c47f-4351-9880-12bf55ca5d54 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:02.336718 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcaf20e-c47f-4351-9880-12bf55ca5d54 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:02.340677 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d26bb7-549c-40eb-afc3-2213e7983a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:02.341371 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d26bb7-549c-40eb-afc3-2213e7983a27 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:02.341654 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d26bb7-549c-40eb-afc3-2213e7983a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:02.341930 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d26bb7-549c-40eb-afc3-2213e7983a27 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:02.356172 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d26bb7-549c-40eb-afc3-2213e7983a27 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:02.381927 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d26bb7-549c-40eb-afc3-2213e7983a27 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:02.398857 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-c9d26bb7-549c-40eb-afc3-2213e7983a27 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 29 20:39:02.399929 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 413/825] 10.222.0.37 () {56 vars in 1123 bytes} [Wed Dec 29 20:39:02 2021] GET /identity/v3/users/neutron => generated 85 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:02.405462 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ddd3f-9b6f-470d-b8da-c54f0ef60b7b admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:02.415680 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ddd3f-9b6f-470d-b8da-c54f0ef60b7b admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:02.419682 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209a225-010f-4cad-b01a-a2f2c26f4547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:02.420272 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209a225-010f-4cad-b01a-a2f2c26f4547 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:02.420562 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209a225-010f-4cad-b01a-a2f2c26f4547 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:02.420843 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209a225-010f-4cad-b01a-a2f2c26f4547 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:02.421631 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209a225-010f-4cad-b01a-a2f2c26f4547 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:02.421933 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209a225-010f-4cad-b01a-a2f2c26f4547 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:02.449328 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209a225-010f-4cad-b01a-a2f2c26f4547 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:02.478841 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 413/826] 10.222.0.37 () {56 vars in 1160 bytes} [Wed Dec 29 20:39:02 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:02.484117 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d26bb7-549c-40eb-afc3-2213e7983a27 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:02.493727 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d26bb7-549c-40eb-afc3-2213e7983a27 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:02.497631 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c619e60-a00b-4977-bd8e-ce885b42df7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:02.498323 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c619e60-a00b-4977-bd8e-ce885b42df7e admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:02.498607 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c619e60-a00b-4977-bd8e-ce885b42df7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:02.499018 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c619e60-a00b-4977-bd8e-ce885b42df7e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:02.510927 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c619e60-a00b-4977-bd8e-ce885b42df7e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:02.536171 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c619e60-a00b-4977-bd8e-ce885b42df7e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:02.552926 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-8c619e60-a00b-4977-bd8e-ce885b42df7e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:39:02.554481 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 414/827] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:39:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:02.559816 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209a225-010f-4cad-b01a-a2f2c26f4547 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:02.568897 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209a225-010f-4cad-b01a-a2f2c26f4547 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:02.573271 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1201929-23b6-4aa2-9411-cea0a1e982f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:02.573845 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1201929-23b6-4aa2-9411-cea0a1e982f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:02.574135 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1201929-23b6-4aa2-9411-cea0a1e982f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:02.574417 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1201929-23b6-4aa2-9411-cea0a1e982f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:02.575131 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1201929-23b6-4aa2-9411-cea0a1e982f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:02.575430 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1201929-23b6-4aa2-9411-cea0a1e982f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:02.601059 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1201929-23b6-4aa2-9411-cea0a1e982f2 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:02.613283 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 414/828] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:39:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:02.619154 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c619e60-a00b-4977-bd8e-ce885b42df7e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:02.628025 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c619e60-a00b-4977-bd8e-ce885b42df7e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:02.632044 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5febfe2-1f3a-479f-b31e-c2b13839c2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:02.632680 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5febfe2-1f3a-479f-b31e-c2b13839c2cc admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:02.632966 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5febfe2-1f3a-479f-b31e-c2b13839c2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:02.633240 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5febfe2-1f3a-479f-b31e-c2b13839c2cc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:02.641771 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5febfe2-1f3a-479f-b31e-c2b13839c2cc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:02.667669 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5febfe2-1f3a-479f-b31e-c2b13839c2cc admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:02.681135 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-b5febfe2-1f3a-479f-b31e-c2b13839c2cc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:39:02.682150 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 415/829] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:39:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:02.687462 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1201929-23b6-4aa2-9411-cea0a1e982f2 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:02.697047 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1201929-23b6-4aa2-9411-cea0a1e982f2 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:02.701012 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e695c1d-69b9-4b78-a98b-18c6796a6180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:02.701580 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e695c1d-69b9-4b78-a98b-18c6796a6180 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:02.701869 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e695c1d-69b9-4b78-a98b-18c6796a6180 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:02.702148 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e695c1d-69b9-4b78-a98b-18c6796a6180 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:02.702919 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e695c1d-69b9-4b78-a98b-18c6796a6180 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:02.703221 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e695c1d-69b9-4b78-a98b-18c6796a6180 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:02.729719 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e695c1d-69b9-4b78-a98b-18c6796a6180 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:02.742927 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 415/830] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:39:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:02.748398 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5febfe2-1f3a-479f-b31e-c2b13839c2cc admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:02.757585 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5febfe2-1f3a-479f-b31e-c2b13839c2cc admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:02.761477 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84467e-a193-4c34-9c79-f95da61b2d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:02.762261 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84467e-a193-4c34-9c79-f95da61b2d61 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:02.762545 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84467e-a193-4c34-9c79-f95da61b2d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:02.762859 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84467e-a193-4c34-9c79-f95da61b2d61 admin admin] PATH_INFO: `/v3/projects/ed634cf9bb9146f7a9738325a8638b70/users/55d700adb7db4848a97bab6cf4105481/roles/1c5a8286caa54ded9e44ef97f73f6776` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:02.782374 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84467e-a193-4c34-9c79-f95da61b2d61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed634cf9bb9146f7a9738325a8638b70, user_id=55d700adb7db4848a97bab6cf4105481, role_id=1c5a8286caa54ded9e44ef97f73f6776)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:02.808975 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84467e-a193-4c34-9c79-f95da61b2d61 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:02.821081 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 416/831] 10.222.0.37 () {58 vars in 1460 bytes} [Wed Dec 29 20:39:02 2021] PUT /identity/v3/projects/ed634cf9bb9146f7a9738325a8638b70/users/55d700adb7db4848a97bab6cf4105481/roles/1c5a8286caa54ded9e44ef97f73f6776 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:39:04.755554 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb67dd-7237-4590-a928-8969ac1587ec None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:04.756081 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb67dd-7237-4590-a928-8969ac1587ec None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:04.756188 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb67dd-7237-4590-a928-8969ac1587ec None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:04.758037 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 416/832] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:39:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:39:04.763028 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008e545-c9c8-4517-82a7-1425cc6d33fd None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:04.763439 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008e545-c9c8-4517-82a7-1425cc6d33fd None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:04.763589 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008e545-c9c8-4517-82a7-1425cc6d33fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:04.785561 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-4008e545-c9c8-4517-82a7-1425cc6d33fd None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:39:04.786697 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-4008e545-c9c8-4517-82a7-1425cc6d33fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:39:04.848305 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 417/833] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:39:04 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:39:04.871578 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb67dd-7237-4590-a928-8969ac1587ec None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:04.883124 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb67dd-7237-4590-a928-8969ac1587ec None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:04.886973 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b77ca-5e17-44af-8f8a-44c29de17fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:04.887686 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b77ca-5e17-44af-8f8a-44c29de17fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:04.887972 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b77ca-5e17-44af-8f8a-44c29de17fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:04.888250 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b77ca-5e17-44af-8f8a-44c29de17fe4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:04.899388 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b77ca-5e17-44af-8f8a-44c29de17fe4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:39:04.905646 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-6a3b77ca-5e17-44af-8f8a-44c29de17fe4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 29 20:39:04.906709 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 417/834] 10.222.0.37 () {56 vars in 1123 bytes} [Wed Dec 29 20:39:04 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:04.912251 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008e545-c9c8-4517-82a7-1425cc6d33fd None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:04.921244 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008e545-c9c8-4517-82a7-1425cc6d33fd None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:04.925273 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55eafd-36a4-47bd-8658-c0bd0dc0f880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:04.925856 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55eafd-36a4-47bd-8658-c0bd0dc0f880 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:04.926144 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55eafd-36a4-47bd-8658-c0bd0dc0f880 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:04.926427 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55eafd-36a4-47bd-8658-c0bd0dc0f880 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:04.927169 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55eafd-36a4-47bd-8658-c0bd0dc0f880 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:04.927471 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55eafd-36a4-47bd-8658-c0bd0dc0f880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:04.953352 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55eafd-36a4-47bd-8658-c0bd0dc0f880 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:04.962487 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 418/835] 10.222.0.37 () {56 vars in 1124 bytes} [Wed Dec 29 20:39:04 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:04.967729 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b77ca-5e17-44af-8f8a-44c29de17fe4 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:04.979505 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b77ca-5e17-44af-8f8a-44c29de17fe4 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:04.983479 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab8044-3272-46d9-8f9d-88a0f0056e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:04.984173 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab8044-3272-46d9-8f9d-88a0f0056e9b admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:04.984454 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab8044-3272-46d9-8f9d-88a0f0056e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:04.984730 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab8044-3272-46d9-8f9d-88a0f0056e9b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:04.995518 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab8044-3272-46d9-8f9d-88a0f0056e9b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:05.020889 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab8044-3272-46d9-8f9d-88a0f0056e9b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:05.038844 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-a1ab8044-3272-46d9-8f9d-88a0f0056e9b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:39:05.039876 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 418/836] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:39:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:05.045192 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55eafd-36a4-47bd-8658-c0bd0dc0f880 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:05.054380 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55eafd-36a4-47bd-8658-c0bd0dc0f880 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:05.058409 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a3a7d-5764-4c96-8637-f55f54d98e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:05.059020 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a3a7d-5764-4c96-8637-f55f54d98e6f admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:05.059312 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a3a7d-5764-4c96-8637-f55f54d98e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:05.059597 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a3a7d-5764-4c96-8637-f55f54d98e6f admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:05.060269 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a3a7d-5764-4c96-8637-f55f54d98e6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:05.060569 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a3a7d-5764-4c96-8637-f55f54d98e6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:05.086262 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a3a7d-5764-4c96-8637-f55f54d98e6f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:05.098594 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 419/837] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:39:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:05.104193 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab8044-3272-46d9-8f9d-88a0f0056e9b admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:05.113051 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab8044-3272-46d9-8f9d-88a0f0056e9b admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:05.117006 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9d292-bf51-4873-a66e-6b36cb41b34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:05.117702 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9d292-bf51-4873-a66e-6b36cb41b34a admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:05.117983 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9d292-bf51-4873-a66e-6b36cb41b34a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:05.118259 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9d292-bf51-4873-a66e-6b36cb41b34a admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:05.130311 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9d292-bf51-4873-a66e-6b36cb41b34a admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:05.156446 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9d292-bf51-4873-a66e-6b36cb41b34a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:05.173923 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-acc9d292-bf51-4873-a66e-6b36cb41b34a admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 29 20:39:05.174968 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 419/838] 10.222.0.37 () {56 vars in 1123 bytes} [Wed Dec 29 20:39:05 2021] GET /identity/v3/users/neutron => generated 85 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:05.180676 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a3a7d-5764-4c96-8637-f55f54d98e6f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:05.189694 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a3a7d-5764-4c96-8637-f55f54d98e6f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:05.193805 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7174b-4a86-419a-affc-2b0c674ae95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:05.194474 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7174b-4a86-419a-affc-2b0c674ae95c admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:05.194798 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7174b-4a86-419a-affc-2b0c674ae95c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:05.195082 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7174b-4a86-419a-affc-2b0c674ae95c admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:05.195860 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7174b-4a86-419a-affc-2b0c674ae95c admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:05.196166 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7174b-4a86-419a-affc-2b0c674ae95c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:05.222198 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7174b-4a86-419a-affc-2b0c674ae95c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:05.250481 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 420/839] 10.222.0.37 () {56 vars in 1160 bytes} [Wed Dec 29 20:39:05 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:05.255890 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9d292-bf51-4873-a66e-6b36cb41b34a admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:05.264868 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9d292-bf51-4873-a66e-6b36cb41b34a admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:05.268759 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40007f1-882d-4903-b535-8fe704c8a630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:05.269314 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40007f1-882d-4903-b535-8fe704c8a630 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:05.269599 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40007f1-882d-4903-b535-8fe704c8a630 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:05.269875 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40007f1-882d-4903-b535-8fe704c8a630 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:05.277732 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40007f1-882d-4903-b535-8fe704c8a630 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:05.303382 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40007f1-882d-4903-b535-8fe704c8a630 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:05.312338 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 420/840] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:39:05 2021] GET /identity/v3/auth/tokens => generated 2725 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:39:05.317655 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7174b-4a86-419a-affc-2b0c674ae95c admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:05.327444 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7174b-4a86-419a-affc-2b0c674ae95c admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:05.331426 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5acb80-63ba-4c59-b1d7-fd6c34e72404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:05.332127 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5acb80-63ba-4c59-b1d7-fd6c34e72404 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:05.332416 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5acb80-63ba-4c59-b1d7-fd6c34e72404 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:05.332694 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5acb80-63ba-4c59-b1d7-fd6c34e72404 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:05.344445 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5acb80-63ba-4c59-b1d7-fd6c34e72404 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:05.369825 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5acb80-63ba-4c59-b1d7-fd6c34e72404 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:05.386718 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-3e5acb80-63ba-4c59-b1d7-fd6c34e72404 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:39:05.387766 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 421/841] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:39:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:05.393103 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40007f1-882d-4903-b535-8fe704c8a630 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:05.401937 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40007f1-882d-4903-b535-8fe704c8a630 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:05.405897 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c018495-37ee-49fd-baba-555d0700d480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:05.406464 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c018495-37ee-49fd-baba-555d0700d480 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:05.406782 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c018495-37ee-49fd-baba-555d0700d480 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:05.407062 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c018495-37ee-49fd-baba-555d0700d480 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:05.407732 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c018495-37ee-49fd-baba-555d0700d480 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:05.408025 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c018495-37ee-49fd-baba-555d0700d480 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:05.433102 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c018495-37ee-49fd-baba-555d0700d480 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:05.446185 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 421/842] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:39:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:05.451821 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5acb80-63ba-4c59-b1d7-fd6c34e72404 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:05.461588 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5acb80-63ba-4c59-b1d7-fd6c34e72404 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:05.465589 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cb5de-9272-4005-8fe8-3dc6d46436ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:05.466295 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cb5de-9272-4005-8fe8-3dc6d46436ba admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:05.466585 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cb5de-9272-4005-8fe8-3dc6d46436ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:05.466898 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cb5de-9272-4005-8fe8-3dc6d46436ba admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:05.475724 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843cb5de-9272-4005-8fe8-3dc6d46436ba admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:05.501444 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843cb5de-9272-4005-8fe8-3dc6d46436ba admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:05.515207 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-843cb5de-9272-4005-8fe8-3dc6d46436ba admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:39:05.516260 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 422/843] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:39:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:05.521636 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c018495-37ee-49fd-baba-555d0700d480 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:05.531328 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c018495-37ee-49fd-baba-555d0700d480 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:05.535200 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335b4e0-8e69-494a-90a8-7406fdb27590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:05.535771 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335b4e0-8e69-494a-90a8-7406fdb27590 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:05.536055 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335b4e0-8e69-494a-90a8-7406fdb27590 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:05.536331 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335b4e0-8e69-494a-90a8-7406fdb27590 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:05.537061 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335b4e0-8e69-494a-90a8-7406fdb27590 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:05.537405 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335b4e0-8e69-494a-90a8-7406fdb27590 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:05.563657 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335b4e0-8e69-494a-90a8-7406fdb27590 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:05.577266 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 422/844] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:39:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:39:05.583001 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cb5de-9272-4005-8fe8-3dc6d46436ba admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:05.592787 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cb5de-9272-4005-8fe8-3dc6d46436ba admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:05.596787 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41c0d0-eaca-4d1c-8a46-eb3b3badf0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:05.597352 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41c0d0-eaca-4d1c-8a46-eb3b3badf0cc admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:05.597639 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41c0d0-eaca-4d1c-8a46-eb3b3badf0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:05.597918 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41c0d0-eaca-4d1c-8a46-eb3b3badf0cc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:05.598712 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41c0d0-eaca-4d1c-8a46-eb3b3badf0cc admin admin] RBAC: Adding query filter params (role.id=1c5a8286caa54ded9e44ef97f73f6776, scope.project.id=ed634cf9bb9146f7a9738325a8638b70, user.id=55d700adb7db4848a97bab6cf4105481) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:05.599019 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41c0d0-eaca-4d1c-8a46-eb3b3badf0cc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:05.624662 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41c0d0-eaca-4d1c-8a46-eb3b3badf0cc admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:05.630172 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 423/845] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:39:05 2021] GET /identity/v3/role_assignments?user.id=55d700adb7db4848a97bab6cf4105481&scope.project.id=ed634cf9bb9146f7a9738325a8638b70&role.id=1c5a8286caa54ded9e44ef97f73f6776 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:07.605677 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501029b3-c9c6-47cd-9423-3bfb62a9c9ea None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:07.606242 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501029b3-c9c6-47cd-9423-3bfb62a9c9ea None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:07.606242 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501029b3-c9c6-47cd-9423-3bfb62a9c9ea None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:07.607955 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 423/846] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:39:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:39:07.612887 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d10a7-13c0-4d5a-96c9-d9ccf1e8edff None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:07.613292 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d10a7-13c0-4d5a-96c9-d9ccf1e8edff None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:07.613455 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d10a7-13c0-4d5a-96c9-d9ccf1e8edff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:07.637500 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-dc9d10a7-13c0-4d5a-96c9-d9ccf1e8edff None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:39:07.638618 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-dc9d10a7-13c0-4d5a-96c9-d9ccf1e8edff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:39:07.645266 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 424/847] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:39:07 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:39:07.668105 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501029b3-c9c6-47cd-9423-3bfb62a9c9ea None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:07.680170 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501029b3-c9c6-47cd-9423-3bfb62a9c9ea None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:07.684096 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168c8a4-95e5-4bdc-a0aa-6dd17298c8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:07.684796 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168c8a4-95e5-4bdc-a0aa-6dd17298c8aa admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:07.685085 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168c8a4-95e5-4bdc-a0aa-6dd17298c8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:07.685368 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168c8a4-95e5-4bdc-a0aa-6dd17298c8aa admin admin] PATH_INFO: `/v3/services/network` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:07.685994 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168c8a4-95e5-4bdc-a0aa-6dd17298c8aa admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:07.711421 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168c8a4-95e5-4bdc-a0aa-6dd17298c8aa admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:07.722421 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-e168c8a4-95e5-4bdc-a0aa-6dd17298c8aa admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 29 20:39:07.723513 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 424/848] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:39:07 2021] GET /identity/v3/services/network => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:07.729974 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d10a7-13c0-4d5a-96c9-d9ccf1e8edff None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:07.738441 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d10a7-13c0-4d5a-96c9-d9ccf1e8edff None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:07.743096 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955dbca-091b-47b3-8ce1-09444cc5e903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:07.743672 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955dbca-091b-47b3-8ce1-09444cc5e903 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:07.743959 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955dbca-091b-47b3-8ce1-09444cc5e903 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:07.744237 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955dbca-091b-47b3-8ce1-09444cc5e903 admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:07.744900 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955dbca-091b-47b3-8ce1-09444cc5e903 admin admin] RBAC: Adding query filter params (name=network) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:07.745194 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955dbca-091b-47b3-8ce1-09444cc5e903 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:07.770211 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955dbca-091b-47b3-8ce1-09444cc5e903 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:07.775075 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 425/849] 10.222.0.37 () {56 vars in 1133 bytes} [Wed Dec 29 20:39:07 2021] GET /identity/v3/services?name=network => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:07.780597 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168c8a4-95e5-4bdc-a0aa-6dd17298c8aa admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:07.790480 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168c8a4-95e5-4bdc-a0aa-6dd17298c8aa admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:07.794674 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a27961-b722-4d18-9fe9-df1e39e7bec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:07.795264 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a27961-b722-4d18-9fe9-df1e39e7bec2 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:07.795554 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a27961-b722-4d18-9fe9-df1e39e7bec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:07.795837 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a27961-b722-4d18-9fe9-df1e39e7bec2 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:07.796506 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a27961-b722-4d18-9fe9-df1e39e7bec2 admin admin] RBAC: Adding query filter params (type=network) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:07.796805 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a27961-b722-4d18-9fe9-df1e39e7bec2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:07.823155 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a27961-b722-4d18-9fe9-df1e39e7bec2 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:07.827669 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 425/850] 10.222.0.37 () {56 vars in 1133 bytes} [Wed Dec 29 20:39:07 2021] GET /identity/v3/services?type=network => generated 124 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:09.740858 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaa71d-2e8d-4d8e-bd61-405e94c7f9d2 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:09.741396 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaa71d-2e8d-4d8e-bd61-405e94c7f9d2 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:09.741488 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaa71d-2e8d-4d8e-bd61-405e94c7f9d2 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:09.743114 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 426/851] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:39:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:39:09.748106 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bad2a-1567-4442-9119-beb5bb03e99a None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:09.748535 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bad2a-1567-4442-9119-beb5bb03e99a None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:09.748682 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bad2a-1567-4442-9119-beb5bb03e99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:09.770444 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-ab0bad2a-1567-4442-9119-beb5bb03e99a None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:39:09.772113 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-ab0bad2a-1567-4442-9119-beb5bb03e99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:39:09.778801 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 426/852] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:39:09 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:39:09.800676 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbaa71d-2e8d-4d8e-bd61-405e94c7f9d2 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:09.812135 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbaa71d-2e8d-4d8e-bd61-405e94c7f9d2 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:09.815984 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563f2f1-b265-4cc3-a70d-e3a730db3ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:09.816554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563f2f1-b265-4cc3-a70d-e3a730db3ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:09.816838 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563f2f1-b265-4cc3-a70d-e3a730db3ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:09.817114 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563f2f1-b265-4cc3-a70d-e3a730db3ab1 admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:09.817785 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563f2f1-b265-4cc3-a70d-e3a730db3ab1 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:09.844173 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563f2f1-b265-4cc3-a70d-e3a730db3ab1 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:09.857131 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 427/853] 10.222.0.37 () {60 vars in 1162 bytes} [Wed Dec 29 20:39:09 2021] POST /identity/v3/services => generated 240 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:39:11.798015 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3d99b-123d-40d2-8232-5924a3393be2 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:11.798537 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3d99b-123d-40d2-8232-5924a3393be2 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:11.798640 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3d99b-123d-40d2-8232-5924a3393be2 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:11.800438 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 427/854] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:39:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:39:11.805637 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b2ffa-dce9-43ea-b83f-15d27173c258 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:11.806052 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b2ffa-dce9-43ea-b83f-15d27173c258 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:11.806198 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b2ffa-dce9-43ea-b83f-15d27173c258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:11.837163 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-b12b2ffa-dce9-43ea-b83f-15d27173c258 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:39:11.838288 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-b12b2ffa-dce9-43ea-b83f-15d27173c258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:39:11.855667 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 428/855] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:39:11 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:39:11.876978 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3d99b-123d-40d2-8232-5924a3393be2 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:11.888698 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3d99b-123d-40d2-8232-5924a3393be2 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:11.892577 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b8e55-b3d7-4dd1-812a-af8c0bb0a596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:11.893284 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b8e55-b3d7-4dd1-812a-af8c0bb0a596 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:11.893571 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b8e55-b3d7-4dd1-812a-af8c0bb0a596 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:11.893850 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b8e55-b3d7-4dd1-812a-af8c0bb0a596 admin admin] PATH_INFO: `/v3/services/network` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:11.894475 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b8e55-b3d7-4dd1-812a-af8c0bb0a596 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:11.921125 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b8e55-b3d7-4dd1-812a-af8c0bb0a596 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:11.931446 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-238b8e55-b3d7-4dd1-812a-af8c0bb0a596 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 29 20:39:11.932485 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 428/856] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:39:11 2021] GET /identity/v3/services/network => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:11.938224 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b2ffa-dce9-43ea-b83f-15d27173c258 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:11.947035 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b2ffa-dce9-43ea-b83f-15d27173c258 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:11.950945 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a465988-c83f-4751-a773-f2e176e3ebf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:11.951519 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a465988-c83f-4751-a773-f2e176e3ebf7 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:11.951804 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a465988-c83f-4751-a773-f2e176e3ebf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:11.952080 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a465988-c83f-4751-a773-f2e176e3ebf7 admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:11.952742 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a465988-c83f-4751-a773-f2e176e3ebf7 admin admin] RBAC: Adding query filter params (name=network) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:11.953033 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a465988-c83f-4751-a773-f2e176e3ebf7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:11.979186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a465988-c83f-4751-a773-f2e176e3ebf7 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:11.983783 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 429/857] 10.222.0.37 () {56 vars in 1133 bytes} [Wed Dec 29 20:39:11 2021] GET /identity/v3/services?name=network => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:11.989024 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b8e55-b3d7-4dd1-812a-af8c0bb0a596 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:11.998252 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b8e55-b3d7-4dd1-812a-af8c0bb0a596 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:12.002260 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feababe2-14d5-4a38-811f-2ae374bbfd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:12.002863 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feababe2-14d5-4a38-811f-2ae374bbfd3a admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:12.003154 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feababe2-14d5-4a38-811f-2ae374bbfd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:12.003437 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feababe2-14d5-4a38-811f-2ae374bbfd3a admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:12.004101 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feababe2-14d5-4a38-811f-2ae374bbfd3a admin admin] RBAC: Adding query filter params (type=network) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:12.004402 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feababe2-14d5-4a38-811f-2ae374bbfd3a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:12.030101 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feababe2-14d5-4a38-811f-2ae374bbfd3a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:12.034634 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 429/858] 10.222.0.37 () {56 vars in 1133 bytes} [Wed Dec 29 20:39:11 2021] GET /identity/v3/services?type=network => generated 350 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:12.040649 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a465988-c83f-4751-a773-f2e176e3ebf7 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:12.049682 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a465988-c83f-4751-a773-f2e176e3ebf7 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:12.053904 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ca46f-1d32-47a2-8401-f96fdcd249b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:12.054471 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ca46f-1d32-47a2-8401-f96fdcd249b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:12.054797 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ca46f-1d32-47a2-8401-f96fdcd249b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:12.055081 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ca46f-1d32-47a2-8401-f96fdcd249b6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:12.055814 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ca46f-1d32-47a2-8401-f96fdcd249b6 admin admin] RBAC: Adding query filter params (interface=public, service_id=7531aed2c43e40a78d5d845253b670f3, region_id=RegionOne) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:12.056118 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ca46f-1d32-47a2-8401-f96fdcd249b6 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:12.082068 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ca46f-1d32-47a2-8401-f96fdcd249b6 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:12.087746 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 430/859] 10.222.0.37 () {56 vars in 1272 bytes} [Wed Dec 29 20:39:12 2021] GET /identity/v3/endpoints?service_id=7531aed2c43e40a78d5d845253b670f3&interface=public®ion_id=RegionOne => generated 194 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:12.092821 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feababe2-14d5-4a38-811f-2ae374bbfd3a admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:12.101692 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feababe2-14d5-4a38-811f-2ae374bbfd3a admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:12.105722 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb06bc1-c9c9-4f71-bd1a-4abb7192f7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:12.106286 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb06bc1-c9c9-4f71-bd1a-4abb7192f7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:12.106581 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb06bc1-c9c9-4f71-bd1a-4abb7192f7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:12.106901 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb06bc1-c9c9-4f71-bd1a-4abb7192f7e1 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:12.107540 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb06bc1-c9c9-4f71-bd1a-4abb7192f7e1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:12.133195 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb06bc1-c9c9-4f71-bd1a-4abb7192f7e1 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:12.139481 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 430/860] 10.222.0.37 () {56 vars in 1108 bytes} [Wed Dec 29 20:39:12 2021] GET /identity/v3/services => generated 1967 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:39:14.071545 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b95b6-7def-46c4-a563-d93e17d570c8 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:14.072046 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b95b6-7def-46c4-a563-d93e17d570c8 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:14.072159 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b95b6-7def-46c4-a563-d93e17d570c8 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:14.073759 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 431/861] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:39:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:39:14.078729 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5699e1-271a-4bfe-94f6-cfdf4f9a776c None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:14.079145 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5699e1-271a-4bfe-94f6-cfdf4f9a776c None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:14.079338 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5699e1-271a-4bfe-94f6-cfdf4f9a776c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:14.102166 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-bf5699e1-271a-4bfe-94f6-cfdf4f9a776c None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:39:14.103312 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-bf5699e1-271a-4bfe-94f6-cfdf4f9a776c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:39:14.109850 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 431/862] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:39:14 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:39:14.131843 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b95b6-7def-46c4-a563-d93e17d570c8 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:14.143081 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b95b6-7def-46c4-a563-d93e17d570c8 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:14.147522 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510aadd-dbad-4f19-b27d-5850bc0c7475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:14.148217 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510aadd-dbad-4f19-b27d-5850bc0c7475 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:14.148503 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510aadd-dbad-4f19-b27d-5850bc0c7475 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:14.148783 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510aadd-dbad-4f19-b27d-5850bc0c7475 admin admin] PATH_INFO: `/v3/services/network` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:14.149392 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510aadd-dbad-4f19-b27d-5850bc0c7475 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:14.174960 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510aadd-dbad-4f19-b27d-5850bc0c7475 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:14.184939 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-2510aadd-dbad-4f19-b27d-5850bc0c7475 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 29 20:39:14.185961 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 432/863] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:39:14 2021] GET /identity/v3/services/network => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:39:14.191486 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5699e1-271a-4bfe-94f6-cfdf4f9a776c None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:14.200302 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5699e1-271a-4bfe-94f6-cfdf4f9a776c None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:14.204327 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc86ff9-f3da-4ffa-9910-0198b68a3053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:14.204903 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc86ff9-f3da-4ffa-9910-0198b68a3053 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:14.205193 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc86ff9-f3da-4ffa-9910-0198b68a3053 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:14.205474 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc86ff9-f3da-4ffa-9910-0198b68a3053 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:14.206142 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc86ff9-f3da-4ffa-9910-0198b68a3053 admin admin] RBAC: Adding query filter params (name=network) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:14.206440 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc86ff9-f3da-4ffa-9910-0198b68a3053 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:14.232728 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc86ff9-f3da-4ffa-9910-0198b68a3053 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:14.237411 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 432/864] 10.222.0.37 () {56 vars in 1133 bytes} [Wed Dec 29 20:39:14 2021] GET /identity/v3/services?name=network => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:14.242829 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510aadd-dbad-4f19-b27d-5850bc0c7475 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:14.251786 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510aadd-dbad-4f19-b27d-5850bc0c7475 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:14.255874 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae933af-c6bb-480c-8662-d9913472609a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:14.256519 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae933af-c6bb-480c-8662-d9913472609a admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:14.256806 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae933af-c6bb-480c-8662-d9913472609a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:14.257086 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae933af-c6bb-480c-8662-d9913472609a admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:14.257742 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae933af-c6bb-480c-8662-d9913472609a admin admin] RBAC: Adding query filter params (type=network) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:14.258035 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae933af-c6bb-480c-8662-d9913472609a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:14.283809 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae933af-c6bb-480c-8662-d9913472609a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:14.289020 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 433/865] 10.222.0.37 () {56 vars in 1133 bytes} [Wed Dec 29 20:39:14 2021] GET /identity/v3/services?type=network => generated 350 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:14.294082 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc86ff9-f3da-4ffa-9910-0198b68a3053 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:14.303022 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc86ff9-f3da-4ffa-9910-0198b68a3053 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:14.307024 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502e276-e940-461f-b1b2-fe6fe00e9cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:14.307586 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502e276-e940-461f-b1b2-fe6fe00e9cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:14.307876 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502e276-e940-461f-b1b2-fe6fe00e9cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:14.308159 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502e276-e940-461f-b1b2-fe6fe00e9cb7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:14.308837 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502e276-e940-461f-b1b2-fe6fe00e9cb7 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:14.335942 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502e276-e940-461f-b1b2-fe6fe00e9cb7 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:14.353202 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 433/866] 10.222.0.37 () {60 vars in 1165 bytes} [Wed Dec 29 20:39:14 2021] POST /identity/v3/endpoints => generated 327 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:39:16.343017 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f624016-21d7-45fa-9951-0c0ba5849f37 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:16.343538 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f624016-21d7-45fa-9951-0c0ba5849f37 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:16.343628 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f624016-21d7-45fa-9951-0c0ba5849f37 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:16.345240 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 434/867] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:39:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:39:16.350526 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68f216-7834-499a-a135-25e74faf49ab None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:16.350974 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68f216-7834-499a-a135-25e74faf49ab None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:16.351120 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68f216-7834-499a-a135-25e74faf49ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:16.373163 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-9a68f216-7834-499a-a135-25e74faf49ab None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:39:16.374277 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-9a68f216-7834-499a-a135-25e74faf49ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:39:16.392018 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 434/868] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:39:16 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:39:16.414058 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f624016-21d7-45fa-9951-0c0ba5849f37 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:16.425420 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f624016-21d7-45fa-9951-0c0ba5849f37 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:16.430078 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecded0-1419-4953-8eb3-979bfb344dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:16.430674 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecded0-1419-4953-8eb3-979bfb344dea admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:16.430971 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecded0-1419-4953-8eb3-979bfb344dea admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:16.431251 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecded0-1419-4953-8eb3-979bfb344dea admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:16.431975 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecded0-1419-4953-8eb3-979bfb344dea admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:16.457965 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecded0-1419-4953-8eb3-979bfb344dea admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:16.463737 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.sql.core [None req-a9ecded0-1419-4953-8eb3-979bfb344dea admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Dec 29 20:39:16.463737 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Dec 29 20:39:16.463737 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [parameters: {'id': 'd9b07a7710f04fa5ab3203df014f9284', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Dec 29 20:39:16.463737 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66051) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Dec 29 20:39:16.469442 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-a9ecded0-1419-4953-8eb3-979bfb344dea admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Dec 29 20:39:16.470548 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 435/869] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:39:16 2021] POST /identity/v3/roles => generated 144 bytes in 57 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:16.476223 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68f216-7834-499a-a135-25e74faf49ab None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:16.484895 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68f216-7834-499a-a135-25e74faf49ab None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:16.488954 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bbf30-33aa-40eb-a15c-72e7a945403e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:16.490181 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bbf30-33aa-40eb-a15c-72e7a945403e admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:16.490478 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bbf30-33aa-40eb-a15c-72e7a945403e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:16.490788 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bbf30-33aa-40eb-a15c-72e7a945403e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:16.502312 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543bbf30-33aa-40eb-a15c-72e7a945403e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:39:16.509601 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-543bbf30-33aa-40eb-a15c-72e7a945403e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 29 20:39:16.510682 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 435/870] 10.222.0.37 () {56 vars in 1135 bytes} [Wed Dec 29 20:39:16 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:16.516061 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecded0-1419-4953-8eb3-979bfb344dea admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:16.525446 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecded0-1419-4953-8eb3-979bfb344dea admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:16.529457 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42dc70-0e07-4bdb-afd6-dc2ee898a860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:16.530039 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42dc70-0e07-4bdb-afd6-dc2ee898a860 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:16.530329 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42dc70-0e07-4bdb-afd6-dc2ee898a860 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:16.530610 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42dc70-0e07-4bdb-afd6-dc2ee898a860 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:16.531341 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42dc70-0e07-4bdb-afd6-dc2ee898a860 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:16.531640 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42dc70-0e07-4bdb-afd6-dc2ee898a860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:16.558047 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42dc70-0e07-4bdb-afd6-dc2ee898a860 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:16.566195 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 436/871] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:39:16 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:18.540041 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85cd12-86c1-4ebe-a571-c3e9297335f9 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:18.540561 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85cd12-86c1-4ebe-a571-c3e9297335f9 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:18.540671 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85cd12-86c1-4ebe-a571-c3e9297335f9 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:18.542256 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 436/872] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:39:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:39:18.547414 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098202f-234d-4e03-b53f-d21d7ca14122 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:18.547789 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098202f-234d-4e03-b53f-d21d7ca14122 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:18.547991 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098202f-234d-4e03-b53f-d21d7ca14122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:18.571344 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-5098202f-234d-4e03-b53f-d21d7ca14122 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:39:18.572477 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-5098202f-234d-4e03-b53f-d21d7ca14122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:39:18.579173 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 437/873] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:39:18 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:39:18.603784 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85cd12-86c1-4ebe-a571-c3e9297335f9 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:18.616461 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85cd12-86c1-4ebe-a571-c3e9297335f9 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:18.620350 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ea119-3625-49c3-8abb-c2c7a6050daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:18.621047 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ea119-3625-49c3-8abb-c2c7a6050daf admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:18.621332 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ea119-3625-49c3-8abb-c2c7a6050daf admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:18.621609 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ea119-3625-49c3-8abb-c2c7a6050daf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:18.633111 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ea119-3625-49c3-8abb-c2c7a6050daf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:18.658473 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ea119-3625-49c3-8abb-c2c7a6050daf admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:18.675459 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-091ea119-3625-49c3-8abb-c2c7a6050daf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:39:18.676507 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 437/874] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:39:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:18.682923 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098202f-234d-4e03-b53f-d21d7ca14122 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:18.691431 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098202f-234d-4e03-b53f-d21d7ca14122 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:18.696290 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3b259-5919-41e1-8506-0911112d8a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:18.696871 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3b259-5919-41e1-8506-0911112d8a6b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:18.697159 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3b259-5919-41e1-8506-0911112d8a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:18.697436 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3b259-5919-41e1-8506-0911112d8a6b admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:18.698111 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3b259-5919-41e1-8506-0911112d8a6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:18.698406 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3b259-5919-41e1-8506-0911112d8a6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:18.723418 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3b259-5919-41e1-8506-0911112d8a6b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:18.735895 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 438/875] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:39:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:18.741893 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ea119-3625-49c3-8abb-c2c7a6050daf admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:18.750950 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ea119-3625-49c3-8abb-c2c7a6050daf admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:18.754924 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1881f-a409-4825-a132-aa5a2422e145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:18.756285 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1881f-a409-4825-a132-aa5a2422e145 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:18.756592 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1881f-a409-4825-a132-aa5a2422e145 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:18.756871 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1881f-a409-4825-a132-aa5a2422e145 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:18.757505 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1881f-a409-4825-a132-aa5a2422e145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:18.782868 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1881f-a409-4825-a132-aa5a2422e145 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:18.801998 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 438/876] 10.222.0.37 () {60 vars in 1153 bytes} [Wed Dec 29 20:39:18 2021] POST /identity/v3/users => generated 247 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:39:20.751929 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2071a-fee2-460c-9aac-f5efd0097078 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:20.752481 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2071a-fee2-460c-9aac-f5efd0097078 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:20.752481 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2071a-fee2-460c-9aac-f5efd0097078 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:20.754128 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 439/877] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:39:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:39:20.759226 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f04ac-ae75-49e6-b85e-bb928e40acba None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:20.759598 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f04ac-ae75-49e6-b85e-bb928e40acba None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:20.759803 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f04ac-ae75-49e6-b85e-bb928e40acba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:20.782491 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-595f04ac-ae75-49e6-b85e-bb928e40acba None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:39:20.783654 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-595f04ac-ae75-49e6-b85e-bb928e40acba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:39:20.790972 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 439/878] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:39:20 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:39:20.812504 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2071a-fee2-460c-9aac-f5efd0097078 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:20.824166 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2071a-fee2-460c-9aac-f5efd0097078 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:20.827973 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35babcd8-759d-4bf0-a43e-3eeb27faa7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:20.828668 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35babcd8-759d-4bf0-a43e-3eeb27faa7ad admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:20.828954 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35babcd8-759d-4bf0-a43e-3eeb27faa7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:20.829231 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35babcd8-759d-4bf0-a43e-3eeb27faa7ad admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:20.840692 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35babcd8-759d-4bf0-a43e-3eeb27faa7ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:39:20.846916 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-35babcd8-759d-4bf0-a43e-3eeb27faa7ad admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 29 20:39:20.847979 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 440/879] 10.222.0.37 () {56 vars in 1123 bytes} [Wed Dec 29 20:39:20 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:20.854202 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f04ac-ae75-49e6-b85e-bb928e40acba None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:20.862604 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f04ac-ae75-49e6-b85e-bb928e40acba None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:20.867066 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3146c-13e2-4bbe-acf2-1b1acd9f11c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:20.867650 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3146c-13e2-4bbe-acf2-1b1acd9f11c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:20.867933 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3146c-13e2-4bbe-acf2-1b1acd9f11c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:20.868209 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3146c-13e2-4bbe-acf2-1b1acd9f11c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:20.868917 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3146c-13e2-4bbe-acf2-1b1acd9f11c4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:20.869210 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3146c-13e2-4bbe-acf2-1b1acd9f11c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:20.894326 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3146c-13e2-4bbe-acf2-1b1acd9f11c4 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:20.903200 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 440/880] 10.222.0.37 () {56 vars in 1124 bytes} [Wed Dec 29 20:39:20 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:20.908751 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35babcd8-759d-4bf0-a43e-3eeb27faa7ad admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:20.918803 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35babcd8-759d-4bf0-a43e-3eeb27faa7ad admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:20.922851 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38646157-e0a4-4f03-9347-86fbe33b5001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:20.923543 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38646157-e0a4-4f03-9347-86fbe33b5001 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:20.923827 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38646157-e0a4-4f03-9347-86fbe33b5001 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:20.924102 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38646157-e0a4-4f03-9347-86fbe33b5001 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:20.934901 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38646157-e0a4-4f03-9347-86fbe33b5001 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:20.960984 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38646157-e0a4-4f03-9347-86fbe33b5001 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:20.978228 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-38646157-e0a4-4f03-9347-86fbe33b5001 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:39:20.979292 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 441/881] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:39:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:20.984705 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3146c-13e2-4bbe-acf2-1b1acd9f11c4 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:20.993940 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3146c-13e2-4bbe-acf2-1b1acd9f11c4 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:20.998254 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a65464-f287-4391-9082-f9a80e9550df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:20.998877 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a65464-f287-4391-9082-f9a80e9550df admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:20.999168 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a65464-f287-4391-9082-f9a80e9550df admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:20.999448 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a65464-f287-4391-9082-f9a80e9550df admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:21.000168 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a65464-f287-4391-9082-f9a80e9550df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:21.000465 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a65464-f287-4391-9082-f9a80e9550df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:21.026692 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a65464-f287-4391-9082-f9a80e9550df admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:21.042024 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 441/882] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:39:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:21.047773 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38646157-e0a4-4f03-9347-86fbe33b5001 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:21.059894 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38646157-e0a4-4f03-9347-86fbe33b5001 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:21.063926 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213dd267-e481-4924-aa4f-6a4f1e705200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:21.064648 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dd267-e481-4924-aa4f-6a4f1e705200 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:21.064935 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dd267-e481-4924-aa4f-6a4f1e705200 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:21.065214 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dd267-e481-4924-aa4f-6a4f1e705200 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:21.078568 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213dd267-e481-4924-aa4f-6a4f1e705200 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:21.104999 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213dd267-e481-4924-aa4f-6a4f1e705200 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:21.123209 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-213dd267-e481-4924-aa4f-6a4f1e705200 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 29 20:39:21.124339 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 442/883] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:39:21 2021] GET /identity/v3/users/swift => generated 83 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:21.130978 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a65464-f287-4391-9082-f9a80e9550df admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:21.140344 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a65464-f287-4391-9082-f9a80e9550df admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:21.144489 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeeb9f5-e6dd-4e19-9954-865aa8bd040d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:21.145074 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeb9f5-e6dd-4e19-9954-865aa8bd040d admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:21.145357 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeb9f5-e6dd-4e19-9954-865aa8bd040d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:21.145639 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeb9f5-e6dd-4e19-9954-865aa8bd040d admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:21.147216 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeeb9f5-e6dd-4e19-9954-865aa8bd040d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:21.147517 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeeb9f5-e6dd-4e19-9954-865aa8bd040d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:21.173100 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeeb9f5-e6dd-4e19-9954-865aa8bd040d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:21.202793 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 442/884] 10.222.0.37 () {56 vars in 1156 bytes} [Wed Dec 29 20:39:21 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:21.209150 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213dd267-e481-4924-aa4f-6a4f1e705200 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:21.219029 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213dd267-e481-4924-aa4f-6a4f1e705200 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:21.223388 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0772585-4d2a-44f9-90c0-329ba0e8376e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:21.224169 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0772585-4d2a-44f9-90c0-329ba0e8376e admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:21.224620 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0772585-4d2a-44f9-90c0-329ba0e8376e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:21.225140 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0772585-4d2a-44f9-90c0-329ba0e8376e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:21.233146 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0772585-4d2a-44f9-90c0-329ba0e8376e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:21.258695 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0772585-4d2a-44f9-90c0-329ba0e8376e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:21.268095 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 443/885] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:39:21 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:39:21.274591 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeeb9f5-e6dd-4e19-9954-865aa8bd040d admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:21.283936 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeeb9f5-e6dd-4e19-9954-865aa8bd040d admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:21.287987 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52eb4c-ddfa-4b41-8f58-6f5de00cbdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:21.288695 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52eb4c-ddfa-4b41-8f58-6f5de00cbdad admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:21.288984 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52eb4c-ddfa-4b41-8f58-6f5de00cbdad admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:21.289263 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52eb4c-ddfa-4b41-8f58-6f5de00cbdad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:21.300453 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52eb4c-ddfa-4b41-8f58-6f5de00cbdad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:21.326935 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52eb4c-ddfa-4b41-8f58-6f5de00cbdad admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:21.343767 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-7a52eb4c-ddfa-4b41-8f58-6f5de00cbdad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:39:21.344813 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 443/886] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:39:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:39:21.350297 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0772585-4d2a-44f9-90c0-329ba0e8376e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:21.358705 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0772585-4d2a-44f9-90c0-329ba0e8376e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:21.362697 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce1f10-a06d-4853-86a7-f5ccefefe699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:21.363264 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce1f10-a06d-4853-86a7-f5ccefefe699 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:21.363547 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce1f10-a06d-4853-86a7-f5ccefefe699 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:21.363825 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce1f10-a06d-4853-86a7-f5ccefefe699 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:21.364495 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce1f10-a06d-4853-86a7-f5ccefefe699 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:21.364787 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce1f10-a06d-4853-86a7-f5ccefefe699 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:21.390022 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce1f10-a06d-4853-86a7-f5ccefefe699 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:21.403000 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 444/887] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:39:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:21.408226 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52eb4c-ddfa-4b41-8f58-6f5de00cbdad admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:21.417329 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52eb4c-ddfa-4b41-8f58-6f5de00cbdad admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:21.421234 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8aa4e-1a69-4245-869e-0e42aed0eb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:21.421924 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8aa4e-1a69-4245-869e-0e42aed0eb0e admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:21.422208 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8aa4e-1a69-4245-869e-0e42aed0eb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:21.422484 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8aa4e-1a69-4245-869e-0e42aed0eb0e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:21.431778 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8aa4e-1a69-4245-869e-0e42aed0eb0e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:21.458011 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8aa4e-1a69-4245-869e-0e42aed0eb0e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:21.471314 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-35e8aa4e-1a69-4245-869e-0e42aed0eb0e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:39:21.472372 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 444/888] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:39:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:21.478050 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce1f10-a06d-4853-86a7-f5ccefefe699 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:21.487103 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce1f10-a06d-4853-86a7-f5ccefefe699 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:21.491638 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f5ee6-2990-474b-95cb-30e6f7056001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:21.492207 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f5ee6-2990-474b-95cb-30e6f7056001 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:21.492495 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f5ee6-2990-474b-95cb-30e6f7056001 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:21.492776 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f5ee6-2990-474b-95cb-30e6f7056001 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:21.493506 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f5ee6-2990-474b-95cb-30e6f7056001 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:21.493808 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f5ee6-2990-474b-95cb-30e6f7056001 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:21.519878 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f5ee6-2990-474b-95cb-30e6f7056001 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:21.532658 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 445/889] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:39:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:21.538552 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8aa4e-1a69-4245-869e-0e42aed0eb0e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:21.547514 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8aa4e-1a69-4245-869e-0e42aed0eb0e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:21.551516 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8064b-63d3-4d90-a0e6-eadac4a95c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:21.552580 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8064b-63d3-4d90-a0e6-eadac4a95c57 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:21.552863 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8064b-63d3-4d90-a0e6-eadac4a95c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:21.553144 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8064b-63d3-4d90-a0e6-eadac4a95c57 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:21.553912 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8064b-63d3-4d90-a0e6-eadac4a95c57 admin admin] RBAC: Adding query filter params (role.id=1c5a8286caa54ded9e44ef97f73f6776, scope.project.id=ed634cf9bb9146f7a9738325a8638b70, user.id=cbd2861e377640c9b76d0dfb08cf088e) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:21.554215 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8064b-63d3-4d90-a0e6-eadac4a95c57 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:21.580248 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8064b-63d3-4d90-a0e6-eadac4a95c57 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:21.585984 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 445/890] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:39:21 2021] GET /identity/v3/role_assignments?user.id=cbd2861e377640c9b76d0dfb08cf088e&scope.project.id=ed634cf9bb9146f7a9738325a8638b70&role.id=1c5a8286caa54ded9e44ef97f73f6776 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:23.512971 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c82ee-e054-4363-b0bf-49b05a3ff581 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:23.513515 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c82ee-e054-4363-b0bf-49b05a3ff581 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:23.513515 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c82ee-e054-4363-b0bf-49b05a3ff581 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:23.515219 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 446/891] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:39:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:39:23.520341 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf25c0-e3ac-4307-a7d4-0e153d3c630c None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:23.520831 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf25c0-e3ac-4307-a7d4-0e153d3c630c None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:23.520954 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf25c0-e3ac-4307-a7d4-0e153d3c630c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:23.543620 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-bebf25c0-e3ac-4307-a7d4-0e153d3c630c None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:39:23.544762 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-bebf25c0-e3ac-4307-a7d4-0e153d3c630c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:39:23.551435 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 446/892] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:39:23 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:39:23.573485 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c82ee-e054-4363-b0bf-49b05a3ff581 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:23.584927 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c82ee-e054-4363-b0bf-49b05a3ff581 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:23.588765 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc92fc2-ee7c-4c5e-8ad1-e3f313381833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:23.589459 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc92fc2-ee7c-4c5e-8ad1-e3f313381833 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:23.589749 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc92fc2-ee7c-4c5e-8ad1-e3f313381833 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:23.590031 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc92fc2-ee7c-4c5e-8ad1-e3f313381833 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:23.601476 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc92fc2-ee7c-4c5e-8ad1-e3f313381833 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:39:23.607724 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-4dc92fc2-ee7c-4c5e-8ad1-e3f313381833 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 29 20:39:23.608776 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 447/893] 10.222.0.37 () {56 vars in 1123 bytes} [Wed Dec 29 20:39:23 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:23.614408 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf25c0-e3ac-4307-a7d4-0e153d3c630c None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:23.622930 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf25c0-e3ac-4307-a7d4-0e153d3c630c None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:23.626939 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f43954-ff5e-401f-8bbb-9611a65be68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:23.627520 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f43954-ff5e-401f-8bbb-9611a65be68f admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:23.627809 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f43954-ff5e-401f-8bbb-9611a65be68f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:23.628089 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f43954-ff5e-401f-8bbb-9611a65be68f admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:23.628792 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f43954-ff5e-401f-8bbb-9611a65be68f admin admin] RBAC: Adding query filter params (name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:23.629088 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f43954-ff5e-401f-8bbb-9611a65be68f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:23.655295 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f43954-ff5e-401f-8bbb-9611a65be68f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:23.663633 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 447/894] 10.222.0.37 () {56 vars in 1124 bytes} [Wed Dec 29 20:39:23 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:23.669110 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc92fc2-ee7c-4c5e-8ad1-e3f313381833 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:23.679435 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc92fc2-ee7c-4c5e-8ad1-e3f313381833 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:23.683497 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf6ea7-aaef-4e90-8f7c-9e4ceb491765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:23.684189 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf6ea7-aaef-4e90-8f7c-9e4ceb491765 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:23.684475 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf6ea7-aaef-4e90-8f7c-9e4ceb491765 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:23.684757 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf6ea7-aaef-4e90-8f7c-9e4ceb491765 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:23.696389 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf6ea7-aaef-4e90-8f7c-9e4ceb491765 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:23.722550 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf6ea7-aaef-4e90-8f7c-9e4ceb491765 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:23.741418 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-a4cf6ea7-aaef-4e90-8f7c-9e4ceb491765 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:39:23.742462 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 448/895] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:39:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:23.747962 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f43954-ff5e-401f-8bbb-9611a65be68f admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:23.757674 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f43954-ff5e-401f-8bbb-9611a65be68f admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:23.761725 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4b542-7d33-422d-bc73-7c346fe1b179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:23.762301 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4b542-7d33-422d-bc73-7c346fe1b179 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:23.762592 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4b542-7d33-422d-bc73-7c346fe1b179 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:23.762910 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4b542-7d33-422d-bc73-7c346fe1b179 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:23.763643 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4b542-7d33-422d-bc73-7c346fe1b179 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:23.763894 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4b542-7d33-422d-bc73-7c346fe1b179 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:23.790125 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4b542-7d33-422d-bc73-7c346fe1b179 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:23.803327 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 448/896] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:39:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:23.808748 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf6ea7-aaef-4e90-8f7c-9e4ceb491765 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:23.818503 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf6ea7-aaef-4e90-8f7c-9e4ceb491765 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:23.822857 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141833e4-5d27-45db-9144-9baadad2bc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:23.823555 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141833e4-5d27-45db-9144-9baadad2bc8f admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:23.823843 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141833e4-5d27-45db-9144-9baadad2bc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:23.824123 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141833e4-5d27-45db-9144-9baadad2bc8f admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:23.836401 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141833e4-5d27-45db-9144-9baadad2bc8f admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:23.861718 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141833e4-5d27-45db-9144-9baadad2bc8f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:23.879571 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-141833e4-5d27-45db-9144-9baadad2bc8f admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 29 20:39:23.881443 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 449/897] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:39:23 2021] GET /identity/v3/users/swift => generated 83 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:23.887089 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4b542-7d33-422d-bc73-7c346fe1b179 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:23.901378 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4b542-7d33-422d-bc73-7c346fe1b179 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:23.905513 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d44110-40f6-4693-bcbb-1e9cfd251862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:23.906103 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d44110-40f6-4693-bcbb-1e9cfd251862 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:23.906390 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d44110-40f6-4693-bcbb-1e9cfd251862 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:23.906697 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d44110-40f6-4693-bcbb-1e9cfd251862 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:23.907486 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d44110-40f6-4693-bcbb-1e9cfd251862 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:23.907787 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d44110-40f6-4693-bcbb-1e9cfd251862 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:23.933998 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d44110-40f6-4693-bcbb-1e9cfd251862 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:23.962707 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 449/898] 10.222.0.37 () {56 vars in 1156 bytes} [Wed Dec 29 20:39:23 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:23.968355 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141833e4-5d27-45db-9144-9baadad2bc8f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:23.977769 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141833e4-5d27-45db-9144-9baadad2bc8f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:23.981718 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9777b7-5623-44b7-8d10-7240416c53db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:23.982427 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9777b7-5623-44b7-8d10-7240416c53db admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:23.982744 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9777b7-5623-44b7-8d10-7240416c53db admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:23.983025 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9777b7-5623-44b7-8d10-7240416c53db admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:23.995465 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9777b7-5623-44b7-8d10-7240416c53db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:24.021360 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9777b7-5623-44b7-8d10-7240416c53db admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:24.037515 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-cf9777b7-5623-44b7-8d10-7240416c53db admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:39:24.038553 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 450/899] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:39:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:24.044008 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d44110-40f6-4693-bcbb-1e9cfd251862 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:24.053063 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d44110-40f6-4693-bcbb-1e9cfd251862 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:24.057039 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ff95c-a4c1-4696-bef1-a95127db5e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:24.057611 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ff95c-a4c1-4696-bef1-a95127db5e47 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:24.057893 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ff95c-a4c1-4696-bef1-a95127db5e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:24.058170 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ff95c-a4c1-4696-bef1-a95127db5e47 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:24.058871 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ff95c-a4c1-4696-bef1-a95127db5e47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:24.059168 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ff95c-a4c1-4696-bef1-a95127db5e47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:24.085495 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ff95c-a4c1-4696-bef1-a95127db5e47 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:24.097662 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 450/900] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:39:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:39:24.103235 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9777b7-5623-44b7-8d10-7240416c53db admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:24.112219 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9777b7-5623-44b7-8d10-7240416c53db admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:24.116358 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bde0a-b4c6-479e-97b7-c83da5bd9d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:24.117054 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bde0a-b4c6-479e-97b7-c83da5bd9d63 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:24.117344 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bde0a-b4c6-479e-97b7-c83da5bd9d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:24.117623 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bde0a-b4c6-479e-97b7-c83da5bd9d63 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:24.126250 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86bde0a-b4c6-479e-97b7-c83da5bd9d63 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:24.152752 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86bde0a-b4c6-479e-97b7-c83da5bd9d63 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:24.165752 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-e86bde0a-b4c6-479e-97b7-c83da5bd9d63 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:39:24.166800 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 451/901] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:39:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:24.172268 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ff95c-a4c1-4696-bef1-a95127db5e47 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:24.181799 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ff95c-a4c1-4696-bef1-a95127db5e47 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:24.185866 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d68ba-2b4e-4b38-84a0-bb38863ae6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:24.186441 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d68ba-2b4e-4b38-84a0-bb38863ae6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:24.186770 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d68ba-2b4e-4b38-84a0-bb38863ae6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:24.187054 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d68ba-2b4e-4b38-84a0-bb38863ae6f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:24.187791 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d68ba-2b4e-4b38-84a0-bb38863ae6f0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:24.188093 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d68ba-2b4e-4b38-84a0-bb38863ae6f0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:24.215792 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d68ba-2b4e-4b38-84a0-bb38863ae6f0 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:24.228589 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 451/902] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:39:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:24.234052 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bde0a-b4c6-479e-97b7-c83da5bd9d63 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:24.243198 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bde0a-b4c6-479e-97b7-c83da5bd9d63 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:24.247186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64c989-bee6-44e2-8c04-840b460323b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:24.247981 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64c989-bee6-44e2-8c04-840b460323b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:24.248268 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64c989-bee6-44e2-8c04-840b460323b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:24.248554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64c989-bee6-44e2-8c04-840b460323b1 admin admin] PATH_INFO: `/v3/projects/ed634cf9bb9146f7a9738325a8638b70/users/cbd2861e377640c9b76d0dfb08cf088e/roles/1c5a8286caa54ded9e44ef97f73f6776` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:24.268416 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d64c989-bee6-44e2-8c04-840b460323b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed634cf9bb9146f7a9738325a8638b70, user_id=cbd2861e377640c9b76d0dfb08cf088e, role_id=1c5a8286caa54ded9e44ef97f73f6776)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:24.295231 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d64c989-bee6-44e2-8c04-840b460323b1 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:24.308173 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 452/903] 10.222.0.37 () {58 vars in 1460 bytes} [Wed Dec 29 20:39:24 2021] PUT /identity/v3/projects/ed634cf9bb9146f7a9738325a8638b70/users/cbd2861e377640c9b76d0dfb08cf088e/roles/1c5a8286caa54ded9e44ef97f73f6776 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:39:26.250081 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7677d-3a00-47ed-adf4-768214f32137 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:26.250575 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7677d-3a00-47ed-adf4-768214f32137 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:26.250575 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7677d-3a00-47ed-adf4-768214f32137 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:26.252240 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 452/904] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:39:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:39:26.258187 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951031f-1578-409b-b742-fefc24f1f013 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:26.258597 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951031f-1578-409b-b742-fefc24f1f013 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:26.258779 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951031f-1578-409b-b742-fefc24f1f013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:26.280535 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-8951031f-1578-409b-b742-fefc24f1f013 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:39:26.281654 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-8951031f-1578-409b-b742-fefc24f1f013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:39:26.343648 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 453/905] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:39:26 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:39:26.367177 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7677d-3a00-47ed-adf4-768214f32137 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:26.378427 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7677d-3a00-47ed-adf4-768214f32137 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:26.382318 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf42bd4-0f54-4ae2-a28a-f955a4b7cc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:26.383055 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf42bd4-0f54-4ae2-a28a-f955a4b7cc6d admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:26.383340 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf42bd4-0f54-4ae2-a28a-f955a4b7cc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:26.383616 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf42bd4-0f54-4ae2-a28a-f955a4b7cc6d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:26.394365 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf42bd4-0f54-4ae2-a28a-f955a4b7cc6d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:39:26.400726 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-8bf42bd4-0f54-4ae2-a28a-f955a4b7cc6d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 29 20:39:26.401777 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 453/906] 10.222.0.37 () {56 vars in 1123 bytes} [Wed Dec 29 20:39:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:26.407357 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951031f-1578-409b-b742-fefc24f1f013 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:26.416226 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951031f-1578-409b-b742-fefc24f1f013 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:26.420219 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c651df7-a06b-42c6-b23e-edfcb1a149eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:26.420800 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c651df7-a06b-42c6-b23e-edfcb1a149eb admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:26.421089 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c651df7-a06b-42c6-b23e-edfcb1a149eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:26.421371 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c651df7-a06b-42c6-b23e-edfcb1a149eb admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:26.422066 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c651df7-a06b-42c6-b23e-edfcb1a149eb admin admin] RBAC: Adding query filter params (name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:26.422362 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c651df7-a06b-42c6-b23e-edfcb1a149eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:26.448413 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c651df7-a06b-42c6-b23e-edfcb1a149eb admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:26.456563 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 454/907] 10.222.0.37 () {56 vars in 1124 bytes} [Wed Dec 29 20:39:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:26.462067 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf42bd4-0f54-4ae2-a28a-f955a4b7cc6d admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:26.471502 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf42bd4-0f54-4ae2-a28a-f955a4b7cc6d admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:26.476180 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586165e-ce53-4dda-9617-d43d1acc4547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:26.476866 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586165e-ce53-4dda-9617-d43d1acc4547 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:26.477150 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586165e-ce53-4dda-9617-d43d1acc4547 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:26.477428 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586165e-ce53-4dda-9617-d43d1acc4547 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:26.488196 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586165e-ce53-4dda-9617-d43d1acc4547 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:26.514168 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586165e-ce53-4dda-9617-d43d1acc4547 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:26.532159 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-6586165e-ce53-4dda-9617-d43d1acc4547 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:39:26.533177 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 454/908] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:39:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:26.539070 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c651df7-a06b-42c6-b23e-edfcb1a149eb admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:26.548050 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c651df7-a06b-42c6-b23e-edfcb1a149eb admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:26.552576 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcb466-87e7-4245-80d6-3920b18812fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:26.553146 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcb466-87e7-4245-80d6-3920b18812fa admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:26.553432 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcb466-87e7-4245-80d6-3920b18812fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:26.553709 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcb466-87e7-4245-80d6-3920b18812fa admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:26.554379 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbcb466-87e7-4245-80d6-3920b18812fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:26.554704 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbcb466-87e7-4245-80d6-3920b18812fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:26.580053 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbcb466-87e7-4245-80d6-3920b18812fa admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:26.592282 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 455/909] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:39:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:26.597642 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586165e-ce53-4dda-9617-d43d1acc4547 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:26.607313 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586165e-ce53-4dda-9617-d43d1acc4547 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:26.611253 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2edf07-e9a2-466a-83b3-94fc70559dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:26.611947 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2edf07-e9a2-466a-83b3-94fc70559dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:26.612228 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2edf07-e9a2-466a-83b3-94fc70559dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:26.612501 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2edf07-e9a2-466a-83b3-94fc70559dd0 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:26.702403 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2edf07-e9a2-466a-83b3-94fc70559dd0 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:26.729369 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2edf07-e9a2-466a-83b3-94fc70559dd0 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:26.748145 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-9a2edf07-e9a2-466a-83b3-94fc70559dd0 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 29 20:39:26.749221 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 455/910] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:39:26 2021] GET /identity/v3/users/swift => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:26.755211 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcb466-87e7-4245-80d6-3920b18812fa admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:26.764479 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcb466-87e7-4245-80d6-3920b18812fa admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:26.768404 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6859b73-0c66-4035-b382-eed01b8b0dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:26.768990 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6859b73-0c66-4035-b382-eed01b8b0dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:26.769279 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6859b73-0c66-4035-b382-eed01b8b0dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:26.769558 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6859b73-0c66-4035-b382-eed01b8b0dc7 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:26.770950 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6859b73-0c66-4035-b382-eed01b8b0dc7 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:26.771281 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6859b73-0c66-4035-b382-eed01b8b0dc7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:26.797129 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6859b73-0c66-4035-b382-eed01b8b0dc7 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:26.825202 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 456/911] 10.222.0.37 () {56 vars in 1156 bytes} [Wed Dec 29 20:39:26 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:26.830774 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2edf07-e9a2-466a-83b3-94fc70559dd0 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:26.840327 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2edf07-e9a2-466a-83b3-94fc70559dd0 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:26.844286 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a765aa-7fa5-44c0-83e6-dab012693d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:26.844845 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a765aa-7fa5-44c0-83e6-dab012693d23 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:26.845146 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a765aa-7fa5-44c0-83e6-dab012693d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:26.845407 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a765aa-7fa5-44c0-83e6-dab012693d23 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:26.853349 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a765aa-7fa5-44c0-83e6-dab012693d23 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:26.878291 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a765aa-7fa5-44c0-83e6-dab012693d23 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:26.886853 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 456/912] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:39:26 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:39:26.892500 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6859b73-0c66-4035-b382-eed01b8b0dc7 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:26.902393 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6859b73-0c66-4035-b382-eed01b8b0dc7 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:26.906380 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef0c50-017d-40ed-8635-f803b05def09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:26.907113 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef0c50-017d-40ed-8635-f803b05def09 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:26.907399 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef0c50-017d-40ed-8635-f803b05def09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:26.907677 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef0c50-017d-40ed-8635-f803b05def09 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:26.919609 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef0c50-017d-40ed-8635-f803b05def09 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:26.944916 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef0c50-017d-40ed-8635-f803b05def09 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:26.962345 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-97ef0c50-017d-40ed-8635-f803b05def09 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:39:26.963410 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 457/913] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:39:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:26.968786 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a765aa-7fa5-44c0-83e6-dab012693d23 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:26.977614 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a765aa-7fa5-44c0-83e6-dab012693d23 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:26.981606 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34d73d-af74-4023-ad8a-93b1a38dc0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:26.982170 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34d73d-af74-4023-ad8a-93b1a38dc0ad admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:26.982453 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34d73d-af74-4023-ad8a-93b1a38dc0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:26.982764 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34d73d-af74-4023-ad8a-93b1a38dc0ad admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:26.983434 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34d73d-af74-4023-ad8a-93b1a38dc0ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:26.983724 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34d73d-af74-4023-ad8a-93b1a38dc0ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:27.008872 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34d73d-af74-4023-ad8a-93b1a38dc0ad admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:27.021705 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 457/914] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:39:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:27.026921 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef0c50-017d-40ed-8635-f803b05def09 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:27.036059 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef0c50-017d-40ed-8635-f803b05def09 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:27.040349 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56709a4-b1b9-41aa-985e-34c0f0951609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:27.041043 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56709a4-b1b9-41aa-985e-34c0f0951609 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:27.041331 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56709a4-b1b9-41aa-985e-34c0f0951609 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:27.041609 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56709a4-b1b9-41aa-985e-34c0f0951609 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:27.051909 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56709a4-b1b9-41aa-985e-34c0f0951609 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:27.077893 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56709a4-b1b9-41aa-985e-34c0f0951609 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:27.091627 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-f56709a4-b1b9-41aa-985e-34c0f0951609 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:39:27.092652 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 458/915] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:39:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:27.098263 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34d73d-af74-4023-ad8a-93b1a38dc0ad admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:27.107450 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34d73d-af74-4023-ad8a-93b1a38dc0ad admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:27.111512 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aaedbb-f67c-4ef9-85ce-9af2c2e745f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:27.112086 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aaedbb-f67c-4ef9-85ce-9af2c2e745f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:27.112372 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aaedbb-f67c-4ef9-85ce-9af2c2e745f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:27.112653 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aaedbb-f67c-4ef9-85ce-9af2c2e745f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:27.113390 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aaedbb-f67c-4ef9-85ce-9af2c2e745f3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:27.113690 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aaedbb-f67c-4ef9-85ce-9af2c2e745f3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:27.139887 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aaedbb-f67c-4ef9-85ce-9af2c2e745f3 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:27.153184 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 458/916] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:39:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:27.158677 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56709a4-b1b9-41aa-985e-34c0f0951609 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:27.167986 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56709a4-b1b9-41aa-985e-34c0f0951609 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:27.171962 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b754e42-a6c9-453f-925d-53229b970656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:27.172523 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b754e42-a6c9-453f-925d-53229b970656 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:27.172810 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b754e42-a6c9-453f-925d-53229b970656 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:27.173088 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b754e42-a6c9-453f-925d-53229b970656 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:27.173849 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b754e42-a6c9-453f-925d-53229b970656 admin admin] RBAC: Adding query filter params (role.id=1c5a8286caa54ded9e44ef97f73f6776, scope.project.id=ed634cf9bb9146f7a9738325a8638b70, user.id=cbd2861e377640c9b76d0dfb08cf088e) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:27.174150 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b754e42-a6c9-453f-925d-53229b970656 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:27.200385 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b754e42-a6c9-453f-925d-53229b970656 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:27.205917 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 459/917] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:39:27 2021] GET /identity/v3/role_assignments?user.id=cbd2861e377640c9b76d0dfb08cf088e&scope.project.id=ed634cf9bb9146f7a9738325a8638b70&role.id=1c5a8286caa54ded9e44ef97f73f6776 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:29.167603 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31554c0f-fcf7-450f-91fc-bc84075bf2ce None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:29.168149 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31554c0f-fcf7-450f-91fc-bc84075bf2ce None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:29.168149 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31554c0f-fcf7-450f-91fc-bc84075bf2ce None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:29.169744 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 459/918] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:39:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:39:29.175039 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08729cf5-f965-4c4e-83d9-33383f82e28e None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:29.175461 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08729cf5-f965-4c4e-83d9-33383f82e28e None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:29.175636 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08729cf5-f965-4c4e-83d9-33383f82e28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:29.274608 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-08729cf5-f965-4c4e-83d9-33383f82e28e None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:39:29.275764 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-08729cf5-f965-4c4e-83d9-33383f82e28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:39:29.282357 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 460/919] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:39:29 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:39:29.305262 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31554c0f-fcf7-450f-91fc-bc84075bf2ce None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:29.316662 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31554c0f-fcf7-450f-91fc-bc84075bf2ce None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:29.321300 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ca1ad-83e2-4104-8a80-f50579ada158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:29.322000 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ca1ad-83e2-4104-8a80-f50579ada158 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:29.322288 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ca1ad-83e2-4104-8a80-f50579ada158 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:29.322571 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ca1ad-83e2-4104-8a80-f50579ada158 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:29.334084 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ca1ad-83e2-4104-8a80-f50579ada158 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:39:29.340285 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-935ca1ad-83e2-4104-8a80-f50579ada158 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:39:29.341338 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 460/920] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:39:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:29.346790 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08729cf5-f965-4c4e-83d9-33383f82e28e None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:29.355167 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08729cf5-f965-4c4e-83d9-33383f82e28e None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:29.359098 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac40b4-646b-4bd0-a436-4b3c5ea23c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:29.359673 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac40b4-646b-4bd0-a436-4b3c5ea23c47 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:29.359955 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac40b4-646b-4bd0-a436-4b3c5ea23c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:29.360229 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac40b4-646b-4bd0-a436-4b3c5ea23c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:29.360923 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac40b4-646b-4bd0-a436-4b3c5ea23c47 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:29.361215 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac40b4-646b-4bd0-a436-4b3c5ea23c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:29.386613 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac40b4-646b-4bd0-a436-4b3c5ea23c47 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:29.395028 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 461/921] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:39:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:29.401162 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ca1ad-83e2-4104-8a80-f50579ada158 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:29.410734 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ca1ad-83e2-4104-8a80-f50579ada158 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:29.414947 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769d674-e013-48f9-b5b1-2f418c3192bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:29.415640 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769d674-e013-48f9-b5b1-2f418c3192bd admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:29.415930 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769d674-e013-48f9-b5b1-2f418c3192bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:29.416208 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769d674-e013-48f9-b5b1-2f418c3192bd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:29.427469 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769d674-e013-48f9-b5b1-2f418c3192bd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:29.453381 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769d674-e013-48f9-b5b1-2f418c3192bd admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:29.470869 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-e769d674-e013-48f9-b5b1-2f418c3192bd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:39:29.471900 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 461/922] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:39:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:29.477186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac40b4-646b-4bd0-a436-4b3c5ea23c47 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:29.486114 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac40b4-646b-4bd0-a436-4b3c5ea23c47 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:29.490089 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9d795-8de3-48c6-b2db-e24abeca9dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:29.490675 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9d795-8de3-48c6-b2db-e24abeca9dbe admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:29.490960 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9d795-8de3-48c6-b2db-e24abeca9dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:29.491237 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9d795-8de3-48c6-b2db-e24abeca9dbe admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:29.491903 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9d795-8de3-48c6-b2db-e24abeca9dbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:29.492196 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9d795-8de3-48c6-b2db-e24abeca9dbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:29.517361 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9d795-8de3-48c6-b2db-e24abeca9dbe admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:29.529584 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 462/923] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:39:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:29.534954 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769d674-e013-48f9-b5b1-2f418c3192bd admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:29.544422 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769d674-e013-48f9-b5b1-2f418c3192bd admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:29.548422 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2b688-93c3-45e5-9a7f-8100b1730564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:29.549115 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2b688-93c3-45e5-9a7f-8100b1730564 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:29.549401 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2b688-93c3-45e5-9a7f-8100b1730564 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:29.549680 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2b688-93c3-45e5-9a7f-8100b1730564 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:29.562161 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2b688-93c3-45e5-9a7f-8100b1730564 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:29.589263 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2b688-93c3-45e5-9a7f-8100b1730564 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:29.606309 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-e2f2b688-93c3-45e5-9a7f-8100b1730564 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 29 20:39:29.607387 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 462/924] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:39:29 2021] GET /identity/v3/users/swift => generated 83 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:29.612853 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9d795-8de3-48c6-b2db-e24abeca9dbe admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:29.622058 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9d795-8de3-48c6-b2db-e24abeca9dbe admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:29.626080 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a93869-3ac2-4a4f-b309-280c8c20f9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:29.626683 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a93869-3ac2-4a4f-b309-280c8c20f9ae admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:29.626973 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a93869-3ac2-4a4f-b309-280c8c20f9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:29.627254 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a93869-3ac2-4a4f-b309-280c8c20f9ae admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:29.628034 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a93869-3ac2-4a4f-b309-280c8c20f9ae admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:29.628335 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a93869-3ac2-4a4f-b309-280c8c20f9ae admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:29.654820 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a93869-3ac2-4a4f-b309-280c8c20f9ae admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:29.683244 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 463/925] 10.222.0.37 () {56 vars in 1156 bytes} [Wed Dec 29 20:39:29 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:29.688775 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2b688-93c3-45e5-9a7f-8100b1730564 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:29.698959 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2b688-93c3-45e5-9a7f-8100b1730564 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:29.702954 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca917657-238b-4d3a-a5a3-3108547b2ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:29.703516 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca917657-238b-4d3a-a5a3-3108547b2ecc admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:29.703802 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca917657-238b-4d3a-a5a3-3108547b2ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:29.704080 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca917657-238b-4d3a-a5a3-3108547b2ecc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:29.711565 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca917657-238b-4d3a-a5a3-3108547b2ecc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:29.736885 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca917657-238b-4d3a-a5a3-3108547b2ecc admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:29.746685 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 463/926] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:39:29 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:39:29.752129 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a93869-3ac2-4a4f-b309-280c8c20f9ae admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:29.761760 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a93869-3ac2-4a4f-b309-280c8c20f9ae admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:29.765742 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3c4ea-8b3e-428d-b32a-afdd22ae664b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:29.766441 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3c4ea-8b3e-428d-b32a-afdd22ae664b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:29.766763 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3c4ea-8b3e-428d-b32a-afdd22ae664b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:29.767046 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3c4ea-8b3e-428d-b32a-afdd22ae664b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:29.778266 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3c4ea-8b3e-428d-b32a-afdd22ae664b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:29.803970 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3c4ea-8b3e-428d-b32a-afdd22ae664b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:29.820953 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-b0c3c4ea-8b3e-428d-b32a-afdd22ae664b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:39:29.822012 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 464/927] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:39:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:29.827382 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca917657-238b-4d3a-a5a3-3108547b2ecc admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:29.835881 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca917657-238b-4d3a-a5a3-3108547b2ecc admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:29.840037 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae332b-a712-4527-b3b4-6ab3add3333c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:29.840610 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae332b-a712-4527-b3b4-6ab3add3333c admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:29.840895 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae332b-a712-4527-b3b4-6ab3add3333c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:29.841175 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae332b-a712-4527-b3b4-6ab3add3333c admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:29.841848 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae332b-a712-4527-b3b4-6ab3add3333c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:29.842144 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae332b-a712-4527-b3b4-6ab3add3333c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:29.868132 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae332b-a712-4527-b3b4-6ab3add3333c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:29.881473 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 464/928] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:39:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:39:29.886886 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3c4ea-8b3e-428d-b32a-afdd22ae664b admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:29.896207 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3c4ea-8b3e-428d-b32a-afdd22ae664b admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:29.900229 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9617cc-e553-4f54-9607-0b15ea918137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:29.900926 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9617cc-e553-4f54-9607-0b15ea918137 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:29.901211 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9617cc-e553-4f54-9607-0b15ea918137 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:29.901489 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9617cc-e553-4f54-9607-0b15ea918137 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:29.910087 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9617cc-e553-4f54-9607-0b15ea918137 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:29.936084 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9617cc-e553-4f54-9607-0b15ea918137 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:29.950338 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-ed9617cc-e553-4f54-9607-0b15ea918137 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:39:29.951502 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 465/929] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:39:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:29.957311 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae332b-a712-4527-b3b4-6ab3add3333c admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:29.966416 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae332b-a712-4527-b3b4-6ab3add3333c admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:29.970384 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dccc5-c851-4d96-a32f-bbba654af39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:29.970993 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dccc5-c851-4d96-a32f-bbba654af39c admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:29.971277 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dccc5-c851-4d96-a32f-bbba654af39c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:29.971551 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dccc5-c851-4d96-a32f-bbba654af39c admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:29.972280 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dccc5-c851-4d96-a32f-bbba654af39c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:29.972578 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dccc5-c851-4d96-a32f-bbba654af39c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:29.998222 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dccc5-c851-4d96-a32f-bbba654af39c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:30.011436 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 465/930] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:39:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:30.017070 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9617cc-e553-4f54-9607-0b15ea918137 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:30.026089 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9617cc-e553-4f54-9607-0b15ea918137 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:30.029972 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c101652-fa2c-4205-bfe6-baa27d26c5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:30.030534 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c101652-fa2c-4205-bfe6-baa27d26c5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:30.030853 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c101652-fa2c-4205-bfe6-baa27d26c5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:30.031130 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c101652-fa2c-4205-bfe6-baa27d26c5a6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:30.031891 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c101652-fa2c-4205-bfe6-baa27d26c5a6 admin admin] RBAC: Adding query filter params (role.id=e66e6a94ba014fd193b851ceb92695ae, scope.project.id=ed634cf9bb9146f7a9738325a8638b70, user.id=cbd2861e377640c9b76d0dfb08cf088e) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:30.032186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c101652-fa2c-4205-bfe6-baa27d26c5a6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:30.058586 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c101652-fa2c-4205-bfe6-baa27d26c5a6 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:30.063713 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 466/931] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:39:30 2021] GET /identity/v3/role_assignments?user.id=cbd2861e377640c9b76d0dfb08cf088e&scope.project.id=ed634cf9bb9146f7a9738325a8638b70&role.id=e66e6a94ba014fd193b851ceb92695ae => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:31.973844 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf38f6-a123-45a8-b428-5817cfbfc66a None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:31.974379 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf38f6-a123-45a8-b428-5817cfbfc66a None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:31.974379 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf38f6-a123-45a8-b428-5817cfbfc66a None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:31.976068 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 466/932] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:39:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:39:31.981245 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51e685-6624-44d1-87a6-550d9b57ddc0 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:31.981656 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51e685-6624-44d1-87a6-550d9b57ddc0 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:31.981822 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51e685-6624-44d1-87a6-550d9b57ddc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:32.005959 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-ce51e685-6624-44d1-87a6-550d9b57ddc0 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:39:32.007127 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-ce51e685-6624-44d1-87a6-550d9b57ddc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:39:32.013844 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 467/933] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:39:31 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:39:32.035131 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf38f6-a123-45a8-b428-5817cfbfc66a None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:32.046641 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf38f6-a123-45a8-b428-5817cfbfc66a None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:32.050448 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b24378-f3bf-4220-b756-01b89f3cf525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:32.051863 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b24378-f3bf-4220-b756-01b89f3cf525 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:32.052139 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b24378-f3bf-4220-b756-01b89f3cf525 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:32.052414 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b24378-f3bf-4220-b756-01b89f3cf525 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:32.063108 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b24378-f3bf-4220-b756-01b89f3cf525 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:39:32.069789 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-f8b24378-f3bf-4220-b756-01b89f3cf525 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:39:32.071133 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 467/934] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:39:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:32.076982 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51e685-6624-44d1-87a6-550d9b57ddc0 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:32.085595 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51e685-6624-44d1-87a6-550d9b57ddc0 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:32.089582 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33745f89-fb1c-4809-8e93-07f5bed40f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:32.090162 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33745f89-fb1c-4809-8e93-07f5bed40f9c admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:32.090448 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33745f89-fb1c-4809-8e93-07f5bed40f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:32.090761 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33745f89-fb1c-4809-8e93-07f5bed40f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:32.091462 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33745f89-fb1c-4809-8e93-07f5bed40f9c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:32.091757 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33745f89-fb1c-4809-8e93-07f5bed40f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:32.118919 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33745f89-fb1c-4809-8e93-07f5bed40f9c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:32.127495 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 468/935] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:39:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:32.135407 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b24378-f3bf-4220-b756-01b89f3cf525 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:32.145053 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b24378-f3bf-4220-b756-01b89f3cf525 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:32.149218 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457e48c-43a0-4869-97b4-3d68b513f790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:32.149919 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457e48c-43a0-4869-97b4-3d68b513f790 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:32.150203 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457e48c-43a0-4869-97b4-3d68b513f790 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:32.150481 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457e48c-43a0-4869-97b4-3d68b513f790 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:32.161568 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457e48c-43a0-4869-97b4-3d68b513f790 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:32.187330 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457e48c-43a0-4869-97b4-3d68b513f790 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:32.204786 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-3457e48c-43a0-4869-97b4-3d68b513f790 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:39:32.205851 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 468/936] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:39:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:32.211394 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33745f89-fb1c-4809-8e93-07f5bed40f9c admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:32.220706 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33745f89-fb1c-4809-8e93-07f5bed40f9c admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:32.225531 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef938d1d-6291-4fa7-bdde-5e20f5bbc6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:32.226353 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef938d1d-6291-4fa7-bdde-5e20f5bbc6ce admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:32.226706 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef938d1d-6291-4fa7-bdde-5e20f5bbc6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:32.226990 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef938d1d-6291-4fa7-bdde-5e20f5bbc6ce admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:32.227671 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef938d1d-6291-4fa7-bdde-5e20f5bbc6ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:32.227967 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef938d1d-6291-4fa7-bdde-5e20f5bbc6ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:32.255138 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef938d1d-6291-4fa7-bdde-5e20f5bbc6ce admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:32.273442 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 469/937] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:39:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:32.279648 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457e48c-43a0-4869-97b4-3d68b513f790 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:32.289659 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457e48c-43a0-4869-97b4-3d68b513f790 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:32.293734 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101431b1-e078-4f9d-9c9c-24dabdf43b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:32.294447 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101431b1-e078-4f9d-9c9c-24dabdf43b56 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:32.294766 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101431b1-e078-4f9d-9c9c-24dabdf43b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:32.295051 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101431b1-e078-4f9d-9c9c-24dabdf43b56 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:32.309850 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101431b1-e078-4f9d-9c9c-24dabdf43b56 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:32.340196 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101431b1-e078-4f9d-9c9c-24dabdf43b56 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:32.360711 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-101431b1-e078-4f9d-9c9c-24dabdf43b56 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 29 20:39:32.361850 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 469/938] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:39:32 2021] GET /identity/v3/users/swift => generated 83 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:32.369581 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef938d1d-6291-4fa7-bdde-5e20f5bbc6ce admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:32.381302 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef938d1d-6291-4fa7-bdde-5e20f5bbc6ce admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:32.385738 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65611f1-868e-4bf9-86b5-7a8be36c4604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:32.386332 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65611f1-868e-4bf9-86b5-7a8be36c4604 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:32.386619 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65611f1-868e-4bf9-86b5-7a8be36c4604 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:32.386933 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65611f1-868e-4bf9-86b5-7a8be36c4604 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:32.387721 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65611f1-868e-4bf9-86b5-7a8be36c4604 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:32.388023 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65611f1-868e-4bf9-86b5-7a8be36c4604 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:32.419579 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65611f1-868e-4bf9-86b5-7a8be36c4604 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:32.451446 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 470/939] 10.222.0.37 () {56 vars in 1156 bytes} [Wed Dec 29 20:39:32 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:32.457059 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101431b1-e078-4f9d-9c9c-24dabdf43b56 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:32.468462 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101431b1-e078-4f9d-9c9c-24dabdf43b56 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:32.472496 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdaf658-3bcc-4490-b19a-dda2074601a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:32.474340 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdaf658-3bcc-4490-b19a-dda2074601a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:32.474636 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdaf658-3bcc-4490-b19a-dda2074601a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:32.474956 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdaf658-3bcc-4490-b19a-dda2074601a9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:32.488445 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdaf658-3bcc-4490-b19a-dda2074601a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:32.519604 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdaf658-3bcc-4490-b19a-dda2074601a9 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:32.539276 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-3bdaf658-3bcc-4490-b19a-dda2074601a9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:39:32.540407 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 470/940] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:39:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:32.549359 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65611f1-868e-4bf9-86b5-7a8be36c4604 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:32.559455 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65611f1-868e-4bf9-86b5-7a8be36c4604 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:32.563752 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ffd34-341d-4a49-baf4-3db5aedac1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:32.564332 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ffd34-341d-4a49-baf4-3db5aedac1fa admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:32.564614 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ffd34-341d-4a49-baf4-3db5aedac1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:32.564893 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ffd34-341d-4a49-baf4-3db5aedac1fa admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:32.565575 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ffd34-341d-4a49-baf4-3db5aedac1fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:32.565866 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ffd34-341d-4a49-baf4-3db5aedac1fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:32.592407 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ffd34-341d-4a49-baf4-3db5aedac1fa admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:32.609496 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 471/941] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:39:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:32.615840 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdaf658-3bcc-4490-b19a-dda2074601a9 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:32.625096 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdaf658-3bcc-4490-b19a-dda2074601a9 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:32.629105 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cdf18-7158-4399-a729-1f91aeecba71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:32.629917 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cdf18-7158-4399-a729-1f91aeecba71 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:32.630407 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cdf18-7158-4399-a729-1f91aeecba71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:32.630926 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cdf18-7158-4399-a729-1f91aeecba71 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:32.640690 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3cdf18-7158-4399-a729-1f91aeecba71 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:32.668173 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3cdf18-7158-4399-a729-1f91aeecba71 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:32.683732 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-9c3cdf18-7158-4399-a729-1f91aeecba71 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:39:32.684847 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 471/942] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:39:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:32.690954 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ffd34-341d-4a49-baf4-3db5aedac1fa admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:32.700946 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ffd34-341d-4a49-baf4-3db5aedac1fa admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:32.705074 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a58c9-21a6-42f2-945b-9c254cab7dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:32.705663 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a58c9-21a6-42f2-945b-9c254cab7dfa admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:32.705953 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a58c9-21a6-42f2-945b-9c254cab7dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:32.706482 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a58c9-21a6-42f2-945b-9c254cab7dfa admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:32.707970 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a58c9-21a6-42f2-945b-9c254cab7dfa admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:32.708534 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a58c9-21a6-42f2-945b-9c254cab7dfa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:32.738004 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a58c9-21a6-42f2-945b-9c254cab7dfa admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:32.753347 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 472/943] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:39:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:32.760019 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cdf18-7158-4399-a729-1f91aeecba71 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:32.773909 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cdf18-7158-4399-a729-1f91aeecba71 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:32.777976 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34585104-2029-48cd-a340-16d7309da36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:32.778817 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34585104-2029-48cd-a340-16d7309da36a admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:32.779391 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34585104-2029-48cd-a340-16d7309da36a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:32.779723 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34585104-2029-48cd-a340-16d7309da36a admin admin] PATH_INFO: `/v3/projects/ed634cf9bb9146f7a9738325a8638b70/users/cbd2861e377640c9b76d0dfb08cf088e/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:32.781518 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34585104-2029-48cd-a340-16d7309da36a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed634cf9bb9146f7a9738325a8638b70, user_id=cbd2861e377640c9b76d0dfb08cf088e, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:32.812655 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34585104-2029-48cd-a340-16d7309da36a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:32.835740 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 472/944] 10.222.0.37 () {58 vars in 1460 bytes} [Wed Dec 29 20:39:32 2021] PUT /identity/v3/projects/ed634cf9bb9146f7a9738325a8638b70/users/cbd2861e377640c9b76d0dfb08cf088e/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:39:34.786404 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc485818-a7ff-41b2-bd86-5c33edd6dcc9 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:34.786979 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc485818-a7ff-41b2-bd86-5c33edd6dcc9 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:34.786979 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc485818-a7ff-41b2-bd86-5c33edd6dcc9 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:34.788641 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 473/945] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:39:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:39:34.793693 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe0433-5058-4ef2-b1e9-f43fa547405f None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:34.794085 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe0433-5058-4ef2-b1e9-f43fa547405f None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:34.794265 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe0433-5058-4ef2-b1e9-f43fa547405f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:34.816131 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-2cbe0433-5058-4ef2-b1e9-f43fa547405f None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:39:34.817754 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-2cbe0433-5058-4ef2-b1e9-f43fa547405f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:39:34.880667 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 473/946] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:39:34 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:39:34.903810 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc485818-a7ff-41b2-bd86-5c33edd6dcc9 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:34.915633 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc485818-a7ff-41b2-bd86-5c33edd6dcc9 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:34.919507 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bccb7-9ab9-4ed9-83ca-94dca261c050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:34.920207 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bccb7-9ab9-4ed9-83ca-94dca261c050 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:34.920494 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bccb7-9ab9-4ed9-83ca-94dca261c050 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:34.920771 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bccb7-9ab9-4ed9-83ca-94dca261c050 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:34.932229 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bccb7-9ab9-4ed9-83ca-94dca261c050 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:39:34.938293 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-184bccb7-9ab9-4ed9-83ca-94dca261c050 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:39:34.939374 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 474/947] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:39:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:34.946056 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe0433-5058-4ef2-b1e9-f43fa547405f None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:34.954482 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe0433-5058-4ef2-b1e9-f43fa547405f None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:34.959037 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c74b5d-542b-4e96-8e4c-250368cddb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:34.959619 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c74b5d-542b-4e96-8e4c-250368cddb18 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:34.959901 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c74b5d-542b-4e96-8e4c-250368cddb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:34.960176 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c74b5d-542b-4e96-8e4c-250368cddb18 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:34.960876 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c74b5d-542b-4e96-8e4c-250368cddb18 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:34.961167 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c74b5d-542b-4e96-8e4c-250368cddb18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:34.986103 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c74b5d-542b-4e96-8e4c-250368cddb18 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:34.995100 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 474/948] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:39:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:35.000515 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bccb7-9ab9-4ed9-83ca-94dca261c050 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:35.010947 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bccb7-9ab9-4ed9-83ca-94dca261c050 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:35.014967 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ed226-c4b7-47a1-be4a-051ac7e3fc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:35.015659 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ed226-c4b7-47a1-be4a-051ac7e3fc1e admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:35.015944 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ed226-c4b7-47a1-be4a-051ac7e3fc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:35.016225 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ed226-c4b7-47a1-be4a-051ac7e3fc1e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:35.027401 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ed226-c4b7-47a1-be4a-051ac7e3fc1e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:35.053022 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ed226-c4b7-47a1-be4a-051ac7e3fc1e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:35.070178 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-d41ed226-c4b7-47a1-be4a-051ac7e3fc1e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:39:35.071486 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 475/949] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:39:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:35.076868 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c74b5d-542b-4e96-8e4c-250368cddb18 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:35.086223 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c74b5d-542b-4e96-8e4c-250368cddb18 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:35.090188 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d52c26-ef31-497e-855e-123d0e43258c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:35.090788 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d52c26-ef31-497e-855e-123d0e43258c admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:35.091074 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d52c26-ef31-497e-855e-123d0e43258c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:35.091357 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d52c26-ef31-497e-855e-123d0e43258c admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:35.092030 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d52c26-ef31-497e-855e-123d0e43258c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:35.092323 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d52c26-ef31-497e-855e-123d0e43258c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:35.118239 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d52c26-ef31-497e-855e-123d0e43258c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:35.131057 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 475/950] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:39:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:35.136384 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ed226-c4b7-47a1-be4a-051ac7e3fc1e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:35.145402 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ed226-c4b7-47a1-be4a-051ac7e3fc1e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:35.149425 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947bc47-f3f0-44af-ba2c-9443cb582cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:35.150120 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947bc47-f3f0-44af-ba2c-9443cb582cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:35.150407 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947bc47-f3f0-44af-ba2c-9443cb582cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:35.150715 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947bc47-f3f0-44af-ba2c-9443cb582cc5 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:35.163009 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947bc47-f3f0-44af-ba2c-9443cb582cc5 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:35.189217 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947bc47-f3f0-44af-ba2c-9443cb582cc5 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:35.206927 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-5947bc47-f3f0-44af-ba2c-9443cb582cc5 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 29 20:39:35.208271 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 476/951] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:39:35 2021] GET /identity/v3/users/swift => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:35.213839 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d52c26-ef31-497e-855e-123d0e43258c admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:35.223168 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d52c26-ef31-497e-855e-123d0e43258c admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:35.227151 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdaf313-58fb-4e0b-ae13-c4fcd6608504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:35.227732 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaf313-58fb-4e0b-ae13-c4fcd6608504 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:35.228015 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaf313-58fb-4e0b-ae13-c4fcd6608504 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:35.228287 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaf313-58fb-4e0b-ae13-c4fcd6608504 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:35.229067 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdaf313-58fb-4e0b-ae13-c4fcd6608504 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:35.229363 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdaf313-58fb-4e0b-ae13-c4fcd6608504 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:35.255875 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdaf313-58fb-4e0b-ae13-c4fcd6608504 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:35.283324 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 476/952] 10.222.0.37 () {56 vars in 1156 bytes} [Wed Dec 29 20:39:35 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:35.289580 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947bc47-f3f0-44af-ba2c-9443cb582cc5 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:35.298722 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947bc47-f3f0-44af-ba2c-9443cb582cc5 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:35.303870 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b180ed0-9067-4070-be7a-9dc08a1555a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:35.304382 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b180ed0-9067-4070-be7a-9dc08a1555a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:35.304699 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b180ed0-9067-4070-be7a-9dc08a1555a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:35.304984 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b180ed0-9067-4070-be7a-9dc08a1555a9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:35.312527 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b180ed0-9067-4070-be7a-9dc08a1555a9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:35.338911 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b180ed0-9067-4070-be7a-9dc08a1555a9 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:35.349192 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 477/953] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:39:35 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:39:35.354531 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdaf313-58fb-4e0b-ae13-c4fcd6608504 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:35.363448 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdaf313-58fb-4e0b-ae13-c4fcd6608504 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:35.367970 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec4ff8-eaaf-4776-a398-967db5d7c064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:35.368662 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec4ff8-eaaf-4776-a398-967db5d7c064 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:35.368945 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec4ff8-eaaf-4776-a398-967db5d7c064 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:35.369223 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec4ff8-eaaf-4776-a398-967db5d7c064 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:35.380276 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec4ff8-eaaf-4776-a398-967db5d7c064 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:35.405370 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec4ff8-eaaf-4776-a398-967db5d7c064 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:35.422031 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-11ec4ff8-eaaf-4776-a398-967db5d7c064 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:39:35.423093 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 477/954] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:39:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:35.429574 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b180ed0-9067-4070-be7a-9dc08a1555a9 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:35.437895 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b180ed0-9067-4070-be7a-9dc08a1555a9 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:35.442645 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24750be8-31e4-464a-99ca-0ec2fa83ba06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:35.443243 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24750be8-31e4-464a-99ca-0ec2fa83ba06 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:35.443532 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24750be8-31e4-464a-99ca-0ec2fa83ba06 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:35.443815 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24750be8-31e4-464a-99ca-0ec2fa83ba06 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:35.444497 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24750be8-31e4-464a-99ca-0ec2fa83ba06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:35.444794 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24750be8-31e4-464a-99ca-0ec2fa83ba06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:35.470461 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24750be8-31e4-464a-99ca-0ec2fa83ba06 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:35.483877 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 478/955] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:39:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:35.489931 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec4ff8-eaaf-4776-a398-967db5d7c064 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:35.498882 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec4ff8-eaaf-4776-a398-967db5d7c064 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:35.502899 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2757e-9de2-4223-9562-7fb8f382b050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:35.503594 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2757e-9de2-4223-9562-7fb8f382b050 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:35.503887 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2757e-9de2-4223-9562-7fb8f382b050 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:35.504203 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2757e-9de2-4223-9562-7fb8f382b050 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:35.513158 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2757e-9de2-4223-9562-7fb8f382b050 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:35.539900 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2757e-9de2-4223-9562-7fb8f382b050 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:35.553810 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-e4d2757e-9de2-4223-9562-7fb8f382b050 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:39:35.554931 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 478/956] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:39:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:35.560402 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24750be8-31e4-464a-99ca-0ec2fa83ba06 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:35.569559 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24750be8-31e4-464a-99ca-0ec2fa83ba06 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:35.573842 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf229c2-ac7a-4a41-b426-6ab25526f8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:35.574412 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf229c2-ac7a-4a41-b426-6ab25526f8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:35.574729 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf229c2-ac7a-4a41-b426-6ab25526f8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:35.575014 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf229c2-ac7a-4a41-b426-6ab25526f8b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:35.575748 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf229c2-ac7a-4a41-b426-6ab25526f8b7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:35.576054 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf229c2-ac7a-4a41-b426-6ab25526f8b7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:35.601646 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf229c2-ac7a-4a41-b426-6ab25526f8b7 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:35.614577 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 479/957] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:39:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:35.620434 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2757e-9de2-4223-9562-7fb8f382b050 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:35.630149 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2757e-9de2-4223-9562-7fb8f382b050 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:35.634617 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7306d-a0a8-4186-b043-d472b54e320a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:35.635220 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7306d-a0a8-4186-b043-d472b54e320a admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:35.635509 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7306d-a0a8-4186-b043-d472b54e320a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:35.635798 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7306d-a0a8-4186-b043-d472b54e320a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:35.636574 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7306d-a0a8-4186-b043-d472b54e320a admin admin] RBAC: Adding query filter params (role.id=e66e6a94ba014fd193b851ceb92695ae, scope.project.id=ed634cf9bb9146f7a9738325a8638b70, user.id=cbd2861e377640c9b76d0dfb08cf088e) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:35.636882 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7306d-a0a8-4186-b043-d472b54e320a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:35.664059 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7306d-a0a8-4186-b043-d472b54e320a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:35.669669 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 479/958] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:39:35 2021] GET /identity/v3/role_assignments?user.id=cbd2861e377640c9b76d0dfb08cf088e&scope.project.id=ed634cf9bb9146f7a9738325a8638b70&role.id=e66e6a94ba014fd193b851ceb92695ae => generated 608 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:37.635818 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbb34a-14ab-48f5-9a64-bd6b05814db1 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:37.636332 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbb34a-14ab-48f5-9a64-bd6b05814db1 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:37.636419 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbb34a-14ab-48f5-9a64-bd6b05814db1 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:37.638064 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 480/959] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:39:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:39:37.643299 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb40c27-c267-4acb-b043-c48060faa78e None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:37.643723 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb40c27-c267-4acb-b043-c48060faa78e None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:37.643865 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb40c27-c267-4acb-b043-c48060faa78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:37.666478 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-4bb40c27-c267-4acb-b043-c48060faa78e None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:39:37.667632 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-4bb40c27-c267-4acb-b043-c48060faa78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:39:37.674220 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 480/960] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:39:37 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:39:37.696713 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbb34a-14ab-48f5-9a64-bd6b05814db1 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:37.708868 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbb34a-14ab-48f5-9a64-bd6b05814db1 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:37.712802 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca50253-ddb8-466e-8a97-b7d9e4ded4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:37.713514 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca50253-ddb8-466e-8a97-b7d9e4ded4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:37.713803 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca50253-ddb8-466e-8a97-b7d9e4ded4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:37.714086 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca50253-ddb8-466e-8a97-b7d9e4ded4a6 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:37.714746 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca50253-ddb8-466e-8a97-b7d9e4ded4a6 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:37.740021 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca50253-ddb8-466e-8a97-b7d9e4ded4a6 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:37.750363 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-2ca50253-ddb8-466e-8a97-b7d9e4ded4a6 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 29 20:39:37.751425 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 481/961] 10.222.0.37 () {56 vars in 1147 bytes} [Wed Dec 29 20:39:37 2021] GET /identity/v3/services/object-store => generated 93 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:37.757763 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb40c27-c267-4acb-b043-c48060faa78e None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:37.766230 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb40c27-c267-4acb-b043-c48060faa78e None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:37.771078 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69d063-5193-481f-9d78-1012bb6b1883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:37.771652 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69d063-5193-481f-9d78-1012bb6b1883 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:37.771938 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69d063-5193-481f-9d78-1012bb6b1883 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:37.772217 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69d063-5193-481f-9d78-1012bb6b1883 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:37.772891 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69d063-5193-481f-9d78-1012bb6b1883 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:37.773188 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69d063-5193-481f-9d78-1012bb6b1883 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:37.798187 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69d063-5193-481f-9d78-1012bb6b1883 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:37.802920 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 481/962] 10.222.0.37 () {56 vars in 1143 bytes} [Wed Dec 29 20:39:37 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:37.808198 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca50253-ddb8-466e-8a97-b7d9e4ded4a6 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:37.817823 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca50253-ddb8-466e-8a97-b7d9e4ded4a6 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:37.822094 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74295830-4931-4d4f-8071-e5e4d1c67332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:37.822676 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74295830-4931-4d4f-8071-e5e4d1c67332 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:37.823027 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74295830-4931-4d4f-8071-e5e4d1c67332 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:37.823309 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74295830-4931-4d4f-8071-e5e4d1c67332 admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:37.823968 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74295830-4931-4d4f-8071-e5e4d1c67332 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:37.824263 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74295830-4931-4d4f-8071-e5e4d1c67332 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:37.850200 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74295830-4931-4d4f-8071-e5e4d1c67332 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:37.854565 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 482/963] 10.222.0.37 () {56 vars in 1143 bytes} [Wed Dec 29 20:39:37 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:39.792543 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942b5dd-d22e-4dd0-9dbc-aa58af8c24b0 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:39.793088 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942b5dd-d22e-4dd0-9dbc-aa58af8c24b0 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:39.793088 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942b5dd-d22e-4dd0-9dbc-aa58af8c24b0 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:39.794880 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 482/964] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:39:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:39:39.799950 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79946112-627e-451b-8151-066b940e8f6d None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:39.800353 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79946112-627e-451b-8151-066b940e8f6d None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:39.800519 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79946112-627e-451b-8151-066b940e8f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:39.823369 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-79946112-627e-451b-8151-066b940e8f6d None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:39:39.824543 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-79946112-627e-451b-8151-066b940e8f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:39:39.831348 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 483/965] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:39:39 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:39:39.853961 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942b5dd-d22e-4dd0-9dbc-aa58af8c24b0 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:39.865603 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942b5dd-d22e-4dd0-9dbc-aa58af8c24b0 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:39.869391 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5bd50-c440-4433-a181-0c997501a7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:39.869961 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5bd50-c440-4433-a181-0c997501a7fa admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:39.870273 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5bd50-c440-4433-a181-0c997501a7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:39.870549 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5bd50-c440-4433-a181-0c997501a7fa admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:39.871253 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5bd50-c440-4433-a181-0c997501a7fa admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:39.897235 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5bd50-c440-4433-a181-0c997501a7fa admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:39.910710 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 483/966] 10.222.0.37 () {60 vars in 1162 bytes} [Wed Dec 29 20:39:39 2021] POST /identity/v3/services => generated 241 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:39:41.845009 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95714176-481c-4288-ba61-3152b93753ce None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:41.845552 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95714176-481c-4288-ba61-3152b93753ce None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:41.845552 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95714176-481c-4288-ba61-3152b93753ce None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:41.847271 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 484/967] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:39:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:39:41.853184 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b167cf-37e7-429c-b3a9-507f1db78aec None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:41.853581 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b167cf-37e7-429c-b3a9-507f1db78aec None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:41.853749 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b167cf-37e7-429c-b3a9-507f1db78aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:41.876928 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-49b167cf-37e7-429c-b3a9-507f1db78aec None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:39:41.878065 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-49b167cf-37e7-429c-b3a9-507f1db78aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:39:41.895509 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 484/968] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:39:41 2021] POST /identity/v3/auth/tokens => generated 3075 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:39:41.922946 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95714176-481c-4288-ba61-3152b93753ce None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:41.934467 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95714176-481c-4288-ba61-3152b93753ce None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:41.938379 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19fa3f-c644-4ec4-9b19-d641b541793f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:41.939132 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19fa3f-c644-4ec4-9b19-d641b541793f admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:41.939420 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19fa3f-c644-4ec4-9b19-d641b541793f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:41.939701 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19fa3f-c644-4ec4-9b19-d641b541793f admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:41.940319 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19fa3f-c644-4ec4-9b19-d641b541793f admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:41.966458 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19fa3f-c644-4ec4-9b19-d641b541793f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:41.977505 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-dd19fa3f-c644-4ec4-9b19-d641b541793f admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 29 20:39:41.978543 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 485/969] 10.222.0.37 () {56 vars in 1147 bytes} [Wed Dec 29 20:39:41 2021] GET /identity/v3/services/object-store => generated 93 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:41.987424 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b167cf-37e7-429c-b3a9-507f1db78aec None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:41.997244 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b167cf-37e7-429c-b3a9-507f1db78aec None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:42.001272 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ee586-989b-4b51-ab1d-8bc4ebc25535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:42.001848 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ee586-989b-4b51-ab1d-8bc4ebc25535 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:42.002133 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ee586-989b-4b51-ab1d-8bc4ebc25535 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:42.002410 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ee586-989b-4b51-ab1d-8bc4ebc25535 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:42.003113 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ee586-989b-4b51-ab1d-8bc4ebc25535 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:42.003408 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ee586-989b-4b51-ab1d-8bc4ebc25535 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:42.029019 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ee586-989b-4b51-ab1d-8bc4ebc25535 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:42.033671 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 485/970] 10.222.0.37 () {56 vars in 1143 bytes} [Wed Dec 29 20:39:41 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:42.039723 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19fa3f-c644-4ec4-9b19-d641b541793f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:42.048859 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19fa3f-c644-4ec4-9b19-d641b541793f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:42.053045 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28df00-d461-4986-8a37-f5dd5fb9463b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:42.053625 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28df00-d461-4986-8a37-f5dd5fb9463b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:42.053914 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28df00-d461-4986-8a37-f5dd5fb9463b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:42.054196 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28df00-d461-4986-8a37-f5dd5fb9463b admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:42.054888 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28df00-d461-4986-8a37-f5dd5fb9463b admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:42.055188 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28df00-d461-4986-8a37-f5dd5fb9463b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:42.080919 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28df00-d461-4986-8a37-f5dd5fb9463b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:42.086107 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 486/971] 10.222.0.37 () {56 vars in 1143 bytes} [Wed Dec 29 20:39:42 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:42.091480 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ee586-989b-4b51-ab1d-8bc4ebc25535 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:42.100402 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ee586-989b-4b51-ab1d-8bc4ebc25535 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:42.104357 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd663c4a-e8b0-4a89-b702-1f746dd98e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:42.104913 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd663c4a-e8b0-4a89-b702-1f746dd98e60 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:42.105194 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd663c4a-e8b0-4a89-b702-1f746dd98e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:42.105466 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd663c4a-e8b0-4a89-b702-1f746dd98e60 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:42.106194 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd663c4a-e8b0-4a89-b702-1f746dd98e60 admin admin] RBAC: Adding query filter params (interface=public, service_id=70a075d6b60344f2b16ccc5402476780, region_id=RegionOne) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:42.106493 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd663c4a-e8b0-4a89-b702-1f746dd98e60 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:42.132089 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd663c4a-e8b0-4a89-b702-1f746dd98e60 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:42.137084 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 486/972] 10.222.0.37 () {56 vars in 1272 bytes} [Wed Dec 29 20:39:42 2021] GET /identity/v3/endpoints?service_id=70a075d6b60344f2b16ccc5402476780&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:42.142322 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28df00-d461-4986-8a37-f5dd5fb9463b admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:42.152245 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28df00-d461-4986-8a37-f5dd5fb9463b admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:42.156336 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce7117-2753-4d61-8c52-9d9f6ecced7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:42.156905 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce7117-2753-4d61-8c52-9d9f6ecced7c admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:42.157196 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce7117-2753-4d61-8c52-9d9f6ecced7c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:42.157480 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce7117-2753-4d61-8c52-9d9f6ecced7c admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:42.158119 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce7117-2753-4d61-8c52-9d9f6ecced7c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:42.183175 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce7117-2753-4d61-8c52-9d9f6ecced7c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:42.189724 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 487/973] 10.222.0.37 () {56 vars in 1108 bytes} [Wed Dec 29 20:39:42 2021] GET /identity/v3/services => generated 2196 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:39:44.138020 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfe482-5eda-4809-aeb8-a70da7f5e0de None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:44.138567 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfe482-5eda-4809-aeb8-a70da7f5e0de None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:44.138567 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfe482-5eda-4809-aeb8-a70da7f5e0de None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:44.140176 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 487/974] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:39:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:39:44.145927 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3ac5f-ed62-458f-8b38-4adbd27bbb14 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:44.146291 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3ac5f-ed62-458f-8b38-4adbd27bbb14 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:44.146494 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3ac5f-ed62-458f-8b38-4adbd27bbb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:44.168414 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-6af3ac5f-ed62-458f-8b38-4adbd27bbb14 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:39:44.169534 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-6af3ac5f-ed62-458f-8b38-4adbd27bbb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:39:44.176846 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 488/975] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:39:44 2021] POST /identity/v3/auth/tokens => generated 3075 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:39:44.198910 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfe482-5eda-4809-aeb8-a70da7f5e0de None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:44.210774 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfe482-5eda-4809-aeb8-a70da7f5e0de None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:44.214617 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1065ca-125a-44b7-90d8-6f2b20441a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:44.215346 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1065ca-125a-44b7-90d8-6f2b20441a05 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:44.215632 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1065ca-125a-44b7-90d8-6f2b20441a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:44.215934 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1065ca-125a-44b7-90d8-6f2b20441a05 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:44.216545 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1065ca-125a-44b7-90d8-6f2b20441a05 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:44.242385 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1065ca-125a-44b7-90d8-6f2b20441a05 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:44.252616 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-cd1065ca-125a-44b7-90d8-6f2b20441a05 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 29 20:39:44.253728 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 488/976] 10.222.0.37 () {56 vars in 1147 bytes} [Wed Dec 29 20:39:44 2021] GET /identity/v3/services/object-store => generated 93 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:44.259293 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3ac5f-ed62-458f-8b38-4adbd27bbb14 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:44.267756 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3ac5f-ed62-458f-8b38-4adbd27bbb14 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:44.272349 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7854d-a6b5-444c-96cf-7daae8b9bdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:44.272927 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7854d-a6b5-444c-96cf-7daae8b9bdaa admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:44.273224 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7854d-a6b5-444c-96cf-7daae8b9bdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:44.273507 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7854d-a6b5-444c-96cf-7daae8b9bdaa admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:44.274171 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7854d-a6b5-444c-96cf-7daae8b9bdaa admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:44.274471 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7854d-a6b5-444c-96cf-7daae8b9bdaa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:44.299680 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7854d-a6b5-444c-96cf-7daae8b9bdaa admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:44.304656 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 489/977] 10.222.0.37 () {56 vars in 1143 bytes} [Wed Dec 29 20:39:44 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:44.309909 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1065ca-125a-44b7-90d8-6f2b20441a05 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:44.319327 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1065ca-125a-44b7-90d8-6f2b20441a05 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:44.323580 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce467b-0b6f-45c8-8326-3f3fc3c6229b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:44.324136 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce467b-0b6f-45c8-8326-3f3fc3c6229b admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:44.324419 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce467b-0b6f-45c8-8326-3f3fc3c6229b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:44.324695 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce467b-0b6f-45c8-8326-3f3fc3c6229b admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:44.325344 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce467b-0b6f-45c8-8326-3f3fc3c6229b admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:44.325634 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce467b-0b6f-45c8-8326-3f3fc3c6229b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:44.351239 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce467b-0b6f-45c8-8326-3f3fc3c6229b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:44.355738 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 489/978] 10.222.0.37 () {56 vars in 1143 bytes} [Wed Dec 29 20:39:44 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:44.360888 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7854d-a6b5-444c-96cf-7daae8b9bdaa admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:44.369959 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7854d-a6b5-444c-96cf-7daae8b9bdaa admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:44.374012 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a913ed-180c-4f07-ad21-98510e4ff259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:44.374571 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a913ed-180c-4f07-ad21-98510e4ff259 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:44.374897 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a913ed-180c-4f07-ad21-98510e4ff259 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:44.375183 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a913ed-180c-4f07-ad21-98510e4ff259 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:44.375855 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a913ed-180c-4f07-ad21-98510e4ff259 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:44.401829 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a913ed-180c-4f07-ad21-98510e4ff259 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:44.418852 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 490/979] 10.222.0.37 () {60 vars in 1165 bytes} [Wed Dec 29 20:39:44 2021] POST /identity/v3/endpoints => generated 349 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:39:46.358266 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72a824-a4a6-4c23-94f1-f050ff3be221 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:46.358825 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72a824-a4a6-4c23-94f1-f050ff3be221 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:46.358917 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72a824-a4a6-4c23-94f1-f050ff3be221 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:46.360506 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 490/980] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:39:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:39:46.366117 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b949a0d-88da-45b4-9db9-bdc93c142dcf None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:46.366516 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b949a0d-88da-45b4-9db9-bdc93c142dcf None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:46.366704 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b949a0d-88da-45b4-9db9-bdc93c142dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:46.388810 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-7b949a0d-88da-45b4-9db9-bdc93c142dcf None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:39:46.389925 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-7b949a0d-88da-45b4-9db9-bdc93c142dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:39:46.406304 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 491/981] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:39:46 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:39:46.428562 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72a824-a4a6-4c23-94f1-f050ff3be221 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:46.440001 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72a824-a4a6-4c23-94f1-f050ff3be221 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:46.444550 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf55c5e-97bf-473d-b80b-0386e974cf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:46.445519 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf55c5e-97bf-473d-b80b-0386e974cf69 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:46.445809 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf55c5e-97bf-473d-b80b-0386e974cf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:46.446088 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf55c5e-97bf-473d-b80b-0386e974cf69 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:46.446730 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf55c5e-97bf-473d-b80b-0386e974cf69 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:46.471702 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf55c5e-97bf-473d-b80b-0386e974cf69 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:46.482217 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-adf55c5e-97bf-473d-b80b-0386e974cf69 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 29 20:39:46.483288 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 491/982] 10.222.0.37 () {56 vars in 1147 bytes} [Wed Dec 29 20:39:46 2021] GET /identity/v3/services/object-store => generated 93 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:46.489437 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b949a0d-88da-45b4-9db9-bdc93c142dcf None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:46.497794 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b949a0d-88da-45b4-9db9-bdc93c142dcf None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:46.501770 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd977ff-09ce-4a17-9146-1c15569a623b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:46.502344 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd977ff-09ce-4a17-9146-1c15569a623b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:46.502627 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd977ff-09ce-4a17-9146-1c15569a623b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:46.502935 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd977ff-09ce-4a17-9146-1c15569a623b admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:46.503694 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd977ff-09ce-4a17-9146-1c15569a623b admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:46.503985 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd977ff-09ce-4a17-9146-1c15569a623b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:46.529319 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd977ff-09ce-4a17-9146-1c15569a623b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:46.534007 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 492/983] 10.222.0.37 () {56 vars in 1143 bytes} [Wed Dec 29 20:39:46 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:46.539875 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf55c5e-97bf-473d-b80b-0386e974cf69 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:46.549747 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf55c5e-97bf-473d-b80b-0386e974cf69 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:46.553854 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade40cfb-f05d-48a7-bc5a-66b9af3c0f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:46.554418 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade40cfb-f05d-48a7-bc5a-66b9af3c0f56 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:46.554739 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade40cfb-f05d-48a7-bc5a-66b9af3c0f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:46.555026 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade40cfb-f05d-48a7-bc5a-66b9af3c0f56 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:46.555685 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade40cfb-f05d-48a7-bc5a-66b9af3c0f56 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:46.555983 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade40cfb-f05d-48a7-bc5a-66b9af3c0f56 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:46.582208 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade40cfb-f05d-48a7-bc5a-66b9af3c0f56 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:46.586744 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 492/984] 10.222.0.37 () {56 vars in 1143 bytes} [Wed Dec 29 20:39:46 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:46.592052 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd977ff-09ce-4a17-9146-1c15569a623b admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:46.601247 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd977ff-09ce-4a17-9146-1c15569a623b admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:46.605337 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490ed6c-0053-4e18-9db5-31327191fb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:46.605896 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490ed6c-0053-4e18-9db5-31327191fb0d admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:46.606183 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490ed6c-0053-4e18-9db5-31327191fb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:46.606461 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490ed6c-0053-4e18-9db5-31327191fb0d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:46.607222 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490ed6c-0053-4e18-9db5-31327191fb0d admin admin] RBAC: Adding query filter params (interface=admin, service_id=70a075d6b60344f2b16ccc5402476780, region_id=RegionOne) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:46.607524 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490ed6c-0053-4e18-9db5-31327191fb0d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:46.633480 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490ed6c-0053-4e18-9db5-31327191fb0d admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:46.638448 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 493/985] 10.222.0.37 () {56 vars in 1270 bytes} [Wed Dec 29 20:39:46 2021] GET /identity/v3/endpoints?service_id=70a075d6b60344f2b16ccc5402476780&interface=admin®ion_id=RegionOne => generated 193 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:46.643591 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade40cfb-f05d-48a7-bc5a-66b9af3c0f56 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:46.653288 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade40cfb-f05d-48a7-bc5a-66b9af3c0f56 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:46.657342 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfaa0bf-61ac-493f-aeeb-e0e74a6cb446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:46.657917 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfaa0bf-61ac-493f-aeeb-e0e74a6cb446 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:46.658207 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfaa0bf-61ac-493f-aeeb-e0e74a6cb446 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:46.658489 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfaa0bf-61ac-493f-aeeb-e0e74a6cb446 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:46.659167 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfaa0bf-61ac-493f-aeeb-e0e74a6cb446 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:46.684319 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfaa0bf-61ac-493f-aeeb-e0e74a6cb446 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:46.691437 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 493/986] 10.222.0.37 () {56 vars in 1108 bytes} [Wed Dec 29 20:39:46 2021] GET /identity/v3/services => generated 2196 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:39:48.633912 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff65a1e-ce59-41c3-8274-6e67dd614b6b None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:48.634443 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff65a1e-ce59-41c3-8274-6e67dd614b6b None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:48.634535 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff65a1e-ce59-41c3-8274-6e67dd614b6b None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:48.636173 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 494/987] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:39:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:39:48.641280 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab60a9-daac-4ddb-8ce6-3ed1b0229bcd None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:48.641665 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab60a9-daac-4ddb-8ce6-3ed1b0229bcd None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:48.641839 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab60a9-daac-4ddb-8ce6-3ed1b0229bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:48.664908 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-78ab60a9-daac-4ddb-8ce6-3ed1b0229bcd None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:39:48.666037 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-78ab60a9-daac-4ddb-8ce6-3ed1b0229bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:39:48.673027 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 494/988] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:39:48 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:39:48.694477 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff65a1e-ce59-41c3-8274-6e67dd614b6b None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:48.706193 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff65a1e-ce59-41c3-8274-6e67dd614b6b None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:48.710778 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f13cb3-99f5-40f8-9da6-b695880824f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:48.711488 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f13cb3-99f5-40f8-9da6-b695880824f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:48.711775 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f13cb3-99f5-40f8-9da6-b695880824f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:48.712053 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f13cb3-99f5-40f8-9da6-b695880824f0 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:48.712667 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f13cb3-99f5-40f8-9da6-b695880824f0 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:48.738256 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f13cb3-99f5-40f8-9da6-b695880824f0 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:48.748512 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-79f13cb3-99f5-40f8-9da6-b695880824f0 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 29 20:39:48.749548 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 495/989] 10.222.0.37 () {56 vars in 1147 bytes} [Wed Dec 29 20:39:48 2021] GET /identity/v3/services/object-store => generated 93 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:48.755209 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab60a9-daac-4ddb-8ce6-3ed1b0229bcd None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:48.763556 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab60a9-daac-4ddb-8ce6-3ed1b0229bcd None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:48.767592 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2b9b8-7177-4c5c-8b00-973b6d8a1df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:48.768185 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2b9b8-7177-4c5c-8b00-973b6d8a1df6 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:48.768469 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2b9b8-7177-4c5c-8b00-973b6d8a1df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:48.768744 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2b9b8-7177-4c5c-8b00-973b6d8a1df6 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:48.769934 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2b9b8-7177-4c5c-8b00-973b6d8a1df6 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:48.770223 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2b9b8-7177-4c5c-8b00-973b6d8a1df6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:48.795631 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2b9b8-7177-4c5c-8b00-973b6d8a1df6 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:48.800393 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 495/990] 10.222.0.37 () {56 vars in 1143 bytes} [Wed Dec 29 20:39:48 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:48.805670 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f13cb3-99f5-40f8-9da6-b695880824f0 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:48.814646 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f13cb3-99f5-40f8-9da6-b695880824f0 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:48.819413 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a099e0-10e3-46dd-a704-7eae27c8fe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:48.819982 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a099e0-10e3-46dd-a704-7eae27c8fe44 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:48.820519 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a099e0-10e3-46dd-a704-7eae27c8fe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:48.820800 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a099e0-10e3-46dd-a704-7eae27c8fe44 admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:48.821453 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a099e0-10e3-46dd-a704-7eae27c8fe44 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:48.821749 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a099e0-10e3-46dd-a704-7eae27c8fe44 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:48.847576 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a099e0-10e3-46dd-a704-7eae27c8fe44 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:48.852297 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 496/991] 10.222.0.37 () {56 vars in 1143 bytes} [Wed Dec 29 20:39:48 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:48.857704 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2b9b8-7177-4c5c-8b00-973b6d8a1df6 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:48.866898 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2b9b8-7177-4c5c-8b00-973b6d8a1df6 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:48.870916 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8133e-146d-44ee-a809-04b39af87b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:48.871480 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8133e-146d-44ee-a809-04b39af87b9f admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:48.871762 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8133e-146d-44ee-a809-04b39af87b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:48.872039 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8133e-146d-44ee-a809-04b39af87b9f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:48.872712 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8133e-146d-44ee-a809-04b39af87b9f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:48.899003 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8133e-146d-44ee-a809-04b39af87b9f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:48.913335 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 496/992] 10.222.0.37 () {60 vars in 1165 bytes} [Wed Dec 29 20:39:48 2021] POST /identity/v3/endpoints => generated 325 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:39:50.886110 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f34e5-cad2-421a-8671-bc3b39ae5cf2 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:50.886550 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f34e5-cad2-421a-8671-bc3b39ae5cf2 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:50.886693 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f34e5-cad2-421a-8671-bc3b39ae5cf2 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:50.888364 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 497/993] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:39:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:39:50.893502 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a9d8b-7c1e-4aab-a95e-ff2d1668ba40 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:50.894485 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a9d8b-7c1e-4aab-a95e-ff2d1668ba40 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:50.894673 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a9d8b-7c1e-4aab-a95e-ff2d1668ba40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:50.916980 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-0b0a9d8b-7c1e-4aab-a95e-ff2d1668ba40 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:39:50.918117 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-0b0a9d8b-7c1e-4aab-a95e-ff2d1668ba40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:39:50.935139 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 497/994] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:39:50 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:39:50.958329 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f34e5-cad2-421a-8671-bc3b39ae5cf2 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:50.969679 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f34e5-cad2-421a-8671-bc3b39ae5cf2 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:50.974421 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357665d9-96d2-4d21-993c-26eb7807b30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:50.975143 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357665d9-96d2-4d21-993c-26eb7807b30b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:50.975430 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357665d9-96d2-4d21-993c-26eb7807b30b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:50.975712 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357665d9-96d2-4d21-993c-26eb7807b30b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:50.976755 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357665d9-96d2-4d21-993c-26eb7807b30b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:51.001859 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357665d9-96d2-4d21-993c-26eb7807b30b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:51.003479 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 498/995] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:39:50 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:51.008974 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a9d8b-7c1e-4aab-a95e-ff2d1668ba40 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:51.017497 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a9d8b-7c1e-4aab-a95e-ff2d1668ba40 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:51.022336 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6c14a-00d5-4159-8713-3b78d08bae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:51.022951 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6c14a-00d5-4159-8713-3b78d08bae1e admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:51.023243 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6c14a-00d5-4159-8713-3b78d08bae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:51.023526 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6c14a-00d5-4159-8713-3b78d08bae1e admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:51.024173 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6c14a-00d5-4159-8713-3b78d08bae1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:51.050512 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6c14a-00d5-4159-8713-3b78d08bae1e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:51.077902 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 498/996] 10.222.0.37 () {60 vars in 1162 bytes} [Wed Dec 29 20:39:51 2021] POST /identity/v3/projects => generated 311 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:39:53.116943 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28707b-30bb-4ae5-b52d-21bc7f184f2d None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:53.117455 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28707b-30bb-4ae5-b52d-21bc7f184f2d None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:53.117455 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28707b-30bb-4ae5-b52d-21bc7f184f2d None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:53.119102 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 499/997] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:39:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:39:53.124110 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ed4f5-3ecc-4331-93ca-412c92616edb None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:53.124515 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ed4f5-3ecc-4331-93ca-412c92616edb None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:53.124674 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ed4f5-3ecc-4331-93ca-412c92616edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:53.146548 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-515ed4f5-3ecc-4331-93ca-412c92616edb None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:39:53.147703 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-515ed4f5-3ecc-4331-93ca-412c92616edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:39:53.209147 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 499/998] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:39:53 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:39:53.232710 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28707b-30bb-4ae5-b52d-21bc7f184f2d None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:53.245072 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28707b-30bb-4ae5-b52d-21bc7f184f2d None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:53.249067 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25202714-473c-44de-b807-b6641116f788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:53.249762 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25202714-473c-44de-b807-b6641116f788 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:53.250047 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25202714-473c-44de-b807-b6641116f788 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:53.250323 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25202714-473c-44de-b807-b6641116f788 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:53.251413 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25202714-473c-44de-b807-b6641116f788 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:53.277436 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25202714-473c-44de-b807-b6641116f788 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:53.278902 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 500/999] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:39:53 2021] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:53.284481 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ed4f5-3ecc-4331-93ca-412c92616edb None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:53.293021 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ed4f5-3ecc-4331-93ca-412c92616edb None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:53.297009 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fc0ec-73ab-4504-bce9-54792e28f8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:53.297587 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fc0ec-73ab-4504-bce9-54792e28f8db admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:53.297872 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fc0ec-73ab-4504-bce9-54792e28f8db admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:53.298149 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fc0ec-73ab-4504-bce9-54792e28f8db admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:53.298824 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8fc0ec-73ab-4504-bce9-54792e28f8db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:53.325124 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8fc0ec-73ab-4504-bce9-54792e28f8db admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:53.344719 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 500/1000] 10.222.0.37 () {60 vars in 1153 bytes} [Wed Dec 29 20:39:53 2021] POST /identity/v3/users => generated 285 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:39:55.306064 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d35dea-eea7-4d75-8677-b40fc3e585d4 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:55.306558 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d35dea-eea7-4d75-8677-b40fc3e585d4 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:55.306558 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d35dea-eea7-4d75-8677-b40fc3e585d4 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:55.308254 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 501/1001] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:39:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:39:55.313266 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4df69d-2fc8-49bd-a96f-afa1363ffc3c None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:55.313626 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4df69d-2fc8-49bd-a96f-afa1363ffc3c None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:55.313831 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4df69d-2fc8-49bd-a96f-afa1363ffc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:55.336172 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-6d4df69d-2fc8-49bd-a96f-afa1363ffc3c None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:39:55.337292 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-6d4df69d-2fc8-49bd-a96f-afa1363ffc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:39:55.343981 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 501/1002] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:39:55 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:39:55.365992 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d35dea-eea7-4d75-8677-b40fc3e585d4 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:55.377367 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d35dea-eea7-4d75-8677-b40fc3e585d4 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:55.381512 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa9b68-c4f9-46b8-8dcc-896380351bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:55.382206 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa9b68-c4f9-46b8-8dcc-896380351bec admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:55.382493 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa9b68-c4f9-46b8-8dcc-896380351bec admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:55.382813 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa9b68-c4f9-46b8-8dcc-896380351bec admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:55.395382 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa9b68-c4f9-46b8-8dcc-896380351bec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:39:55.401522 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-bfaa9b68-c4f9-46b8-8dcc-896380351bec admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:39:55.402573 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 502/1003] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:39:55 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:55.408148 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4df69d-2fc8-49bd-a96f-afa1363ffc3c None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:55.416538 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4df69d-2fc8-49bd-a96f-afa1363ffc3c None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:55.420542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45e93f-a8fa-4335-b788-a773c0c049cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:55.421114 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45e93f-a8fa-4335-b788-a773c0c049cb admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:55.421397 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45e93f-a8fa-4335-b788-a773c0c049cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:55.421675 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45e93f-a8fa-4335-b788-a773c0c049cb admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:55.422373 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45e93f-a8fa-4335-b788-a773c0c049cb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:55.422678 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45e93f-a8fa-4335-b788-a773c0c049cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:55.449159 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45e93f-a8fa-4335-b788-a773c0c049cb admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:55.457469 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 502/1004] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:39:55 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:55.462863 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa9b68-c4f9-46b8-8dcc-896380351bec admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:55.472046 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa9b68-c4f9-46b8-8dcc-896380351bec admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:55.476084 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99b55c-d51e-4f71-9a0f-5c18d6340646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:55.476850 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99b55c-d51e-4f71-9a0f-5c18d6340646 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:55.477136 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99b55c-d51e-4f71-9a0f-5c18d6340646 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:55.477415 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99b55c-d51e-4f71-9a0f-5c18d6340646 admin admin] PATH_INFO: `/v3/users/93a806b10e374e72aee28b4d432fde06` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:55.495595 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99b55c-d51e-4f71-9a0f-5c18d6340646 admin admin] RBAC: Authorizing `identity:get_user(user_id=93a806b10e374e72aee28b4d432fde06)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:55.522081 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99b55c-d51e-4f71-9a0f-5c18d6340646 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:55.523569 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 503/1005] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:39:55 2021] GET /identity/v3/users/93a806b10e374e72aee28b4d432fde06 => generated 285 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:55.529108 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45e93f-a8fa-4335-b788-a773c0c049cb admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:55.538733 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45e93f-a8fa-4335-b788-a773c0c049cb admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:55.542782 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0e47c-a763-46a4-8b83-f9fe766ed174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:55.543342 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0e47c-a763-46a4-8b83-f9fe766ed174 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:55.543630 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0e47c-a763-46a4-8b83-f9fe766ed174 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:55.543911 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0e47c-a763-46a4-8b83-f9fe766ed174 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:55.552075 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0e47c-a763-46a4-8b83-f9fe766ed174 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:55.577544 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0e47c-a763-46a4-8b83-f9fe766ed174 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:55.585899 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 503/1006] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:39:55 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:39:55.591331 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99b55c-d51e-4f71-9a0f-5c18d6340646 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:55.600970 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99b55c-d51e-4f71-9a0f-5c18d6340646 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:55.604981 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec91c8-d07e-450f-a0b0-26819a541f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:55.605739 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec91c8-d07e-450f-a0b0-26819a541f73 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:55.606024 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec91c8-d07e-450f-a0b0-26819a541f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:55.606303 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec91c8-d07e-450f-a0b0-26819a541f73 admin admin] PATH_INFO: `/v3/projects/3254768b950741409b4b08384a7fc310` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:55.607385 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec91c8-d07e-450f-a0b0-26819a541f73 admin admin] RBAC: Authorizing `identity:get_project(project_id=3254768b950741409b4b08384a7fc310)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:55.633561 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec91c8-d07e-450f-a0b0-26819a541f73 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:55.635065 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 504/1007] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:39:55 2021] GET /identity/v3/projects/3254768b950741409b4b08384a7fc310 => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:55.640481 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0e47c-a763-46a4-8b83-f9fe766ed174 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:55.648948 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0e47c-a763-46a4-8b83-f9fe766ed174 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:55.653051 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687832d-92cb-4585-9524-3b35f85c0f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:55.653610 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687832d-92cb-4585-9524-3b35f85c0f8d admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:55.653896 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687832d-92cb-4585-9524-3b35f85c0f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:55.654176 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687832d-92cb-4585-9524-3b35f85c0f8d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:55.654988 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687832d-92cb-4585-9524-3b35f85c0f8d admin admin] RBAC: Adding query filter params (role.id=e66e6a94ba014fd193b851ceb92695ae, scope.project.id=3254768b950741409b4b08384a7fc310, user.id=93a806b10e374e72aee28b4d432fde06) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:55.655294 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687832d-92cb-4585-9524-3b35f85c0f8d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:55.681570 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687832d-92cb-4585-9524-3b35f85c0f8d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:55.686901 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 504/1008] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:39:55 2021] GET /identity/v3/role_assignments?user.id=93a806b10e374e72aee28b4d432fde06&scope.project.id=3254768b950741409b4b08384a7fc310&role.id=e66e6a94ba014fd193b851ceb92695ae => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:57.589373 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20320331-5f18-4860-95de-15dd46fcf6b8 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:57.589930 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20320331-5f18-4860-95de-15dd46fcf6b8 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:57.589930 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20320331-5f18-4860-95de-15dd46fcf6b8 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:57.591628 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 505/1009] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:39:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:39:57.597265 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cec20-f508-42a6-85ba-af31c19e3c32 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:57.597683 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cec20-f508-42a6-85ba-af31c19e3c32 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:57.597822 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cec20-f508-42a6-85ba-af31c19e3c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:57.619302 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-6e3cec20-f508-42a6-85ba-af31c19e3c32 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:39:57.620421 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-6e3cec20-f508-42a6-85ba-af31c19e3c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:39:57.627066 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 505/1010] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:39:57 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:39:57.650044 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20320331-5f18-4860-95de-15dd46fcf6b8 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:57.662253 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20320331-5f18-4860-95de-15dd46fcf6b8 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:57.666138 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96499061-7c70-46d1-b329-08886585598e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:57.666871 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96499061-7c70-46d1-b329-08886585598e admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:57.667160 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96499061-7c70-46d1-b329-08886585598e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:57.667441 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96499061-7c70-46d1-b329-08886585598e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:57.678255 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96499061-7c70-46d1-b329-08886585598e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:39:57.684373 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-96499061-7c70-46d1-b329-08886585598e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:39:57.685427 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 506/1011] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:39:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:57.691337 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cec20-f508-42a6-85ba-af31c19e3c32 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:57.699919 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cec20-f508-42a6-85ba-af31c19e3c32 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:57.703910 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325395e-7d53-44f1-9160-aaca8f75e68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:57.704485 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325395e-7d53-44f1-9160-aaca8f75e68f admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:57.704767 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325395e-7d53-44f1-9160-aaca8f75e68f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:57.705043 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325395e-7d53-44f1-9160-aaca8f75e68f admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:57.706272 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325395e-7d53-44f1-9160-aaca8f75e68f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:57.706646 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325395e-7d53-44f1-9160-aaca8f75e68f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:57.732264 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325395e-7d53-44f1-9160-aaca8f75e68f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:57.740487 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 506/1012] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:39:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:39:57.745948 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96499061-7c70-46d1-b329-08886585598e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:57.757072 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96499061-7c70-46d1-b329-08886585598e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:57.761098 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d01f54-aa5e-4efe-a038-7563a0f7e0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:57.761861 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d01f54-aa5e-4efe-a038-7563a0f7e0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:57.762147 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d01f54-aa5e-4efe-a038-7563a0f7e0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:57.762424 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d01f54-aa5e-4efe-a038-7563a0f7e0f5 admin admin] PATH_INFO: `/v3/users/93a806b10e374e72aee28b4d432fde06` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:57.763540 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d01f54-aa5e-4efe-a038-7563a0f7e0f5 admin admin] RBAC: Authorizing `identity:get_user(user_id=93a806b10e374e72aee28b4d432fde06)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:57.789973 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d01f54-aa5e-4efe-a038-7563a0f7e0f5 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:57.791452 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 507/1013] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:39:57 2021] GET /identity/v3/users/93a806b10e374e72aee28b4d432fde06 => generated 285 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:57.796628 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325395e-7d53-44f1-9160-aaca8f75e68f admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:57.805702 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325395e-7d53-44f1-9160-aaca8f75e68f admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:57.809688 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670c7b0-7a60-4941-a9c3-8af1d66ae1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:57.810445 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670c7b0-7a60-4941-a9c3-8af1d66ae1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:57.810764 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670c7b0-7a60-4941-a9c3-8af1d66ae1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:57.811042 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670c7b0-7a60-4941-a9c3-8af1d66ae1f1 admin admin] PATH_INFO: `/v3/projects/3254768b950741409b4b08384a7fc310` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:57.812096 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670c7b0-7a60-4941-a9c3-8af1d66ae1f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=3254768b950741409b4b08384a7fc310)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:57.839055 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670c7b0-7a60-4941-a9c3-8af1d66ae1f1 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:57.840602 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 507/1014] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:39:57 2021] GET /identity/v3/projects/3254768b950741409b4b08384a7fc310 => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:39:57.845941 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d01f54-aa5e-4efe-a038-7563a0f7e0f5 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:57.855284 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d01f54-aa5e-4efe-a038-7563a0f7e0f5 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:57.859271 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a8dd1-d08d-41e1-877b-94617bf16617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:57.860063 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a8dd1-d08d-41e1-877b-94617bf16617 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:57.860344 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a8dd1-d08d-41e1-877b-94617bf16617 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:57.860618 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a8dd1-d08d-41e1-877b-94617bf16617 admin admin] PATH_INFO: `/v3/projects/3254768b950741409b4b08384a7fc310/users/93a806b10e374e72aee28b4d432fde06/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:57.862809 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a8dd1-d08d-41e1-877b-94617bf16617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3254768b950741409b4b08384a7fc310, user_id=93a806b10e374e72aee28b4d432fde06, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:39:57.888587 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a8dd1-d08d-41e1-877b-94617bf16617 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:39:57.901499 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 508/1015] 10.222.0.37 () {58 vars in 1460 bytes} [Wed Dec 29 20:39:57 2021] PUT /identity/v3/projects/3254768b950741409b4b08384a7fc310/users/93a806b10e374e72aee28b4d432fde06/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:39:59.818092 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f9446-677e-4695-a906-96965ae3a4ee None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:59.818746 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f9446-677e-4695-a906-96965ae3a4ee None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:59.818746 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f9446-677e-4695-a906-96965ae3a4ee None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:59.820609 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 508/1016] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:39:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:39:59.825700 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123739f-9a87-43dc-8da0-e8713a5d40fe None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:59.826094 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123739f-9a87-43dc-8da0-e8713a5d40fe None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:59.826265 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123739f-9a87-43dc-8da0-e8713a5d40fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:59.848945 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-f123739f-9a87-43dc-8da0-e8713a5d40fe None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:39:59.850074 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-f123739f-9a87-43dc-8da0-e8713a5d40fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:39:59.911691 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 509/1017] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:39:59 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:39:59.933799 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f9446-677e-4695-a906-96965ae3a4ee None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:59.945691 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f9446-677e-4695-a906-96965ae3a4ee None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:59.949626 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809a2ae-c382-4183-85a2-644ef0e1fb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:59.950327 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809a2ae-c382-4183-85a2-644ef0e1fb37 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:59.950617 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809a2ae-c382-4183-85a2-644ef0e1fb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:59.950931 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809a2ae-c382-4183-85a2-644ef0e1fb37 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:59.963324 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809a2ae-c382-4183-85a2-644ef0e1fb37 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:39:59.969906 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-c809a2ae-c382-4183-85a2-644ef0e1fb37 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:39:59.971019 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 509/1018] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:39:59 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:39:59.977274 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123739f-9a87-43dc-8da0-e8713a5d40fe None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:39:59.985685 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123739f-9a87-43dc-8da0-e8713a5d40fe None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:39:59.989859 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f617931-6c7d-4b3d-89a5-9971a11152af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:39:59.990439 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f617931-6c7d-4b3d-89a5-9971a11152af admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:39:59.990767 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f617931-6c7d-4b3d-89a5-9971a11152af admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:39:59.991052 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f617931-6c7d-4b3d-89a5-9971a11152af admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:39:59.991761 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f617931-6c7d-4b3d-89a5-9971a11152af admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:39:59.992061 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f617931-6c7d-4b3d-89a5-9971a11152af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:00.017099 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f617931-6c7d-4b3d-89a5-9971a11152af admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:00.026179 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 510/1019] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:39:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:00.031584 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809a2ae-c382-4183-85a2-644ef0e1fb37 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:00.041359 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809a2ae-c382-4183-85a2-644ef0e1fb37 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:00.045430 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea71dac-4348-4d0f-a2c6-58a7c8f01abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:00.046200 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea71dac-4348-4d0f-a2c6-58a7c8f01abd admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:00.046485 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea71dac-4348-4d0f-a2c6-58a7c8f01abd admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:00.046797 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea71dac-4348-4d0f-a2c6-58a7c8f01abd admin admin] PATH_INFO: `/v3/users/93a806b10e374e72aee28b4d432fde06` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:00.047866 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea71dac-4348-4d0f-a2c6-58a7c8f01abd admin admin] RBAC: Authorizing `identity:get_user(user_id=93a806b10e374e72aee28b4d432fde06)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:00.075128 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea71dac-4348-4d0f-a2c6-58a7c8f01abd admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:00.076813 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 510/1020] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:40:00 2021] GET /identity/v3/users/93a806b10e374e72aee28b4d432fde06 => generated 285 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:40:00.082921 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f617931-6c7d-4b3d-89a5-9971a11152af admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:00.092155 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f617931-6c7d-4b3d-89a5-9971a11152af admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:00.096175 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c7ccc-fbc0-4678-a4c2-4c0975f9b6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:00.096871 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c7ccc-fbc0-4678-a4c2-4c0975f9b6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:00.097155 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c7ccc-fbc0-4678-a4c2-4c0975f9b6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:00.097433 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c7ccc-fbc0-4678-a4c2-4c0975f9b6e5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:00.104808 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c7ccc-fbc0-4678-a4c2-4c0975f9b6e5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:00.130407 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c7ccc-fbc0-4678-a4c2-4c0975f9b6e5 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:00.138734 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 511/1021] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:40:00 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:40:00.144953 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea71dac-4348-4d0f-a2c6-58a7c8f01abd admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:00.153970 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea71dac-4348-4d0f-a2c6-58a7c8f01abd admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:00.157980 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fe216-57c0-4779-9179-e67171984c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:00.158841 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fe216-57c0-4779-9179-e67171984c94 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:00.159078 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fe216-57c0-4779-9179-e67171984c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:00.159470 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fe216-57c0-4779-9179-e67171984c94 admin admin] PATH_INFO: `/v3/projects/3254768b950741409b4b08384a7fc310` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:00.160541 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53fe216-57c0-4779-9179-e67171984c94 admin admin] RBAC: Authorizing `identity:get_project(project_id=3254768b950741409b4b08384a7fc310)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:00.186170 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53fe216-57c0-4779-9179-e67171984c94 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:00.187789 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 511/1022] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:40:00 2021] GET /identity/v3/projects/3254768b950741409b4b08384a7fc310 => generated 311 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:40:00.193561 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c7ccc-fbc0-4678-a4c2-4c0975f9b6e5 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:00.201978 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c7ccc-fbc0-4678-a4c2-4c0975f9b6e5 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:00.206546 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce087935-5d3c-44de-a5fb-be6dbba69703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:00.207277 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce087935-5d3c-44de-a5fb-be6dbba69703 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:00.207561 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce087935-5d3c-44de-a5fb-be6dbba69703 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:00.207839 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce087935-5d3c-44de-a5fb-be6dbba69703 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:00.208621 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce087935-5d3c-44de-a5fb-be6dbba69703 admin admin] RBAC: Adding query filter params (role.id=e66e6a94ba014fd193b851ceb92695ae, scope.project.id=3254768b950741409b4b08384a7fc310, user.id=93a806b10e374e72aee28b4d432fde06) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:40:00.208919 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce087935-5d3c-44de-a5fb-be6dbba69703 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:00.234488 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce087935-5d3c-44de-a5fb-be6dbba69703 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:00.240149 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 512/1023] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:40:00 2021] GET /identity/v3/role_assignments?user.id=93a806b10e374e72aee28b4d432fde06&scope.project.id=3254768b950741409b4b08384a7fc310&role.id=e66e6a94ba014fd193b851ceb92695ae => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:02.200396 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b033b-012d-421c-82d0-917102b0098a None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:02.200908 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b033b-012d-421c-82d0-917102b0098a None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:02.200908 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b033b-012d-421c-82d0-917102b0098a None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:02.202538 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 512/1024] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:40:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 29 20:40:02.208148 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb81b63-6352-47e1-8f28-b98390854709 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:02.208582 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb81b63-6352-47e1-8f28-b98390854709 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:02.208721 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb81b63-6352-47e1-8f28-b98390854709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:02.231172 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-6eb81b63-6352-47e1-8f28-b98390854709 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:40:02.232309 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-6eb81b63-6352-47e1-8f28-b98390854709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:40:02.239147 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 513/1025] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:40:02 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:40:02.262507 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b033b-012d-421c-82d0-917102b0098a None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:02.274425 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b033b-012d-421c-82d0-917102b0098a None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:02.278331 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b60c4-7a1c-4e8a-a376-846ecb036ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:02.279059 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b60c4-7a1c-4e8a-a376-846ecb036ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:02.279348 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b60c4-7a1c-4e8a-a376-846ecb036ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:02.279626 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b60c4-7a1c-4e8a-a376-846ecb036ba9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:02.280682 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b60c4-7a1c-4e8a-a376-846ecb036ba9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:02.306462 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b60c4-7a1c-4e8a-a376-846ecb036ba9 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:02.307918 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 513/1026] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:40:02 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:02.313199 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb81b63-6352-47e1-8f28-b98390854709 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:02.322515 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb81b63-6352-47e1-8f28-b98390854709 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:02.326585 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a668e-132f-4baa-96d3-b97a7867d1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:02.327197 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a668e-132f-4baa-96d3-b97a7867d1d3 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:02.327487 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a668e-132f-4baa-96d3-b97a7867d1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:02.327769 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a668e-132f-4baa-96d3-b97a7867d1d3 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:02.328409 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a668e-132f-4baa-96d3-b97a7867d1d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:02.354350 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a668e-132f-4baa-96d3-b97a7867d1d3 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:02.373381 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 514/1027] 10.222.0.37 () {60 vars in 1153 bytes} [Wed Dec 29 20:40:02 2021] POST /identity/v3/users => generated 286 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:40:04.362182 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c2fbc-97f4-4ba8-beab-de4a9a355c94 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:04.362714 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c2fbc-97f4-4ba8-beab-de4a9a355c94 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:04.362823 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c2fbc-97f4-4ba8-beab-de4a9a355c94 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:04.364417 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 514/1028] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:40:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:40:04.369621 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096e632-e443-4fe9-9655-2e1d5e41933e None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:04.370039 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096e632-e443-4fe9-9655-2e1d5e41933e None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:04.370185 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096e632-e443-4fe9-9655-2e1d5e41933e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:04.392397 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-d096e632-e443-4fe9-9655-2e1d5e41933e None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:40:04.393568 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-d096e632-e443-4fe9-9655-2e1d5e41933e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:40:04.400328 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 515/1029] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:40:04 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:40:04.422195 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c2fbc-97f4-4ba8-beab-de4a9a355c94 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:04.434371 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c2fbc-97f4-4ba8-beab-de4a9a355c94 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:04.438252 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d8935-0fed-4a57-a1bc-7b62c901db33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:04.439046 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d8935-0fed-4a57-a1bc-7b62c901db33 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:04.439335 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d8935-0fed-4a57-a1bc-7b62c901db33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:04.439617 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d8935-0fed-4a57-a1bc-7b62c901db33 admin admin] PATH_INFO: `/v3/roles/5f70396837d2484ca16563634aa8d2a2` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:04.441688 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d8935-0fed-4a57-a1bc-7b62c901db33 admin admin] RBAC: Authorizing `identity:get_role(role_id=5f70396837d2484ca16563634aa8d2a2)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:04.467233 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING py.warnings [None req-237d8935-0fed-4a57-a1bc-7b62c901db33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:40:04.467233 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: warnings.warn(msg) Dec 29 20:40:04.467233 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: Dec 29 20:40:04.468094 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d8935-0fed-4a57-a1bc-7b62c901db33 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:04.469327 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 515/1030] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:40:04 2021] GET /identity/v3/roles/5f70396837d2484ca16563634aa8d2a2 => generated 223 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:04.475653 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096e632-e443-4fe9-9655-2e1d5e41933e None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:04.484211 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096e632-e443-4fe9-9655-2e1d5e41933e None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:04.488571 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6911e-3409-4e1f-b16d-387b08d192c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:04.489355 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6911e-3409-4e1f-b16d-387b08d192c6 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:04.489643 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6911e-3409-4e1f-b16d-387b08d192c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:04.489923 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6911e-3409-4e1f-b16d-387b08d192c6 admin admin] PATH_INFO: `/v3/users/400a099d23df4df7937d86e2e5b3c769` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:04.507453 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6911e-3409-4e1f-b16d-387b08d192c6 admin admin] RBAC: Authorizing `identity:get_user(user_id=400a099d23df4df7937d86e2e5b3c769)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:04.534105 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6911e-3409-4e1f-b16d-387b08d192c6 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:04.535615 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 516/1031] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:40:04 2021] GET /identity/v3/users/400a099d23df4df7937d86e2e5b3c769 => generated 286 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:04.541104 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d8935-0fed-4a57-a1bc-7b62c901db33 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:04.550420 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d8935-0fed-4a57-a1bc-7b62c901db33 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:04.554451 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28ea92-23b6-41e9-b4d1-103600d6d2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:04.555052 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28ea92-23b6-41e9-b4d1-103600d6d2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:04.555340 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28ea92-23b6-41e9-b4d1-103600d6d2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:04.555622 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28ea92-23b6-41e9-b4d1-103600d6d2e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:04.563028 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28ea92-23b6-41e9-b4d1-103600d6d2e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:04.589556 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28ea92-23b6-41e9-b4d1-103600d6d2e6 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:04.598016 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 516/1032] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:40:04 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:40:04.603525 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6911e-3409-4e1f-b16d-387b08d192c6 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:04.612844 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6911e-3409-4e1f-b16d-387b08d192c6 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:04.616814 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65e89c-a9e3-4301-a25c-c0d768828fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:04.617574 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65e89c-a9e3-4301-a25c-c0d768828fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:04.617862 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65e89c-a9e3-4301-a25c-c0d768828fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:04.618148 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65e89c-a9e3-4301-a25c-c0d768828fa2 admin admin] PATH_INFO: `/v3/projects/3254768b950741409b4b08384a7fc310` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:04.619244 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65e89c-a9e3-4301-a25c-c0d768828fa2 admin admin] RBAC: Authorizing `identity:get_project(project_id=3254768b950741409b4b08384a7fc310)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:04.645763 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65e89c-a9e3-4301-a25c-c0d768828fa2 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:04.647287 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 517/1033] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:40:04 2021] GET /identity/v3/projects/3254768b950741409b4b08384a7fc310 => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:04.652762 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28ea92-23b6-41e9-b4d1-103600d6d2e6 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:04.661209 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28ea92-23b6-41e9-b4d1-103600d6d2e6 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:04.665325 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6fc46-aa28-4c4d-aa18-c38a3c5beece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:04.665884 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6fc46-aa28-4c4d-aa18-c38a3c5beece admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:04.666171 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6fc46-aa28-4c4d-aa18-c38a3c5beece admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:04.666453 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6fc46-aa28-4c4d-aa18-c38a3c5beece admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:04.667254 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6fc46-aa28-4c4d-aa18-c38a3c5beece admin admin] RBAC: Adding query filter params (role.id=5f70396837d2484ca16563634aa8d2a2, scope.project.id=3254768b950741409b4b08384a7fc310, user.id=400a099d23df4df7937d86e2e5b3c769) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:40:04.667559 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6fc46-aa28-4c4d-aa18-c38a3c5beece admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:04.693779 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6fc46-aa28-4c4d-aa18-c38a3c5beece admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:04.699309 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 517/1034] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:40:04 2021] GET /identity/v3/role_assignments?user.id=400a099d23df4df7937d86e2e5b3c769&scope.project.id=3254768b950741409b4b08384a7fc310&role.id=5f70396837d2484ca16563634aa8d2a2 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:40:06.599853 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb963e29-543e-4ab3-8a2c-5b89b03d5954 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:06.600409 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb963e29-543e-4ab3-8a2c-5b89b03d5954 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:06.600409 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb963e29-543e-4ab3-8a2c-5b89b03d5954 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:06.602145 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 518/1035] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:40:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:40:06.607225 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021174aa-18bf-4064-93fa-dbcacdefda3b None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:06.607600 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021174aa-18bf-4064-93fa-dbcacdefda3b None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:06.607786 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021174aa-18bf-4064-93fa-dbcacdefda3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:06.630733 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-021174aa-18bf-4064-93fa-dbcacdefda3b None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:40:06.631847 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-021174aa-18bf-4064-93fa-dbcacdefda3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:40:06.638453 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 518/1036] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:40:06 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:40:06.659343 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb963e29-543e-4ab3-8a2c-5b89b03d5954 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:06.670917 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb963e29-543e-4ab3-8a2c-5b89b03d5954 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:06.675873 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03b23d-24f9-4472-afcc-3a2595b68ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:06.676629 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03b23d-24f9-4472-afcc-3a2595b68ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:06.676918 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03b23d-24f9-4472-afcc-3a2595b68ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:06.677197 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03b23d-24f9-4472-afcc-3a2595b68ae0 admin admin] PATH_INFO: `/v3/roles/5f70396837d2484ca16563634aa8d2a2` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:06.678506 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03b23d-24f9-4472-afcc-3a2595b68ae0 admin admin] RBAC: Authorizing `identity:get_role(role_id=5f70396837d2484ca16563634aa8d2a2)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:06.703635 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING py.warnings [None req-6b03b23d-24f9-4472-afcc-3a2595b68ae0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:40:06.703635 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: warnings.warn(msg) Dec 29 20:40:06.703635 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: Dec 29 20:40:06.704489 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03b23d-24f9-4472-afcc-3a2595b68ae0 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:06.706001 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 519/1037] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:40:06 2021] GET /identity/v3/roles/5f70396837d2484ca16563634aa8d2a2 => generated 223 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:06.711348 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021174aa-18bf-4064-93fa-dbcacdefda3b None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:06.719798 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021174aa-18bf-4064-93fa-dbcacdefda3b None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:06.723877 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cec5a-5eef-4af4-96ea-e4effa164247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:06.724659 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cec5a-5eef-4af4-96ea-e4effa164247 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:06.724948 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cec5a-5eef-4af4-96ea-e4effa164247 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:06.725231 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cec5a-5eef-4af4-96ea-e4effa164247 admin admin] PATH_INFO: `/v3/users/400a099d23df4df7937d86e2e5b3c769` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:06.726316 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cec5a-5eef-4af4-96ea-e4effa164247 admin admin] RBAC: Authorizing `identity:get_user(user_id=400a099d23df4df7937d86e2e5b3c769)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:06.753327 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cec5a-5eef-4af4-96ea-e4effa164247 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:06.754896 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 519/1038] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:40:06 2021] GET /identity/v3/users/400a099d23df4df7937d86e2e5b3c769 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:06.760048 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03b23d-24f9-4472-afcc-3a2595b68ae0 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:06.769051 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03b23d-24f9-4472-afcc-3a2595b68ae0 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:06.773098 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31993cd-a92f-4c46-a9ca-cbb57b878016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:06.773838 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31993cd-a92f-4c46-a9ca-cbb57b878016 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:06.774124 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31993cd-a92f-4c46-a9ca-cbb57b878016 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:06.774405 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31993cd-a92f-4c46-a9ca-cbb57b878016 admin admin] PATH_INFO: `/v3/projects/3254768b950741409b4b08384a7fc310` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:06.775501 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31993cd-a92f-4c46-a9ca-cbb57b878016 admin admin] RBAC: Authorizing `identity:get_project(project_id=3254768b950741409b4b08384a7fc310)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:06.802030 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31993cd-a92f-4c46-a9ca-cbb57b878016 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:06.803532 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 520/1039] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:40:06 2021] GET /identity/v3/projects/3254768b950741409b4b08384a7fc310 => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:06.808779 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cec5a-5eef-4af4-96ea-e4effa164247 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:06.818175 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cec5a-5eef-4af4-96ea-e4effa164247 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:06.822466 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fb189-6992-48e0-b6de-b0a0c5868181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:06.823290 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fb189-6992-48e0-b6de-b0a0c5868181 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:06.823581 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fb189-6992-48e0-b6de-b0a0c5868181 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:06.823866 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fb189-6992-48e0-b6de-b0a0c5868181 admin admin] PATH_INFO: `/v3/projects/3254768b950741409b4b08384a7fc310/users/400a099d23df4df7937d86e2e5b3c769/roles/5f70396837d2484ca16563634aa8d2a2` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:06.825840 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300fb189-6992-48e0-b6de-b0a0c5868181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3254768b950741409b4b08384a7fc310, user_id=400a099d23df4df7937d86e2e5b3c769, role_id=5f70396837d2484ca16563634aa8d2a2)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:06.852670 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300fb189-6992-48e0-b6de-b0a0c5868181 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:06.865103 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 520/1040] 10.222.0.37 () {58 vars in 1460 bytes} [Wed Dec 29 20:40:06 2021] PUT /identity/v3/projects/3254768b950741409b4b08384a7fc310/users/400a099d23df4df7937d86e2e5b3c769/roles/5f70396837d2484ca16563634aa8d2a2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:40:08.804157 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f281cd9-8f96-491e-ad1c-039d90394052 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:08.804720 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f281cd9-8f96-491e-ad1c-039d90394052 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:08.804720 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f281cd9-8f96-491e-ad1c-039d90394052 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:08.806355 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 521/1041] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:40:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:40:08.811493 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcc24e-4db9-4a02-8344-c0a82b5e6d96 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:08.811856 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcc24e-4db9-4a02-8344-c0a82b5e6d96 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:08.812099 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcc24e-4db9-4a02-8344-c0a82b5e6d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:08.836310 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-5efcc24e-4db9-4a02-8344-c0a82b5e6d96 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:40:08.837442 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-5efcc24e-4db9-4a02-8344-c0a82b5e6d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:40:08.899753 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 521/1042] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:40:08 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:40:08.922779 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f281cd9-8f96-491e-ad1c-039d90394052 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:08.934354 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f281cd9-8f96-491e-ad1c-039d90394052 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:08.938410 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff4be0-334d-48f0-9256-e12f432c6703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:08.939334 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff4be0-334d-48f0-9256-e12f432c6703 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:08.939941 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff4be0-334d-48f0-9256-e12f432c6703 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:08.940225 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff4be0-334d-48f0-9256-e12f432c6703 admin admin] PATH_INFO: `/v3/roles/5f70396837d2484ca16563634aa8d2a2` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:08.941531 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff4be0-334d-48f0-9256-e12f432c6703 admin admin] RBAC: Authorizing `identity:get_role(role_id=5f70396837d2484ca16563634aa8d2a2)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:08.967465 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff4be0-334d-48f0-9256-e12f432c6703 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:08.968685 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 522/1043] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:40:08 2021] GET /identity/v3/roles/5f70396837d2484ca16563634aa8d2a2 => generated 223 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:08.974729 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcc24e-4db9-4a02-8344-c0a82b5e6d96 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:08.983159 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcc24e-4db9-4a02-8344-c0a82b5e6d96 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:08.987230 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafbb1b-52d4-49f9-add2-59059fc635ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:08.988012 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafbb1b-52d4-49f9-add2-59059fc635ee admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:08.988296 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafbb1b-52d4-49f9-add2-59059fc635ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:08.988568 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafbb1b-52d4-49f9-add2-59059fc635ee admin admin] PATH_INFO: `/v3/users/400a099d23df4df7937d86e2e5b3c769` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:08.989621 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafbb1b-52d4-49f9-add2-59059fc635ee admin admin] RBAC: Authorizing `identity:get_user(user_id=400a099d23df4df7937d86e2e5b3c769)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:09.015477 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafbb1b-52d4-49f9-add2-59059fc635ee admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:09.016890 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 522/1044] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:40:08 2021] GET /identity/v3/users/400a099d23df4df7937d86e2e5b3c769 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:09.023050 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff4be0-334d-48f0-9256-e12f432c6703 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:09.032096 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff4be0-334d-48f0-9256-e12f432c6703 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:09.036699 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262c85c-93d7-417f-9636-ba18d3355a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:09.037243 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262c85c-93d7-417f-9636-ba18d3355a9e admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:09.037526 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262c85c-93d7-417f-9636-ba18d3355a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:09.037801 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262c85c-93d7-417f-9636-ba18d3355a9e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:09.045183 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262c85c-93d7-417f-9636-ba18d3355a9e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:09.071223 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262c85c-93d7-417f-9636-ba18d3355a9e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:09.079386 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 523/1045] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:40:09 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:40:09.085452 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafbb1b-52d4-49f9-add2-59059fc635ee admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:09.094479 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafbb1b-52d4-49f9-add2-59059fc635ee admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:09.098646 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28159c-4a04-468b-a2b2-049a7949b71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:09.099434 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28159c-4a04-468b-a2b2-049a7949b71f admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:09.099724 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28159c-4a04-468b-a2b2-049a7949b71f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:09.100009 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28159c-4a04-468b-a2b2-049a7949b71f admin admin] PATH_INFO: `/v3/projects/3254768b950741409b4b08384a7fc310` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:09.101080 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28159c-4a04-468b-a2b2-049a7949b71f admin admin] RBAC: Authorizing `identity:get_project(project_id=3254768b950741409b4b08384a7fc310)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:09.126684 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28159c-4a04-468b-a2b2-049a7949b71f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:09.128687 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 523/1046] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:40:09 2021] GET /identity/v3/projects/3254768b950741409b4b08384a7fc310 => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:09.134236 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262c85c-93d7-417f-9636-ba18d3355a9e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:09.144650 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262c85c-93d7-417f-9636-ba18d3355a9e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:09.148775 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3185532-e359-4d4b-b180-a79c57d08088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:09.149328 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3185532-e359-4d4b-b180-a79c57d08088 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:09.149612 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3185532-e359-4d4b-b180-a79c57d08088 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:09.149888 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3185532-e359-4d4b-b180-a79c57d08088 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:09.150647 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3185532-e359-4d4b-b180-a79c57d08088 admin admin] RBAC: Adding query filter params (role.id=5f70396837d2484ca16563634aa8d2a2, scope.project.id=3254768b950741409b4b08384a7fc310, user.id=400a099d23df4df7937d86e2e5b3c769) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:40:09.150973 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3185532-e359-4d4b-b180-a79c57d08088 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:09.176873 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3185532-e359-4d4b-b180-a79c57d08088 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:09.182410 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 524/1047] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:40:09 2021] GET /identity/v3/role_assignments?user.id=400a099d23df4df7937d86e2e5b3c769&scope.project.id=3254768b950741409b4b08384a7fc310&role.id=5f70396837d2484ca16563634aa8d2a2 => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:11.128606 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92e7ef-6aad-474a-ab43-38a07b6a82a5 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:11.129122 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92e7ef-6aad-474a-ab43-38a07b6a82a5 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:11.129122 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92e7ef-6aad-474a-ab43-38a07b6a82a5 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:11.130769 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 524/1048] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:40:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:40:11.135813 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735d51a-f05b-4375-bfce-0b66375acb7c None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:11.136227 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735d51a-f05b-4375-bfce-0b66375acb7c None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:11.136388 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735d51a-f05b-4375-bfce-0b66375acb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:11.159232 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-3735d51a-f05b-4375-bfce-0b66375acb7c None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:40:11.160342 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-3735d51a-f05b-4375-bfce-0b66375acb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:40:11.167121 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 525/1049] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:40:11 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:40:11.188540 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92e7ef-6aad-474a-ab43-38a07b6a82a5 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:11.200116 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92e7ef-6aad-474a-ab43-38a07b6a82a5 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:11.203958 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766790e7-9dd0-4149-aca8-34812b263f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:11.204656 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766790e7-9dd0-4149-aca8-34812b263f92 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:11.205475 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766790e7-9dd0-4149-aca8-34812b263f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:11.205755 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766790e7-9dd0-4149-aca8-34812b263f92 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:11.206842 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766790e7-9dd0-4149-aca8-34812b263f92 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:11.232686 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766790e7-9dd0-4149-aca8-34812b263f92 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:11.234097 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 525/1050] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:40:11 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:11.239693 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735d51a-f05b-4375-bfce-0b66375acb7c None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:11.248269 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735d51a-f05b-4375-bfce-0b66375acb7c None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:11.252907 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304a5e3-de87-4d8c-ba86-91b21b2208fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:11.253485 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304a5e3-de87-4d8c-ba86-91b21b2208fd admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:11.253771 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304a5e3-de87-4d8c-ba86-91b21b2208fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:11.254054 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304a5e3-de87-4d8c-ba86-91b21b2208fd admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:11.254740 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304a5e3-de87-4d8c-ba86-91b21b2208fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:11.280577 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304a5e3-de87-4d8c-ba86-91b21b2208fd admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:11.306208 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 526/1051] 10.222.0.37 () {60 vars in 1162 bytes} [Wed Dec 29 20:40:11 2021] POST /identity/v3/projects => generated 311 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:40:13.283761 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52e71c-a34b-4a39-9017-c3469728b45d None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:13.284282 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52e71c-a34b-4a39-9017-c3469728b45d None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:13.284282 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52e71c-a34b-4a39-9017-c3469728b45d None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:13.285901 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 526/1052] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:40:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:40:13.291088 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa55ae-cfa3-4f9d-a859-0c49914fd1ad None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:13.291507 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa55ae-cfa3-4f9d-a859-0c49914fd1ad None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:13.291651 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa55ae-cfa3-4f9d-a859-0c49914fd1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:13.313437 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-61fa55ae-cfa3-4f9d-a859-0c49914fd1ad None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:40:13.315173 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-61fa55ae-cfa3-4f9d-a859-0c49914fd1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:40:13.376024 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 527/1053] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:40:13 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:40:13.400274 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52e71c-a34b-4a39-9017-c3469728b45d None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:13.411968 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52e71c-a34b-4a39-9017-c3469728b45d None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:13.415906 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b05a8-4789-4b99-964e-98c917fc3cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:13.416610 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b05a8-4789-4b99-964e-98c917fc3cdb admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:13.416896 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b05a8-4789-4b99-964e-98c917fc3cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:13.417175 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b05a8-4789-4b99-964e-98c917fc3cdb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:13.418231 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b05a8-4789-4b99-964e-98c917fc3cdb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:13.445004 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b05a8-4789-4b99-964e-98c917fc3cdb admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:13.446428 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 527/1054] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:40:13 2021] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:13.451730 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa55ae-cfa3-4f9d-a859-0c49914fd1ad None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:13.460117 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa55ae-cfa3-4f9d-a859-0c49914fd1ad None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:13.464141 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95126fff-ef45-47f9-a773-2e1b00fb688b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:13.464715 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95126fff-ef45-47f9-a773-2e1b00fb688b admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:13.465000 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95126fff-ef45-47f9-a773-2e1b00fb688b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:13.465276 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95126fff-ef45-47f9-a773-2e1b00fb688b admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:13.465914 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95126fff-ef45-47f9-a773-2e1b00fb688b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:13.491866 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95126fff-ef45-47f9-a773-2e1b00fb688b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:13.511153 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 528/1055] 10.222.0.37 () {60 vars in 1153 bytes} [Wed Dec 29 20:40:13 2021] POST /identity/v3/users => generated 286 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:40:15.492365 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7b93d-6b44-48ce-b8cb-76b1ac9d00c9 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:15.492912 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7b93d-6b44-48ce-b8cb-76b1ac9d00c9 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:15.492912 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7b93d-6b44-48ce-b8cb-76b1ac9d00c9 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:15.494618 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 528/1056] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:40:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:40:15.499836 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa24828-4506-48f7-8dcc-9723f90b0aee None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:15.500234 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa24828-4506-48f7-8dcc-9723f90b0aee None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:15.500406 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa24828-4506-48f7-8dcc-9723f90b0aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:15.524303 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-daa24828-4506-48f7-8dcc-9723f90b0aee None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:40:15.525440 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-daa24828-4506-48f7-8dcc-9723f90b0aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:40:15.532239 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 529/1057] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:40:15 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:40:15.554720 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7b93d-6b44-48ce-b8cb-76b1ac9d00c9 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:15.566705 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7b93d-6b44-48ce-b8cb-76b1ac9d00c9 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:15.570926 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44dc39-1127-49bc-9f1c-f8bc7abcb0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:15.571628 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44dc39-1127-49bc-9f1c-f8bc7abcb0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:15.571917 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44dc39-1127-49bc-9f1c-f8bc7abcb0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:15.572198 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44dc39-1127-49bc-9f1c-f8bc7abcb0f8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:15.584056 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44dc39-1127-49bc-9f1c-f8bc7abcb0f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:40:15.590314 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-3d44dc39-1127-49bc-9f1c-f8bc7abcb0f8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:40:15.591396 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 529/1058] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:40:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:40:15.597013 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa24828-4506-48f7-8dcc-9723f90b0aee None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:15.605443 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa24828-4506-48f7-8dcc-9723f90b0aee None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:15.609422 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170639a7-ca3e-446c-ad75-3671fcffb458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:15.609999 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170639a7-ca3e-446c-ad75-3671fcffb458 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:15.610291 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170639a7-ca3e-446c-ad75-3671fcffb458 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:15.610570 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170639a7-ca3e-446c-ad75-3671fcffb458 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:15.611819 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170639a7-ca3e-446c-ad75-3671fcffb458 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:40:15.612109 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170639a7-ca3e-446c-ad75-3671fcffb458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:15.637531 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170639a7-ca3e-446c-ad75-3671fcffb458 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:15.645862 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 530/1059] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:40:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:15.651312 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44dc39-1127-49bc-9f1c-f8bc7abcb0f8 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:15.660399 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44dc39-1127-49bc-9f1c-f8bc7abcb0f8 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:15.664666 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d888c-e773-4d80-8536-bbcce05a2809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:15.665453 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d888c-e773-4d80-8536-bbcce05a2809 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:15.665738 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d888c-e773-4d80-8536-bbcce05a2809 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:15.666015 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d888c-e773-4d80-8536-bbcce05a2809 admin admin] PATH_INFO: `/v3/users/46856f130b344342890c397cb9747fd4` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:15.684553 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d888c-e773-4d80-8536-bbcce05a2809 admin admin] RBAC: Authorizing `identity:get_user(user_id=46856f130b344342890c397cb9747fd4)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:15.711191 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d888c-e773-4d80-8536-bbcce05a2809 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:15.712650 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 530/1060] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:40:15 2021] GET /identity/v3/users/46856f130b344342890c397cb9747fd4 => generated 286 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:40:15.718144 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170639a7-ca3e-446c-ad75-3671fcffb458 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:15.728414 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170639a7-ca3e-446c-ad75-3671fcffb458 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:15.732457 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41d672-290c-403e-a994-a964502532f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:15.733019 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41d672-290c-403e-a994-a964502532f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:15.733303 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41d672-290c-403e-a994-a964502532f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:15.733582 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41d672-290c-403e-a994-a964502532f0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:15.741624 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41d672-290c-403e-a994-a964502532f0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:15.767400 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41d672-290c-403e-a994-a964502532f0 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:15.775565 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 531/1061] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:40:15 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:40:15.781237 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d888c-e773-4d80-8536-bbcce05a2809 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:15.790845 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d888c-e773-4d80-8536-bbcce05a2809 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:15.794880 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89126f9f-5b7a-4f26-b681-ef2709c5d9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:15.795656 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89126f9f-5b7a-4f26-b681-ef2709c5d9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:15.795943 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89126f9f-5b7a-4f26-b681-ef2709c5d9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:15.796221 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89126f9f-5b7a-4f26-b681-ef2709c5d9b0 admin admin] PATH_INFO: `/v3/projects/eab36123e8944d6cbc3850dcea7e4cf4` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:15.797286 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89126f9f-5b7a-4f26-b681-ef2709c5d9b0 admin admin] RBAC: Authorizing `identity:get_project(project_id=eab36123e8944d6cbc3850dcea7e4cf4)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:15.824109 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89126f9f-5b7a-4f26-b681-ef2709c5d9b0 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:15.825623 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 531/1062] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:40:15 2021] GET /identity/v3/projects/eab36123e8944d6cbc3850dcea7e4cf4 => generated 311 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:15.831188 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41d672-290c-403e-a994-a964502532f0 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:15.839535 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41d672-290c-403e-a994-a964502532f0 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:15.843555 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3650ed-5e5f-41f1-b8f4-e0393bc01d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:15.844283 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3650ed-5e5f-41f1-b8f4-e0393bc01d41 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:15.844567 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3650ed-5e5f-41f1-b8f4-e0393bc01d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:15.844842 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3650ed-5e5f-41f1-b8f4-e0393bc01d41 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:15.846112 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3650ed-5e5f-41f1-b8f4-e0393bc01d41 admin admin] RBAC: Adding query filter params (role.id=e66e6a94ba014fd193b851ceb92695ae, scope.project.id=eab36123e8944d6cbc3850dcea7e4cf4, user.id=46856f130b344342890c397cb9747fd4) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:40:15.846409 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3650ed-5e5f-41f1-b8f4-e0393bc01d41 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:15.872086 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3650ed-5e5f-41f1-b8f4-e0393bc01d41 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:15.877421 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 532/1063] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:40:15 2021] GET /identity/v3/role_assignments?user.id=46856f130b344342890c397cb9747fd4&scope.project.id=eab36123e8944d6cbc3850dcea7e4cf4&role.id=e66e6a94ba014fd193b851ceb92695ae => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:17.796670 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cb7af-1a0a-4557-b27f-d722d4fe05d2 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:17.797193 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cb7af-1a0a-4557-b27f-d722d4fe05d2 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:17.797300 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cb7af-1a0a-4557-b27f-d722d4fe05d2 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:17.799095 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 532/1064] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:40:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:40:17.804271 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5637b0-5579-4fb1-9cd3-ecaf2f32adfd None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:17.804682 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5637b0-5579-4fb1-9cd3-ecaf2f32adfd None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:17.804831 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5637b0-5579-4fb1-9cd3-ecaf2f32adfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:17.826801 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-4d5637b0-5579-4fb1-9cd3-ecaf2f32adfd None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:40:17.827927 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-4d5637b0-5579-4fb1-9cd3-ecaf2f32adfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:40:17.835204 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 533/1065] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:40:17 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:40:17.857490 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93cb7af-1a0a-4557-b27f-d722d4fe05d2 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:17.869069 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93cb7af-1a0a-4557-b27f-d722d4fe05d2 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:17.872927 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451744f5-df71-4aeb-a570-a44142a1f838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:17.873633 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451744f5-df71-4aeb-a570-a44142a1f838 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:17.873915 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451744f5-df71-4aeb-a570-a44142a1f838 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:17.874190 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451744f5-df71-4aeb-a570-a44142a1f838 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:17.885039 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451744f5-df71-4aeb-a570-a44142a1f838 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:40:17.891267 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-451744f5-df71-4aeb-a570-a44142a1f838 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:40:17.892815 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 533/1066] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:40:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:40:17.898678 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5637b0-5579-4fb1-9cd3-ecaf2f32adfd None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:17.907149 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5637b0-5579-4fb1-9cd3-ecaf2f32adfd None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:17.912027 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac63893-2589-4acd-bdd3-24204246d170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:17.912607 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac63893-2589-4acd-bdd3-24204246d170 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:17.912891 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac63893-2589-4acd-bdd3-24204246d170 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:17.913168 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac63893-2589-4acd-bdd3-24204246d170 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:17.913863 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac63893-2589-4acd-bdd3-24204246d170 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:40:17.914157 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac63893-2589-4acd-bdd3-24204246d170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:17.939644 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac63893-2589-4acd-bdd3-24204246d170 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:17.948180 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 534/1067] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:40:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:17.953519 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451744f5-df71-4aeb-a570-a44142a1f838 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:17.963957 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451744f5-df71-4aeb-a570-a44142a1f838 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:17.967942 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d04ec-0741-4f21-a771-89aa4a6f9042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:17.968709 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d04ec-0741-4f21-a771-89aa4a6f9042 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:17.968993 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d04ec-0741-4f21-a771-89aa4a6f9042 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:17.969270 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d04ec-0741-4f21-a771-89aa4a6f9042 admin admin] PATH_INFO: `/v3/users/46856f130b344342890c397cb9747fd4` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:17.970939 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d04ec-0741-4f21-a771-89aa4a6f9042 admin admin] RBAC: Authorizing `identity:get_user(user_id=46856f130b344342890c397cb9747fd4)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:17.996678 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d04ec-0741-4f21-a771-89aa4a6f9042 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:17.998127 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 534/1068] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:40:17 2021] GET /identity/v3/users/46856f130b344342890c397cb9747fd4 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:18.003430 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac63893-2589-4acd-bdd3-24204246d170 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:18.012363 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac63893-2589-4acd-bdd3-24204246d170 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:18.016408 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83928f6-26dc-40f1-ab3a-59150fd688b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:18.017707 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83928f6-26dc-40f1-ab3a-59150fd688b2 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:18.017995 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83928f6-26dc-40f1-ab3a-59150fd688b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:18.018276 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83928f6-26dc-40f1-ab3a-59150fd688b2 admin admin] PATH_INFO: `/v3/projects/eab36123e8944d6cbc3850dcea7e4cf4` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:18.019324 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83928f6-26dc-40f1-ab3a-59150fd688b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=eab36123e8944d6cbc3850dcea7e4cf4)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:18.044869 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83928f6-26dc-40f1-ab3a-59150fd688b2 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:18.046342 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 535/1069] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:40:18 2021] GET /identity/v3/projects/eab36123e8944d6cbc3850dcea7e4cf4 => generated 311 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:18.051686 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d04ec-0741-4f21-a771-89aa4a6f9042 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:18.060511 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d04ec-0741-4f21-a771-89aa4a6f9042 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:18.064988 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6037e2-3882-4494-a523-e36482adb138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:18.065766 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6037e2-3882-4494-a523-e36482adb138 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:18.066049 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6037e2-3882-4494-a523-e36482adb138 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:18.066324 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6037e2-3882-4494-a523-e36482adb138 admin admin] PATH_INFO: `/v3/projects/eab36123e8944d6cbc3850dcea7e4cf4/users/46856f130b344342890c397cb9747fd4/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:18.068081 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6037e2-3882-4494-a523-e36482adb138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eab36123e8944d6cbc3850dcea7e4cf4, user_id=46856f130b344342890c397cb9747fd4, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:18.094227 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6037e2-3882-4494-a523-e36482adb138 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:18.106856 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 535/1070] 10.222.0.37 () {58 vars in 1460 bytes} [Wed Dec 29 20:40:18 2021] PUT /identity/v3/projects/eab36123e8944d6cbc3850dcea7e4cf4/users/46856f130b344342890c397cb9747fd4/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:40:20.034291 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c7329-cfb4-4abe-8542-af1393f9af96 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:20.034851 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c7329-cfb4-4abe-8542-af1393f9af96 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:20.034954 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c7329-cfb4-4abe-8542-af1393f9af96 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:20.036544 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 536/1071] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:40:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:40:20.041551 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de194ab-00e8-453e-9df7-123800873096 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:20.041933 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de194ab-00e8-453e-9df7-123800873096 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:20.042124 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de194ab-00e8-453e-9df7-123800873096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:20.065014 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-1de194ab-00e8-453e-9df7-123800873096 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:40:20.066138 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-1de194ab-00e8-453e-9df7-123800873096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:40:20.127929 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 536/1072] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:40:20 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:40:20.150321 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c7329-cfb4-4abe-8542-af1393f9af96 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:20.162113 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c7329-cfb4-4abe-8542-af1393f9af96 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:20.166063 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357b27b-8ad5-4796-81e6-1fffd9e7efcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:20.166806 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357b27b-8ad5-4796-81e6-1fffd9e7efcf admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:20.167122 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357b27b-8ad5-4796-81e6-1fffd9e7efcf admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:20.167402 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357b27b-8ad5-4796-81e6-1fffd9e7efcf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:20.179552 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357b27b-8ad5-4796-81e6-1fffd9e7efcf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:40:20.185716 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-0357b27b-8ad5-4796-81e6-1fffd9e7efcf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:40:20.186811 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 537/1073] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:40:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:40:20.193227 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de194ab-00e8-453e-9df7-123800873096 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:20.201953 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de194ab-00e8-453e-9df7-123800873096 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:20.206477 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6613e-5699-4b15-8e21-22b33a861e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:20.207097 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6613e-5699-4b15-8e21-22b33a861e72 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:20.207384 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6613e-5699-4b15-8e21-22b33a861e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:20.207664 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6613e-5699-4b15-8e21-22b33a861e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:20.208375 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6613e-5699-4b15-8e21-22b33a861e72 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:40:20.208671 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6613e-5699-4b15-8e21-22b33a861e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:20.233938 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6613e-5699-4b15-8e21-22b33a861e72 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:20.242992 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 537/1074] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:40:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:20.248648 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357b27b-8ad5-4796-81e6-1fffd9e7efcf admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:20.258413 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357b27b-8ad5-4796-81e6-1fffd9e7efcf admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:20.262407 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5be1e1-639a-43db-9525-f4afcaf2cab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:20.263223 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5be1e1-639a-43db-9525-f4afcaf2cab7 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:20.263506 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5be1e1-639a-43db-9525-f4afcaf2cab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:20.263782 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5be1e1-639a-43db-9525-f4afcaf2cab7 admin admin] PATH_INFO: `/v3/users/46856f130b344342890c397cb9747fd4` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:20.264845 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5be1e1-639a-43db-9525-f4afcaf2cab7 admin admin] RBAC: Authorizing `identity:get_user(user_id=46856f130b344342890c397cb9747fd4)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:20.290897 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5be1e1-639a-43db-9525-f4afcaf2cab7 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:20.292321 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 538/1075] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:40:20 2021] GET /identity/v3/users/46856f130b344342890c397cb9747fd4 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:20.297607 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6613e-5699-4b15-8e21-22b33a861e72 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:20.307706 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6613e-5699-4b15-8e21-22b33a861e72 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:20.311781 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f466e-9473-4bac-87dc-f40f512d49eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:20.312345 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f466e-9473-4bac-87dc-f40f512d49eb admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:20.312636 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f466e-9473-4bac-87dc-f40f512d49eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:20.312920 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f466e-9473-4bac-87dc-f40f512d49eb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:20.321273 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f466e-9473-4bac-87dc-f40f512d49eb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:20.348023 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f466e-9473-4bac-87dc-f40f512d49eb admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:20.356343 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 538/1076] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:40:20 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:40:20.362461 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5be1e1-639a-43db-9525-f4afcaf2cab7 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:20.371344 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5be1e1-639a-43db-9525-f4afcaf2cab7 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:20.375313 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe7f9d-c179-4bc7-93e2-b2943bd60570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:20.376061 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe7f9d-c179-4bc7-93e2-b2943bd60570 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:20.376473 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe7f9d-c179-4bc7-93e2-b2943bd60570 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:20.376772 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe7f9d-c179-4bc7-93e2-b2943bd60570 admin admin] PATH_INFO: `/v3/projects/eab36123e8944d6cbc3850dcea7e4cf4` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:20.377828 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe7f9d-c179-4bc7-93e2-b2943bd60570 admin admin] RBAC: Authorizing `identity:get_project(project_id=eab36123e8944d6cbc3850dcea7e4cf4)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:20.403037 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe7f9d-c179-4bc7-93e2-b2943bd60570 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:20.404452 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 539/1077] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:40:20 2021] GET /identity/v3/projects/eab36123e8944d6cbc3850dcea7e4cf4 => generated 311 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:20.410507 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f466e-9473-4bac-87dc-f40f512d49eb admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:20.418717 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f466e-9473-4bac-87dc-f40f512d49eb admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:20.422751 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655a362-6490-4164-a9a1-127b00010b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:20.424055 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655a362-6490-4164-a9a1-127b00010b13 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:20.424341 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655a362-6490-4164-a9a1-127b00010b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:20.424618 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655a362-6490-4164-a9a1-127b00010b13 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:20.425383 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655a362-6490-4164-a9a1-127b00010b13 admin admin] RBAC: Adding query filter params (role.id=e66e6a94ba014fd193b851ceb92695ae, scope.project.id=eab36123e8944d6cbc3850dcea7e4cf4, user.id=46856f130b344342890c397cb9747fd4) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:40:20.425685 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655a362-6490-4164-a9a1-127b00010b13 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:20.451411 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655a362-6490-4164-a9a1-127b00010b13 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:20.457220 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 539/1078] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:40:20 2021] GET /identity/v3/role_assignments?user.id=46856f130b344342890c397cb9747fd4&scope.project.id=eab36123e8944d6cbc3850dcea7e4cf4&role.id=e66e6a94ba014fd193b851ceb92695ae => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:22.434796 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec04b3e-3e08-403f-9818-1f9ab47bb3b1 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:22.435336 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec04b3e-3e08-403f-9818-1f9ab47bb3b1 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:22.435436 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec04b3e-3e08-403f-9818-1f9ab47bb3b1 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:22.437025 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 540/1079] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:40:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:40:22.442516 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7ab7d-2b2c-4f91-9186-11ca4e71032a None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:22.442941 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7ab7d-2b2c-4f91-9186-11ca4e71032a None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:22.443125 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7ab7d-2b2c-4f91-9186-11ca4e71032a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:22.465685 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-7db7ab7d-2b2c-4f91-9186-11ca4e71032a None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:40:22.466875 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-7db7ab7d-2b2c-4f91-9186-11ca4e71032a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:40:22.474282 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 540/1080] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:40:22 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:40:22.495954 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec04b3e-3e08-403f-9818-1f9ab47bb3b1 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:22.507312 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec04b3e-3e08-403f-9818-1f9ab47bb3b1 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:22.511176 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6b9c7-e64c-4e7d-aea5-953c8285ec35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:22.511728 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6b9c7-e64c-4e7d-aea5-953c8285ec35 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:22.512013 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6b9c7-e64c-4e7d-aea5-953c8285ec35 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:22.512292 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6b9c7-e64c-4e7d-aea5-953c8285ec35 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:22.520312 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6b9c7-e64c-4e7d-aea5-953c8285ec35 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:22.546071 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6b9c7-e64c-4e7d-aea5-953c8285ec35 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:22.554359 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 541/1081] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:40:22 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:40:22.560107 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7ab7d-2b2c-4f91-9186-11ca4e71032a None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:22.569508 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7ab7d-2b2c-4f91-9186-11ca4e71032a None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:22.573563 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b960ca-7eb3-4975-b7d9-1e9c7980e3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:22.574275 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b960ca-7eb3-4975-b7d9-1e9c7980e3ee admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:22.574562 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b960ca-7eb3-4975-b7d9-1e9c7980e3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:22.574871 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b960ca-7eb3-4975-b7d9-1e9c7980e3ee admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:22.583379 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b960ca-7eb3-4975-b7d9-1e9c7980e3ee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:22.608816 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b960ca-7eb3-4975-b7d9-1e9c7980e3ee admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:22.623170 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-b6b960ca-7eb3-4975-b7d9-1e9c7980e3ee admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Dec 29 20:40:22.624211 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 541/1082] 10.222.0.37 () {56 vars in 1138 bytes} [Wed Dec 29 20:40:22 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:40:22.630479 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6b9c7-e64c-4e7d-aea5-953c8285ec35 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:22.638838 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6b9c7-e64c-4e7d-aea5-953c8285ec35 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:22.643944 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba9e72-831b-4397-ad23-9fa10f27003a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:22.644511 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba9e72-831b-4397-ad23-9fa10f27003a admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:22.644795 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba9e72-831b-4397-ad23-9fa10f27003a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:22.645070 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba9e72-831b-4397-ad23-9fa10f27003a admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:22.645731 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba9e72-831b-4397-ad23-9fa10f27003a admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:40:22.646025 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba9e72-831b-4397-ad23-9fa10f27003a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:22.670859 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba9e72-831b-4397-ad23-9fa10f27003a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:22.678485 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 542/1083] 10.222.0.37 () {56 vars in 1136 bytes} [Wed Dec 29 20:40:22 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:24.595760 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f1019-58c7-4131-84ad-2189bd0c910f None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:24.596284 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f1019-58c7-4131-84ad-2189bd0c910f None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:24.596375 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f1019-58c7-4131-84ad-2189bd0c910f None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:24.597967 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 542/1084] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:40:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:40:24.603906 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55bec4-9a29-4863-bd78-c814a9337975 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:24.604314 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55bec4-9a29-4863-bd78-c814a9337975 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:24.604477 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55bec4-9a29-4863-bd78-c814a9337975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:24.626452 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-7f55bec4-9a29-4863-bd78-c814a9337975 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:40:24.627624 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-7f55bec4-9a29-4863-bd78-c814a9337975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:40:24.634415 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 543/1085] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:40:24 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:40:24.656701 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f1019-58c7-4131-84ad-2189bd0c910f None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:24.668665 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f1019-58c7-4131-84ad-2189bd0c910f None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:24.672612 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dbf20-ff0b-4c4e-a09a-41b33b94e2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:24.673773 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dbf20-ff0b-4c4e-a09a-41b33b94e2f5 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:24.674061 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dbf20-ff0b-4c4e-a09a-41b33b94e2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:24.674338 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dbf20-ff0b-4c4e-a09a-41b33b94e2f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:24.675074 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6dbf20-ff0b-4c4e-a09a-41b33b94e2f5 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:24.700530 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING py.warnings [None req-fb6dbf20-ff0b-4c4e-a09a-41b33b94e2f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:40:24.700530 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: warnings.warn(msg) Dec 29 20:40:24.700530 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: Dec 29 20:40:24.701386 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6dbf20-ff0b-4c4e-a09a-41b33b94e2f5 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:24.716401 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 543/1086] 10.222.0.37 () {60 vars in 1159 bytes} [Wed Dec 29 20:40:24 2021] POST /identity/v3/domains => generated 267 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:40:26.671371 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f8f5d-58d2-48dd-8f2b-d642b2c26dc0 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:26.671932 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f8f5d-58d2-48dd-8f2b-d642b2c26dc0 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:26.671932 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f8f5d-58d2-48dd-8f2b-d642b2c26dc0 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:26.674268 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 544/1087] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:40:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:40:26.679292 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b75a4-6a05-4569-af40-580efc208c48 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:26.679703 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b75a4-6a05-4569-af40-580efc208c48 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:26.679867 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b75a4-6a05-4569-af40-580efc208c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:26.701989 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-7a8b75a4-6a05-4569-af40-580efc208c48 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:40:26.703149 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-7a8b75a4-6a05-4569-af40-580efc208c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:40:26.767634 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 544/1088] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:40:26 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:40:26.790762 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f8f5d-58d2-48dd-8f2b-d642b2c26dc0 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:26.802041 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f8f5d-58d2-48dd-8f2b-d642b2c26dc0 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:26.805891 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f723f38-2f41-4fce-ac70-8436e26d9e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:26.806649 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f723f38-2f41-4fce-ac70-8436e26d9e2b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:26.806956 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f723f38-2f41-4fce-ac70-8436e26d9e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:26.807230 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f723f38-2f41-4fce-ac70-8436e26d9e2b admin admin] PATH_INFO: `/v3/domains/33ae9c00cd5d4d258a72d2721d89361e` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:26.818691 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f723f38-2f41-4fce-ac70-8436e26d9e2b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=33ae9c00cd5d4d258a72d2721d89361e)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:26.845401 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f723f38-2f41-4fce-ac70-8436e26d9e2b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:26.847028 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 545/1089] 10.222.0.37 () {56 vars in 1204 bytes} [Wed Dec 29 20:40:26 2021] GET /identity/v3/domains/33ae9c00cd5d4d258a72d2721d89361e => generated 267 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:26.852744 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b75a4-6a05-4569-af40-580efc208c48 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:26.861284 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b75a4-6a05-4569-af40-580efc208c48 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:26.865579 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905255a-50d3-43de-ac3b-a696598ff1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:26.866153 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905255a-50d3-43de-ac3b-a696598ff1cf admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:26.866434 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905255a-50d3-43de-ac3b-a696598ff1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:26.866738 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905255a-50d3-43de-ac3b-a696598ff1cf admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:26.867396 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905255a-50d3-43de-ac3b-a696598ff1cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:26.893459 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905255a-50d3-43de-ac3b-a696598ff1cf admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:26.919514 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 545/1090] 10.222.0.37 () {60 vars in 1162 bytes} [Wed Dec 29 20:40:26 2021] POST /identity/v3/projects => generated 361 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:40:28.884292 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe13f19-3494-4bdf-9dfb-fb89a134f56b None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:28.884729 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe13f19-3494-4bdf-9dfb-fb89a134f56b None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:28.884869 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe13f19-3494-4bdf-9dfb-fb89a134f56b None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:28.886550 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 546/1091] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:40:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 29 20:40:28.891529 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4395ade-9276-464f-8581-c4c49a40fcdf None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:28.891933 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4395ade-9276-464f-8581-c4c49a40fcdf None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:28.892159 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4395ade-9276-464f-8581-c4c49a40fcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:28.914194 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-f4395ade-9276-464f-8581-c4c49a40fcdf None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:40:28.915332 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-f4395ade-9276-464f-8581-c4c49a40fcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:40:28.977442 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 546/1092] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:40:28 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:40:29.001082 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe13f19-3494-4bdf-9dfb-fb89a134f56b None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:29.012318 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe13f19-3494-4bdf-9dfb-fb89a134f56b None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:29.016667 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf2187-0b4f-4e5f-ac91-e5eda3920e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:29.017429 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf2187-0b4f-4e5f-ac91-e5eda3920e4f admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:29.017711 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf2187-0b4f-4e5f-ac91-e5eda3920e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:29.017985 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf2187-0b4f-4e5f-ac91-e5eda3920e4f admin admin] PATH_INFO: `/v3/domains/33ae9c00cd5d4d258a72d2721d89361e` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:29.019061 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf2187-0b4f-4e5f-ac91-e5eda3920e4f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=33ae9c00cd5d4d258a72d2721d89361e)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:29.045237 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf2187-0b4f-4e5f-ac91-e5eda3920e4f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:29.046646 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 547/1093] 10.222.0.37 () {56 vars in 1204 bytes} [Wed Dec 29 20:40:29 2021] GET /identity/v3/domains/33ae9c00cd5d4d258a72d2721d89361e => generated 267 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:29.052005 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4395ade-9276-464f-8581-c4c49a40fcdf None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:29.060422 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4395ade-9276-464f-8581-c4c49a40fcdf None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:29.064588 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54df58e-b476-4578-8b51-95fad0a9ab8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:29.065172 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54df58e-b476-4578-8b51-95fad0a9ab8d admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:29.065462 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54df58e-b476-4578-8b51-95fad0a9ab8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:29.065744 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54df58e-b476-4578-8b51-95fad0a9ab8d admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:29.066405 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54df58e-b476-4578-8b51-95fad0a9ab8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:29.092395 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54df58e-b476-4578-8b51-95fad0a9ab8d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:29.113256 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 547/1094] 10.222.0.37 () {60 vars in 1153 bytes} [Wed Dec 29 20:40:29 2021] POST /identity/v3/users => generated 311 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:40:31.086225 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7ad91-0fb0-4c42-a2db-f21cf1d562e9 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:31.086816 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7ad91-0fb0-4c42-a2db-f21cf1d562e9 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:31.086816 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7ad91-0fb0-4c42-a2db-f21cf1d562e9 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:31.088475 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 548/1095] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:40:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:40:31.093608 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57182d84-39f0-4c0b-8f7a-c4cce09356c9 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:31.094030 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57182d84-39f0-4c0b-8f7a-c4cce09356c9 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:31.094675 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57182d84-39f0-4c0b-8f7a-c4cce09356c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:31.117048 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-57182d84-39f0-4c0b-8f7a-c4cce09356c9 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:40:31.118119 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-57182d84-39f0-4c0b-8f7a-c4cce09356c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:40:31.124888 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 548/1096] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:40:31 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:40:31.146860 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7ad91-0fb0-4c42-a2db-f21cf1d562e9 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:31.158758 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7ad91-0fb0-4c42-a2db-f21cf1d562e9 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:31.162573 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cde363-9eff-4215-8f2c-17bbc8065897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:31.163289 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cde363-9eff-4215-8f2c-17bbc8065897 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:31.163575 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cde363-9eff-4215-8f2c-17bbc8065897 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:31.163852 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cde363-9eff-4215-8f2c-17bbc8065897 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:31.175102 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cde363-9eff-4215-8f2c-17bbc8065897 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:40:31.181194 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-53cde363-9eff-4215-8f2c-17bbc8065897 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:40:31.182243 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 549/1097] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:40:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:40:31.187689 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57182d84-39f0-4c0b-8f7a-c4cce09356c9 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:31.196341 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57182d84-39f0-4c0b-8f7a-c4cce09356c9 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:31.200319 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c725ebc-8414-4728-9924-a7189c2f8063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:31.200896 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c725ebc-8414-4728-9924-a7189c2f8063 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:31.201182 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c725ebc-8414-4728-9924-a7189c2f8063 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:31.201459 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c725ebc-8414-4728-9924-a7189c2f8063 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:31.202168 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c725ebc-8414-4728-9924-a7189c2f8063 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:40:31.202461 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c725ebc-8414-4728-9924-a7189c2f8063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:31.228989 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c725ebc-8414-4728-9924-a7189c2f8063 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:31.237492 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 549/1098] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:40:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:40:31.242895 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cde363-9eff-4215-8f2c-17bbc8065897 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:31.253091 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cde363-9eff-4215-8f2c-17bbc8065897 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:31.257169 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a265b-8b2f-4983-91f2-353f89807676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:31.257940 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a265b-8b2f-4983-91f2-353f89807676 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:31.258228 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a265b-8b2f-4983-91f2-353f89807676 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:31.258510 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a265b-8b2f-4983-91f2-353f89807676 admin admin] PATH_INFO: `/v3/users/b9f5a221ce5441729df14b52a271f9b0` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:31.276422 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a265b-8b2f-4983-91f2-353f89807676 admin admin] RBAC: Authorizing `identity:get_user(user_id=b9f5a221ce5441729df14b52a271f9b0)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:31.302795 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a265b-8b2f-4983-91f2-353f89807676 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:31.304261 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 550/1099] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:40:31 2021] GET /identity/v3/users/b9f5a221ce5441729df14b52a271f9b0 => generated 311 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:31.309804 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c725ebc-8414-4728-9924-a7189c2f8063 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:31.319194 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c725ebc-8414-4728-9924-a7189c2f8063 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:31.323169 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed45949-234e-4cac-b807-51a2ee23c5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:31.323722 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed45949-234e-4cac-b807-51a2ee23c5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:31.324007 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed45949-234e-4cac-b807-51a2ee23c5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:31.324285 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed45949-234e-4cac-b807-51a2ee23c5e2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:31.332172 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed45949-234e-4cac-b807-51a2ee23c5e2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:31.357876 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed45949-234e-4cac-b807-51a2ee23c5e2 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:31.366703 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 550/1100] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:40:31 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:40:31.372416 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a265b-8b2f-4983-91f2-353f89807676 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:31.382038 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a265b-8b2f-4983-91f2-353f89807676 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:31.386084 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a069b55-eeed-49e1-b99c-4ae219786582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:31.386911 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a069b55-eeed-49e1-b99c-4ae219786582 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:31.387198 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a069b55-eeed-49e1-b99c-4ae219786582 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:31.387478 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a069b55-eeed-49e1-b99c-4ae219786582 admin admin] PATH_INFO: `/v3/projects/51478d7b99934b4da1d0ead6c2df4867` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:31.388546 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a069b55-eeed-49e1-b99c-4ae219786582 admin admin] RBAC: Authorizing `identity:get_project(project_id=51478d7b99934b4da1d0ead6c2df4867)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:31.414364 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a069b55-eeed-49e1-b99c-4ae219786582 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:31.415869 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 551/1101] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:40:31 2021] GET /identity/v3/projects/51478d7b99934b4da1d0ead6c2df4867 => generated 361 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:31.421192 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed45949-234e-4cac-b807-51a2ee23c5e2 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:31.430216 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed45949-234e-4cac-b807-51a2ee23c5e2 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:31.434290 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3fec4-45df-4932-8332-ca121c66ca7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:31.434878 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3fec4-45df-4932-8332-ca121c66ca7f admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:31.435164 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3fec4-45df-4932-8332-ca121c66ca7f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:31.435445 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3fec4-45df-4932-8332-ca121c66ca7f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:31.436208 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3fec4-45df-4932-8332-ca121c66ca7f admin admin] RBAC: Adding query filter params (role.id=e66e6a94ba014fd193b851ceb92695ae, scope.project.id=51478d7b99934b4da1d0ead6c2df4867, user.id=b9f5a221ce5441729df14b52a271f9b0) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:40:31.436508 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3fec4-45df-4932-8332-ca121c66ca7f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:31.462566 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3fec4-45df-4932-8332-ca121c66ca7f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:31.467677 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 551/1102] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:40:31 2021] GET /identity/v3/role_assignments?user.id=b9f5a221ce5441729df14b52a271f9b0&scope.project.id=51478d7b99934b4da1d0ead6c2df4867&role.id=e66e6a94ba014fd193b851ceb92695ae => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:33.386551 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30d02b-7289-4630-9d15-8e6ee6d090cb None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:33.387145 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30d02b-7289-4630-9d15-8e6ee6d090cb None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:33.387145 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30d02b-7289-4630-9d15-8e6ee6d090cb None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:33.388804 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 552/1103] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:40:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:40:33.394478 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcece0-f175-47b8-9d72-05cda20cc818 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:33.394933 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcece0-f175-47b8-9d72-05cda20cc818 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:33.395068 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcece0-f175-47b8-9d72-05cda20cc818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:33.416714 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-b7dcece0-f175-47b8-9d72-05cda20cc818 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:40:33.417822 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-b7dcece0-f175-47b8-9d72-05cda20cc818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:40:33.425181 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 552/1104] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:40:33 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:40:33.447377 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30d02b-7289-4630-9d15-8e6ee6d090cb None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:33.458799 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30d02b-7289-4630-9d15-8e6ee6d090cb None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:33.462644 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199221b-a1fc-4863-8679-1ee14c5d5c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:33.463370 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199221b-a1fc-4863-8679-1ee14c5d5c77 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:33.463658 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199221b-a1fc-4863-8679-1ee14c5d5c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:33.463938 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199221b-a1fc-4863-8679-1ee14c5d5c77 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:33.475018 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199221b-a1fc-4863-8679-1ee14c5d5c77 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:40:33.481143 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-6199221b-a1fc-4863-8679-1ee14c5d5c77 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:40:33.482186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 553/1105] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:40:33 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:40:33.488432 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcece0-f175-47b8-9d72-05cda20cc818 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:33.496740 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcece0-f175-47b8-9d72-05cda20cc818 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:33.500927 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bcfe9-8ca2-4159-8bb0-419045bb0757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:33.501495 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bcfe9-8ca2-4159-8bb0-419045bb0757 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:33.501778 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bcfe9-8ca2-4159-8bb0-419045bb0757 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:33.502057 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bcfe9-8ca2-4159-8bb0-419045bb0757 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:33.502797 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bcfe9-8ca2-4159-8bb0-419045bb0757 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:40:33.503092 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bcfe9-8ca2-4159-8bb0-419045bb0757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:33.528542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bcfe9-8ca2-4159-8bb0-419045bb0757 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:33.537241 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 553/1106] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:40:33 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:33.542611 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199221b-a1fc-4863-8679-1ee14c5d5c77 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:33.552764 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199221b-a1fc-4863-8679-1ee14c5d5c77 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:33.556800 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fcd70-6f8e-4269-b8ad-272c771a2524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:33.557575 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fcd70-6f8e-4269-b8ad-272c771a2524 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:33.557862 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fcd70-6f8e-4269-b8ad-272c771a2524 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:33.558141 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fcd70-6f8e-4269-b8ad-272c771a2524 admin admin] PATH_INFO: `/v3/users/b9f5a221ce5441729df14b52a271f9b0` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:33.559241 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fcd70-6f8e-4269-b8ad-272c771a2524 admin admin] RBAC: Authorizing `identity:get_user(user_id=b9f5a221ce5441729df14b52a271f9b0)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:33.585307 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fcd70-6f8e-4269-b8ad-272c771a2524 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:33.586757 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 554/1107] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:40:33 2021] GET /identity/v3/users/b9f5a221ce5441729df14b52a271f9b0 => generated 311 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:33.592170 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bcfe9-8ca2-4159-8bb0-419045bb0757 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:33.602098 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bcfe9-8ca2-4159-8bb0-419045bb0757 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:33.606132 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e1848-b8ab-477e-8888-a51d67ed6f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:33.606923 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e1848-b8ab-477e-8888-a51d67ed6f19 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:33.607205 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e1848-b8ab-477e-8888-a51d67ed6f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:33.607481 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e1848-b8ab-477e-8888-a51d67ed6f19 admin admin] PATH_INFO: `/v3/projects/51478d7b99934b4da1d0ead6c2df4867` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:33.608541 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e1848-b8ab-477e-8888-a51d67ed6f19 admin admin] RBAC: Authorizing `identity:get_project(project_id=51478d7b99934b4da1d0ead6c2df4867)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:33.634096 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e1848-b8ab-477e-8888-a51d67ed6f19 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:33.635624 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 554/1108] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:40:33 2021] GET /identity/v3/projects/51478d7b99934b4da1d0ead6c2df4867 => generated 361 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:33.642170 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fcd70-6f8e-4269-b8ad-272c771a2524 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:33.651308 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fcd70-6f8e-4269-b8ad-272c771a2524 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:33.655350 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50176eaf-a7b0-4e3e-bc84-4864bea310c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:33.656147 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50176eaf-a7b0-4e3e-bc84-4864bea310c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:33.656520 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50176eaf-a7b0-4e3e-bc84-4864bea310c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:33.657321 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50176eaf-a7b0-4e3e-bc84-4864bea310c6 admin admin] PATH_INFO: `/v3/projects/51478d7b99934b4da1d0ead6c2df4867/users/b9f5a221ce5441729df14b52a271f9b0/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:33.659099 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50176eaf-a7b0-4e3e-bc84-4864bea310c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51478d7b99934b4da1d0ead6c2df4867, user_id=b9f5a221ce5441729df14b52a271f9b0, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:33.685130 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50176eaf-a7b0-4e3e-bc84-4864bea310c6 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:33.697877 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 555/1109] 10.222.0.37 () {58 vars in 1460 bytes} [Wed Dec 29 20:40:33 2021] PUT /identity/v3/projects/51478d7b99934b4da1d0ead6c2df4867/users/b9f5a221ce5441729df14b52a271f9b0/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:40:35.718163 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648710e-a0fc-4dd5-b16a-39df1852a1ce None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:35.719038 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648710e-a0fc-4dd5-b16a-39df1852a1ce None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:35.719038 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648710e-a0fc-4dd5-b16a-39df1852a1ce None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:35.720430 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 555/1110] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:40:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:40:35.726414 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfece2a0-79ac-41f0-9a70-4de356db2dd0 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:35.726922 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfece2a0-79ac-41f0-9a70-4de356db2dd0 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:35.727039 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfece2a0-79ac-41f0-9a70-4de356db2dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:35.750087 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-dfece2a0-79ac-41f0-9a70-4de356db2dd0 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:40:35.751262 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-dfece2a0-79ac-41f0-9a70-4de356db2dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:40:35.815237 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 556/1111] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:40:35 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:40:35.838460 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648710e-a0fc-4dd5-b16a-39df1852a1ce None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:35.850697 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648710e-a0fc-4dd5-b16a-39df1852a1ce None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:35.854639 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed0b25-fb9a-40ea-b60d-c2d76dfb6c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:35.855431 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed0b25-fb9a-40ea-b60d-c2d76dfb6c38 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:35.855787 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed0b25-fb9a-40ea-b60d-c2d76dfb6c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:35.856135 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed0b25-fb9a-40ea-b60d-c2d76dfb6c38 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:35.868151 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed0b25-fb9a-40ea-b60d-c2d76dfb6c38 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:40:35.874334 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-20ed0b25-fb9a-40ea-b60d-c2d76dfb6c38 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:40:35.875486 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 556/1112] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:40:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:40:35.881573 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfece2a0-79ac-41f0-9a70-4de356db2dd0 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:35.890046 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfece2a0-79ac-41f0-9a70-4de356db2dd0 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:35.894598 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb24996-951a-493c-adbe-6a005b6a26eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:35.895206 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb24996-951a-493c-adbe-6a005b6a26eb admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:35.895490 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb24996-951a-493c-adbe-6a005b6a26eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:35.895767 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb24996-951a-493c-adbe-6a005b6a26eb admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:35.896468 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb24996-951a-493c-adbe-6a005b6a26eb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:40:35.896761 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb24996-951a-493c-adbe-6a005b6a26eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:35.922441 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb24996-951a-493c-adbe-6a005b6a26eb admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:35.930984 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 557/1113] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:40:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:35.936665 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed0b25-fb9a-40ea-b60d-c2d76dfb6c38 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:35.946159 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed0b25-fb9a-40ea-b60d-c2d76dfb6c38 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:35.950189 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2e3b5-4d91-4f87-a00f-d07965e2b51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:35.950995 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2e3b5-4d91-4f87-a00f-d07965e2b51f admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:35.951282 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2e3b5-4d91-4f87-a00f-d07965e2b51f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:35.951561 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2e3b5-4d91-4f87-a00f-d07965e2b51f admin admin] PATH_INFO: `/v3/users/b9f5a221ce5441729df14b52a271f9b0` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:35.952637 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2e3b5-4d91-4f87-a00f-d07965e2b51f admin admin] RBAC: Authorizing `identity:get_user(user_id=b9f5a221ce5441729df14b52a271f9b0)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:35.979723 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2e3b5-4d91-4f87-a00f-d07965e2b51f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:35.981118 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 557/1114] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:40:35 2021] GET /identity/v3/users/b9f5a221ce5441729df14b52a271f9b0 => generated 311 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:35.986936 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb24996-951a-493c-adbe-6a005b6a26eb admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:35.996153 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb24996-951a-493c-adbe-6a005b6a26eb admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:36.000378 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6319d0-2113-4d39-a4fa-0a17cd81b2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:36.000939 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6319d0-2113-4d39-a4fa-0a17cd81b2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:36.001226 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6319d0-2113-4d39-a4fa-0a17cd81b2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:36.001504 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6319d0-2113-4d39-a4fa-0a17cd81b2b3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:36.009134 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6319d0-2113-4d39-a4fa-0a17cd81b2b3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:36.035567 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6319d0-2113-4d39-a4fa-0a17cd81b2b3 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:36.044200 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 558/1115] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:40:35 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:40:36.050126 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2e3b5-4d91-4f87-a00f-d07965e2b51f admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:36.059302 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2e3b5-4d91-4f87-a00f-d07965e2b51f admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:36.063864 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51733cde-5b9b-4075-aad0-507696ce7715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:36.064626 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51733cde-5b9b-4075-aad0-507696ce7715 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:36.064907 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51733cde-5b9b-4075-aad0-507696ce7715 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:36.065186 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51733cde-5b9b-4075-aad0-507696ce7715 admin admin] PATH_INFO: `/v3/projects/51478d7b99934b4da1d0ead6c2df4867` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:36.066251 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51733cde-5b9b-4075-aad0-507696ce7715 admin admin] RBAC: Authorizing `identity:get_project(project_id=51478d7b99934b4da1d0ead6c2df4867)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:36.092548 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51733cde-5b9b-4075-aad0-507696ce7715 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:36.094144 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 558/1116] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:40:36 2021] GET /identity/v3/projects/51478d7b99934b4da1d0ead6c2df4867 => generated 361 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:40:36.099817 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6319d0-2113-4d39-a4fa-0a17cd81b2b3 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:40:36.108231 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6319d0-2113-4d39-a4fa-0a17cd81b2b3 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:40:36.112336 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286d73c-aa50-454c-bde4-6361108da7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:40:36.112897 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286d73c-aa50-454c-bde4-6361108da7af admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:40:36.113181 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286d73c-aa50-454c-bde4-6361108da7af admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:40:36.113459 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286d73c-aa50-454c-bde4-6361108da7af admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:40:36.114225 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286d73c-aa50-454c-bde4-6361108da7af admin admin] RBAC: Adding query filter params (role.id=e66e6a94ba014fd193b851ceb92695ae, scope.project.id=51478d7b99934b4da1d0ead6c2df4867, user.id=b9f5a221ce5441729df14b52a271f9b0) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:40:36.114524 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286d73c-aa50-454c-bde4-6361108da7af admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:40:36.140093 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286d73c-aa50-454c-bde4-6361108da7af admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:40:36.146366 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 559/1117] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:40:36 2021] GET /identity/v3/role_assignments?user.id=b9f5a221ce5441729df14b52a271f9b0&scope.project.id=51478d7b99934b4da1d0ead6c2df4867&role.id=e66e6a94ba014fd193b851ceb92695ae => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:03.007513 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d808365-3f9b-405a-8430-83cbe796743c None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:03.008079 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d808365-3f9b-405a-8430-83cbe796743c None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:03.008079 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d808365-3f9b-405a-8430-83cbe796743c None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:03.009719 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 559/1118] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:42:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:42:03.015640 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbad0a8-94c7-4f48-afdd-083bf8677540 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:03.016072 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbad0a8-94c7-4f48-afdd-083bf8677540 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:03.016211 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbad0a8-94c7-4f48-afdd-083bf8677540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:03.037905 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-6dbad0a8-94c7-4f48-afdd-083bf8677540 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:42:03.039305 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-6dbad0a8-94c7-4f48-afdd-083bf8677540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:42:03.047276 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 560/1119] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:42:03 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:42:03.071200 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d808365-3f9b-405a-8430-83cbe796743c None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:03.083341 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d808365-3f9b-405a-8430-83cbe796743c None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:03.087199 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd40cbb-8fc7-4adc-8305-30ac0e43e7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:03.087899 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd40cbb-8fc7-4adc-8305-30ac0e43e7ad admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:03.088182 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd40cbb-8fc7-4adc-8305-30ac0e43e7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:03.088456 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd40cbb-8fc7-4adc-8305-30ac0e43e7ad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:03.100235 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd40cbb-8fc7-4adc-8305-30ac0e43e7ad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:03.125793 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd40cbb-8fc7-4adc-8305-30ac0e43e7ad admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:03.142531 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-3cd40cbb-8fc7-4adc-8305-30ac0e43e7ad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:42:03.143587 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 560/1120] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:42:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:42:03.149316 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbad0a8-94c7-4f48-afdd-083bf8677540 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:03.157749 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbad0a8-94c7-4f48-afdd-083bf8677540 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:03.161839 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cf2d1-140b-4720-9b94-ed0f8d3be07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:03.162414 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cf2d1-140b-4720-9b94-ed0f8d3be07f admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:03.162731 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cf2d1-140b-4720-9b94-ed0f8d3be07f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:03.163013 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cf2d1-140b-4720-9b94-ed0f8d3be07f admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:03.163693 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cf2d1-140b-4720-9b94-ed0f8d3be07f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:03.163987 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cf2d1-140b-4720-9b94-ed0f8d3be07f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:03.189507 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cf2d1-140b-4720-9b94-ed0f8d3be07f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:03.203906 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 561/1121] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:42:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:03.209300 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd40cbb-8fc7-4adc-8305-30ac0e43e7ad admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:03.218427 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd40cbb-8fc7-4adc-8305-30ac0e43e7ad admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:03.222371 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13186aa-59af-4b46-adcd-b6f3f08838c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:03.222981 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13186aa-59af-4b46-adcd-b6f3f08838c9 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:03.223267 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13186aa-59af-4b46-adcd-b6f3f08838c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:03.223542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13186aa-59af-4b46-adcd-b6f3f08838c9 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:03.224186 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13186aa-59af-4b46-adcd-b6f3f08838c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:03.249798 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13186aa-59af-4b46-adcd-b6f3f08838c9 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:03.269338 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 561/1122] 10.222.0.37 () {60 vars in 1153 bytes} [Wed Dec 29 20:42:03 2021] POST /identity/v3/users => generated 251 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:42:05.224913 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505d760-71d9-4452-b1bd-a157e39fd556 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:05.225423 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505d760-71d9-4452-b1bd-a157e39fd556 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:05.225423 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505d760-71d9-4452-b1bd-a157e39fd556 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:05.227097 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 562/1123] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:42:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:42:05.232610 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69aee0-d29b-4c27-b1a9-3aa54c0adf36 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:05.233035 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69aee0-d29b-4c27-b1a9-3aa54c0adf36 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:05.233186 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69aee0-d29b-4c27-b1a9-3aa54c0adf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:05.255021 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-ae69aee0-d29b-4c27-b1a9-3aa54c0adf36 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:42:05.256141 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-ae69aee0-d29b-4c27-b1a9-3aa54c0adf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:42:05.262876 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 562/1124] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:42:05 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:42:05.285802 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505d760-71d9-4452-b1bd-a157e39fd556 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:05.297853 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505d760-71d9-4452-b1bd-a157e39fd556 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:05.301710 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ec1d1-26a3-4236-8eff-a81e04950210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:05.302414 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ec1d1-26a3-4236-8eff-a81e04950210 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:05.302739 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ec1d1-26a3-4236-8eff-a81e04950210 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:05.303026 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ec1d1-26a3-4236-8eff-a81e04950210 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:05.314043 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ec1d1-26a3-4236-8eff-a81e04950210 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:42:05.320527 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-4e6ec1d1-26a3-4236-8eff-a81e04950210 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 29 20:42:05.321587 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 563/1125] 10.222.0.37 () {56 vars in 1123 bytes} [Wed Dec 29 20:42:05 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:05.327538 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69aee0-d29b-4c27-b1a9-3aa54c0adf36 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:05.335890 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69aee0-d29b-4c27-b1a9-3aa54c0adf36 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:05.340506 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636276e-5160-46b3-a0a4-ad1f99a2d559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:05.341082 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636276e-5160-46b3-a0a4-ad1f99a2d559 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:05.341368 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636276e-5160-46b3-a0a4-ad1f99a2d559 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:05.341650 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636276e-5160-46b3-a0a4-ad1f99a2d559 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:05.342353 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8636276e-5160-46b3-a0a4-ad1f99a2d559 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:05.342754 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8636276e-5160-46b3-a0a4-ad1f99a2d559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:05.368530 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8636276e-5160-46b3-a0a4-ad1f99a2d559 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:05.376860 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 563/1126] 10.222.0.37 () {56 vars in 1124 bytes} [Wed Dec 29 20:42:05 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:42:05.382186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ec1d1-26a3-4236-8eff-a81e04950210 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:05.391853 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ec1d1-26a3-4236-8eff-a81e04950210 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:05.395948 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4300ced-ce45-438a-9429-9ffe8fdd14be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:05.396635 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4300ced-ce45-438a-9429-9ffe8fdd14be admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:05.396922 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4300ced-ce45-438a-9429-9ffe8fdd14be admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:05.397203 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4300ced-ce45-438a-9429-9ffe8fdd14be admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:05.408652 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4300ced-ce45-438a-9429-9ffe8fdd14be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:05.434554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4300ced-ce45-438a-9429-9ffe8fdd14be admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:05.451649 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-d4300ced-ce45-438a-9429-9ffe8fdd14be admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:42:05.452682 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 564/1127] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:42:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:05.457970 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636276e-5160-46b3-a0a4-ad1f99a2d559 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:05.467601 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636276e-5160-46b3-a0a4-ad1f99a2d559 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:05.471612 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59c83d-d51e-4fca-830b-7ab7823817fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:05.472186 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59c83d-d51e-4fca-830b-7ab7823817fd admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:05.472481 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59c83d-d51e-4fca-830b-7ab7823817fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:05.472762 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59c83d-d51e-4fca-830b-7ab7823817fd admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:05.473442 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59c83d-d51e-4fca-830b-7ab7823817fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:05.473740 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59c83d-d51e-4fca-830b-7ab7823817fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:05.499407 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59c83d-d51e-4fca-830b-7ab7823817fd admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:05.513252 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 564/1128] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:42:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:42:05.518682 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4300ced-ce45-438a-9429-9ffe8fdd14be admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:05.528213 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4300ced-ce45-438a-9429-9ffe8fdd14be admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:05.532249 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d336689-9e0d-47f4-951c-2f6299b9946a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:05.532947 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d336689-9e0d-47f4-951c-2f6299b9946a admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:05.533232 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d336689-9e0d-47f4-951c-2f6299b9946a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:05.533508 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d336689-9e0d-47f4-951c-2f6299b9946a admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:05.546372 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d336689-9e0d-47f4-951c-2f6299b9946a admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:05.572104 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d336689-9e0d-47f4-951c-2f6299b9946a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:05.589134 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-0d336689-9e0d-47f4-951c-2f6299b9946a admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 29 20:42:05.590714 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 565/1129] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:42:05 2021] GET /identity/v3/users/placement => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:05.596075 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59c83d-d51e-4fca-830b-7ab7823817fd admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:05.605682 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59c83d-d51e-4fca-830b-7ab7823817fd admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:05.609739 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5340a-84e9-4c28-bf6f-fbd25756a9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:05.610315 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5340a-84e9-4c28-bf6f-fbd25756a9cf admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:05.610602 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5340a-84e9-4c28-bf6f-fbd25756a9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:05.610910 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5340a-84e9-4c28-bf6f-fbd25756a9cf admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:05.611693 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5340a-84e9-4c28-bf6f-fbd25756a9cf admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:05.611993 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5340a-84e9-4c28-bf6f-fbd25756a9cf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:05.637679 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5340a-84e9-4c28-bf6f-fbd25756a9cf admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:05.665633 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 565/1130] 10.222.0.37 () {56 vars in 1164 bytes} [Wed Dec 29 20:42:05 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:42:05.671121 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d336689-9e0d-47f4-951c-2f6299b9946a admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:05.680117 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d336689-9e0d-47f4-951c-2f6299b9946a admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:05.684329 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e997f8-f4b0-4d36-b29e-2d2a418e14c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:05.684883 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e997f8-f4b0-4d36-b29e-2d2a418e14c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:05.685168 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e997f8-f4b0-4d36-b29e-2d2a418e14c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:05.685443 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e997f8-f4b0-4d36-b29e-2d2a418e14c0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:05.693059 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e997f8-f4b0-4d36-b29e-2d2a418e14c0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:05.719385 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e997f8-f4b0-4d36-b29e-2d2a418e14c0 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:05.728399 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 566/1131] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:42:05 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:42:05.734048 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5340a-84e9-4c28-bf6f-fbd25756a9cf admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:05.744322 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5340a-84e9-4c28-bf6f-fbd25756a9cf admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:05.748741 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab0606-70f8-49d3-90c5-511543944ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:05.749536 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab0606-70f8-49d3-90c5-511543944ffb admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:05.749737 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab0606-70f8-49d3-90c5-511543944ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:05.750048 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab0606-70f8-49d3-90c5-511543944ffb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:05.762586 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab0606-70f8-49d3-90c5-511543944ffb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:05.788757 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab0606-70f8-49d3-90c5-511543944ffb admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:05.806178 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-7eab0606-70f8-49d3-90c5-511543944ffb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:42:05.807324 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 566/1132] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:42:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:42:05.813181 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e997f8-f4b0-4d36-b29e-2d2a418e14c0 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:05.823545 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e997f8-f4b0-4d36-b29e-2d2a418e14c0 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:05.828745 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc37fd-6fd2-4b1b-b02d-1b2ed77cd04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:05.829326 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc37fd-6fd2-4b1b-b02d-1b2ed77cd04e admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:05.829616 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc37fd-6fd2-4b1b-b02d-1b2ed77cd04e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:05.829978 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc37fd-6fd2-4b1b-b02d-1b2ed77cd04e admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:05.830965 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfc37fd-6fd2-4b1b-b02d-1b2ed77cd04e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:05.831417 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfc37fd-6fd2-4b1b-b02d-1b2ed77cd04e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:05.863343 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfc37fd-6fd2-4b1b-b02d-1b2ed77cd04e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:05.876332 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 567/1133] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:42:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:05.881902 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab0606-70f8-49d3-90c5-511543944ffb admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:05.891555 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab0606-70f8-49d3-90c5-511543944ffb admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:05.895592 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d761fef-fc87-4ea0-b858-cb4bb96482c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:05.896296 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d761fef-fc87-4ea0-b858-cb4bb96482c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:05.896583 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d761fef-fc87-4ea0-b858-cb4bb96482c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:05.896861 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d761fef-fc87-4ea0-b858-cb4bb96482c4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:05.906240 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d761fef-fc87-4ea0-b858-cb4bb96482c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:05.931519 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d761fef-fc87-4ea0-b858-cb4bb96482c4 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:05.944901 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-8d761fef-fc87-4ea0-b858-cb4bb96482c4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:42:05.945943 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 567/1134] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:42:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:05.951933 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc37fd-6fd2-4b1b-b02d-1b2ed77cd04e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:05.960930 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc37fd-6fd2-4b1b-b02d-1b2ed77cd04e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:05.965700 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec8d2b-8019-42e1-a371-e71251d87e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:05.966267 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec8d2b-8019-42e1-a371-e71251d87e9a admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:05.966553 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec8d2b-8019-42e1-a371-e71251d87e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:05.966861 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec8d2b-8019-42e1-a371-e71251d87e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:05.967587 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec8d2b-8019-42e1-a371-e71251d87e9a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:05.967885 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec8d2b-8019-42e1-a371-e71251d87e9a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:05.992958 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec8d2b-8019-42e1-a371-e71251d87e9a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:06.006205 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 568/1135] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:42:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:06.011985 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d761fef-fc87-4ea0-b858-cb4bb96482c4 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:06.020992 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d761fef-fc87-4ea0-b858-cb4bb96482c4 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:06.024974 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc65ad-5bd3-4faa-aaed-3eac3b3567d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:06.025541 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc65ad-5bd3-4faa-aaed-3eac3b3567d2 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:06.025827 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc65ad-5bd3-4faa-aaed-3eac3b3567d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:06.026107 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc65ad-5bd3-4faa-aaed-3eac3b3567d2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:06.027511 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc65ad-5bd3-4faa-aaed-3eac3b3567d2 admin admin] RBAC: Adding query filter params (role.id=1c5a8286caa54ded9e44ef97f73f6776, scope.project.id=ed634cf9bb9146f7a9738325a8638b70, user.id=25cb71bb64a3456fb2dc02095c487d4b) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:06.027966 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc65ad-5bd3-4faa-aaed-3eac3b3567d2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:06.053921 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc65ad-5bd3-4faa-aaed-3eac3b3567d2 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:06.059263 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 568/1136] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:42:06 2021] GET /identity/v3/role_assignments?user.id=25cb71bb64a3456fb2dc02095c487d4b&scope.project.id=ed634cf9bb9146f7a9738325a8638b70&role.id=1c5a8286caa54ded9e44ef97f73f6776 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:07.990412 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f545f-01fb-4eff-9795-9b07d5fa3eb0 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:07.990960 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f545f-01fb-4eff-9795-9b07d5fa3eb0 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:07.991071 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f545f-01fb-4eff-9795-9b07d5fa3eb0 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:07.992671 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 569/1137] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:42:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:42:07.997811 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1480e-4b92-4903-87c2-ff98ea38cf1c None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:07.998223 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1480e-4b92-4903-87c2-ff98ea38cf1c None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:07.998376 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1480e-4b92-4903-87c2-ff98ea38cf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:08.020865 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-89e1480e-4b92-4903-87c2-ff98ea38cf1c None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:42:08.021988 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-89e1480e-4b92-4903-87c2-ff98ea38cf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:42:08.029284 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 569/1138] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:42:07 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:42:08.050610 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f545f-01fb-4eff-9795-9b07d5fa3eb0 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:08.062099 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f545f-01fb-4eff-9795-9b07d5fa3eb0 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:08.066249 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce51f50-5247-4336-bbd2-a2d76342aebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:08.066974 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce51f50-5247-4336-bbd2-a2d76342aebb admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:08.067263 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce51f50-5247-4336-bbd2-a2d76342aebb admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:08.067550 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce51f50-5247-4336-bbd2-a2d76342aebb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:08.078824 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce51f50-5247-4336-bbd2-a2d76342aebb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:42:08.085039 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-5ce51f50-5247-4336-bbd2-a2d76342aebb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 29 20:42:08.086089 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 570/1139] 10.222.0.37 () {56 vars in 1123 bytes} [Wed Dec 29 20:42:08 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:08.092484 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1480e-4b92-4903-87c2-ff98ea38cf1c None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:08.101069 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1480e-4b92-4903-87c2-ff98ea38cf1c None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:08.105430 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d9516-7044-43d5-927d-29bda054d2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:08.106088 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d9516-7044-43d5-927d-29bda054d2af admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:08.106381 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d9516-7044-43d5-927d-29bda054d2af admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:08.106676 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d9516-7044-43d5-927d-29bda054d2af admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:08.107399 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d9516-7044-43d5-927d-29bda054d2af admin admin] RBAC: Adding query filter params (name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:08.107700 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d9516-7044-43d5-927d-29bda054d2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:08.132955 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d9516-7044-43d5-927d-29bda054d2af admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:08.142009 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 570/1140] 10.222.0.37 () {56 vars in 1124 bytes} [Wed Dec 29 20:42:08 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:08.147515 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce51f50-5247-4336-bbd2-a2d76342aebb admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:08.157685 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce51f50-5247-4336-bbd2-a2d76342aebb admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:08.161724 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825f67e-7da7-479b-802b-d1f827be7f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:08.162412 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825f67e-7da7-479b-802b-d1f827be7f75 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:08.162783 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825f67e-7da7-479b-802b-d1f827be7f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:08.163069 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825f67e-7da7-479b-802b-d1f827be7f75 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:08.173902 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4825f67e-7da7-479b-802b-d1f827be7f75 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:08.200937 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4825f67e-7da7-479b-802b-d1f827be7f75 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:08.218516 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-4825f67e-7da7-479b-802b-d1f827be7f75 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:42:08.219594 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 571/1141] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:42:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:08.225125 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d9516-7044-43d5-927d-29bda054d2af admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:08.234578 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d9516-7044-43d5-927d-29bda054d2af admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:08.238647 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb15ccc-30a7-46e6-a3b7-2daa2f426b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:08.239252 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb15ccc-30a7-46e6-a3b7-2daa2f426b4e admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:08.239543 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb15ccc-30a7-46e6-a3b7-2daa2f426b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:08.239826 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb15ccc-30a7-46e6-a3b7-2daa2f426b4e admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:08.240506 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb15ccc-30a7-46e6-a3b7-2daa2f426b4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:08.240804 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb15ccc-30a7-46e6-a3b7-2daa2f426b4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:08.267493 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb15ccc-30a7-46e6-a3b7-2daa2f426b4e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:08.280134 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 571/1142] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:42:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:08.285416 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825f67e-7da7-479b-802b-d1f827be7f75 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:08.294799 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825f67e-7da7-479b-802b-d1f827be7f75 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:08.298877 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b60b5-23da-496f-91f8-c853f495822d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:08.299579 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b60b5-23da-496f-91f8-c853f495822d admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:08.299868 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b60b5-23da-496f-91f8-c853f495822d admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:08.300149 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b60b5-23da-496f-91f8-c853f495822d admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:08.313072 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b60b5-23da-496f-91f8-c853f495822d admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:08.338901 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b60b5-23da-496f-91f8-c853f495822d admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:08.357245 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-8d3b60b5-23da-496f-91f8-c853f495822d admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 29 20:42:08.358283 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 572/1143] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:42:08 2021] GET /identity/v3/users/placement => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:08.363769 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb15ccc-30a7-46e6-a3b7-2daa2f426b4e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:08.372953 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb15ccc-30a7-46e6-a3b7-2daa2f426b4e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:08.376952 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a36976-3115-4f72-b554-529f33308e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:08.377532 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a36976-3115-4f72-b554-529f33308e85 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:08.377817 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a36976-3115-4f72-b554-529f33308e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:08.378095 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a36976-3115-4f72-b554-529f33308e85 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:08.378911 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a36976-3115-4f72-b554-529f33308e85 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:08.379210 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a36976-3115-4f72-b554-529f33308e85 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:08.405042 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a36976-3115-4f72-b554-529f33308e85 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:08.433272 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 572/1144] 10.222.0.37 () {56 vars in 1164 bytes} [Wed Dec 29 20:42:08 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:08.438888 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b60b5-23da-496f-91f8-c853f495822d admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:08.448185 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b60b5-23da-496f-91f8-c853f495822d admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:08.452359 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba413157-f916-4cb3-9bdd-16807889ed52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:08.453051 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba413157-f916-4cb3-9bdd-16807889ed52 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:08.453335 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba413157-f916-4cb3-9bdd-16807889ed52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:08.453609 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba413157-f916-4cb3-9bdd-16807889ed52 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:08.465880 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba413157-f916-4cb3-9bdd-16807889ed52 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:08.491656 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba413157-f916-4cb3-9bdd-16807889ed52 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:08.507827 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-ba413157-f916-4cb3-9bdd-16807889ed52 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:42:08.508860 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 573/1145] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:42:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:08.514453 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a36976-3115-4f72-b554-529f33308e85 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:08.523430 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a36976-3115-4f72-b554-529f33308e85 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:08.527935 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384b029-b9c0-4af5-9c9c-fcaec2877415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:08.528499 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384b029-b9c0-4af5-9c9c-fcaec2877415 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:08.528782 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384b029-b9c0-4af5-9c9c-fcaec2877415 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:08.529056 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384b029-b9c0-4af5-9c9c-fcaec2877415 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:08.529726 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384b029-b9c0-4af5-9c9c-fcaec2877415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:08.530022 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384b029-b9c0-4af5-9c9c-fcaec2877415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:08.555537 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384b029-b9c0-4af5-9c9c-fcaec2877415 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:08.568039 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 573/1146] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:42:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:08.573291 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba413157-f916-4cb3-9bdd-16807889ed52 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:08.582325 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba413157-f916-4cb3-9bdd-16807889ed52 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:08.586363 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38222ca-391f-4f50-bc0f-41c5431bd6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:08.587078 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38222ca-391f-4f50-bc0f-41c5431bd6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:08.587367 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38222ca-391f-4f50-bc0f-41c5431bd6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:08.587648 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38222ca-391f-4f50-bc0f-41c5431bd6a3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:08.596781 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38222ca-391f-4f50-bc0f-41c5431bd6a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:08.622348 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38222ca-391f-4f50-bc0f-41c5431bd6a3 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:08.635268 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-a38222ca-391f-4f50-bc0f-41c5431bd6a3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:42:08.636816 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 574/1147] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:42:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:08.642299 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384b029-b9c0-4af5-9c9c-fcaec2877415 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:08.651220 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384b029-b9c0-4af5-9c9c-fcaec2877415 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:08.655352 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3f864-c3d7-4d95-baec-9fc734fe612e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:08.655868 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3f864-c3d7-4d95-baec-9fc734fe612e admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:08.656153 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3f864-c3d7-4d95-baec-9fc734fe612e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:08.656432 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3f864-c3d7-4d95-baec-9fc734fe612e admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:08.657168 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3f864-c3d7-4d95-baec-9fc734fe612e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:08.657465 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3f864-c3d7-4d95-baec-9fc734fe612e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:08.684375 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3f864-c3d7-4d95-baec-9fc734fe612e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:08.697338 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 574/1148] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:42:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:42:08.703332 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38222ca-391f-4f50-bc0f-41c5431bd6a3 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:08.712588 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38222ca-391f-4f50-bc0f-41c5431bd6a3 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:08.716682 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c05482-fae7-4e2a-8b3f-7117578ad632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:08.717478 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c05482-fae7-4e2a-8b3f-7117578ad632 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:08.717765 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c05482-fae7-4e2a-8b3f-7117578ad632 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:08.718055 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c05482-fae7-4e2a-8b3f-7117578ad632 admin admin] PATH_INFO: `/v3/projects/ed634cf9bb9146f7a9738325a8638b70/users/25cb71bb64a3456fb2dc02095c487d4b/roles/1c5a8286caa54ded9e44ef97f73f6776` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:08.741229 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c05482-fae7-4e2a-8b3f-7117578ad632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed634cf9bb9146f7a9738325a8638b70, user_id=25cb71bb64a3456fb2dc02095c487d4b, role_id=1c5a8286caa54ded9e44ef97f73f6776)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:08.774662 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c05482-fae7-4e2a-8b3f-7117578ad632 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:08.791095 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 575/1149] 10.222.0.37 () {58 vars in 1460 bytes} [Wed Dec 29 20:42:08 2021] PUT /identity/v3/projects/ed634cf9bb9146f7a9738325a8638b70/users/25cb71bb64a3456fb2dc02095c487d4b/roles/1c5a8286caa54ded9e44ef97f73f6776 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:42:10.744214 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc1a25-c1bd-41f5-af97-d5381610decb None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:10.744769 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc1a25-c1bd-41f5-af97-d5381610decb None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:10.744769 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc1a25-c1bd-41f5-af97-d5381610decb None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:10.747018 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 575/1150] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:42:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:42:10.752168 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5f691-6090-4674-ac08-004f3f4422b3 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:10.752561 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5f691-6090-4674-ac08-004f3f4422b3 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:10.752723 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5f691-6090-4674-ac08-004f3f4422b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:10.774790 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-a9f5f691-6090-4674-ac08-004f3f4422b3 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:42:10.775903 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-a9f5f691-6090-4674-ac08-004f3f4422b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:42:10.842778 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 576/1151] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:42:10 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:42:10.865116 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc1a25-c1bd-41f5-af97-d5381610decb None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:10.877131 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc1a25-c1bd-41f5-af97-d5381610decb None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:10.880993 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a79426-89d4-45fd-8d08-a49576ccd046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:10.881688 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a79426-89d4-45fd-8d08-a49576ccd046 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:10.881971 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a79426-89d4-45fd-8d08-a49576ccd046 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:10.882244 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a79426-89d4-45fd-8d08-a49576ccd046 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:10.893063 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a79426-89d4-45fd-8d08-a49576ccd046 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:42:10.899294 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-d0a79426-89d4-45fd-8d08-a49576ccd046 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 29 20:42:10.900346 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 576/1152] 10.222.0.37 () {56 vars in 1123 bytes} [Wed Dec 29 20:42:10 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:10.906277 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5f691-6090-4674-ac08-004f3f4422b3 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:10.914797 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5f691-6090-4674-ac08-004f3f4422b3 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:10.919788 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95928999-0564-49ae-9caf-66ac32861475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:10.920378 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95928999-0564-49ae-9caf-66ac32861475 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:10.920670 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95928999-0564-49ae-9caf-66ac32861475 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:10.920953 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95928999-0564-49ae-9caf-66ac32861475 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:10.921661 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95928999-0564-49ae-9caf-66ac32861475 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:10.921959 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95928999-0564-49ae-9caf-66ac32861475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:10.948491 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95928999-0564-49ae-9caf-66ac32861475 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:10.957229 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 577/1153] 10.222.0.37 () {56 vars in 1124 bytes} [Wed Dec 29 20:42:10 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:10.962552 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a79426-89d4-45fd-8d08-a49576ccd046 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:10.972147 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a79426-89d4-45fd-8d08-a49576ccd046 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:10.976242 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18345a-f5ad-4d5f-8957-79bdd2e88b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:10.976925 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18345a-f5ad-4d5f-8957-79bdd2e88b12 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:10.977210 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18345a-f5ad-4d5f-8957-79bdd2e88b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:10.977488 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18345a-f5ad-4d5f-8957-79bdd2e88b12 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:10.988787 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18345a-f5ad-4d5f-8957-79bdd2e88b12 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:11.014675 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18345a-f5ad-4d5f-8957-79bdd2e88b12 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:11.032714 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-cf18345a-f5ad-4d5f-8957-79bdd2e88b12 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:42:11.033743 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 577/1154] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:42:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:11.039268 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95928999-0564-49ae-9caf-66ac32861475 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:11.049356 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95928999-0564-49ae-9caf-66ac32861475 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:11.053510 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afcff50-eba0-46ec-a089-a5c7b3fc0ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:11.054087 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcff50-eba0-46ec-a089-a5c7b3fc0ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:11.054377 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcff50-eba0-46ec-a089-a5c7b3fc0ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:11.054684 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcff50-eba0-46ec-a089-a5c7b3fc0ad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:11.055369 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afcff50-eba0-46ec-a089-a5c7b3fc0ad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:11.055670 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afcff50-eba0-46ec-a089-a5c7b3fc0ad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:11.082575 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afcff50-eba0-46ec-a089-a5c7b3fc0ad5 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:11.096189 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 578/1155] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:42:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:11.101341 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18345a-f5ad-4d5f-8957-79bdd2e88b12 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:11.110925 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18345a-f5ad-4d5f-8957-79bdd2e88b12 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:11.114994 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d3201-78a1-4e45-85fe-1cec765eac8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:11.115700 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d3201-78a1-4e45-85fe-1cec765eac8d admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:11.116161 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d3201-78a1-4e45-85fe-1cec765eac8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:11.116447 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d3201-78a1-4e45-85fe-1cec765eac8d admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:11.128624 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d3201-78a1-4e45-85fe-1cec765eac8d admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:11.155308 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d3201-78a1-4e45-85fe-1cec765eac8d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:11.172945 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-0b1d3201-78a1-4e45-85fe-1cec765eac8d admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 29 20:42:11.174002 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 578/1156] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:42:11 2021] GET /identity/v3/users/placement => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:11.179767 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afcff50-eba0-46ec-a089-a5c7b3fc0ad5 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:11.189408 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afcff50-eba0-46ec-a089-a5c7b3fc0ad5 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:11.193791 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d213d-c319-41d1-b29d-375aa58d4ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:11.194376 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d213d-c319-41d1-b29d-375aa58d4ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:11.194689 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d213d-c319-41d1-b29d-375aa58d4ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:11.194974 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d213d-c319-41d1-b29d-375aa58d4ad7 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:11.195754 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d213d-c319-41d1-b29d-375aa58d4ad7 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:11.196054 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d213d-c319-41d1-b29d-375aa58d4ad7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:11.223181 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d213d-c319-41d1-b29d-375aa58d4ad7 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:11.252548 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 579/1157] 10.222.0.37 () {56 vars in 1164 bytes} [Wed Dec 29 20:42:11 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:11.258018 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d3201-78a1-4e45-85fe-1cec765eac8d admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:11.267941 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d3201-78a1-4e45-85fe-1cec765eac8d admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:11.271915 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebf13d-0159-4657-86ab-edd31e75d146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:11.272496 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebf13d-0159-4657-86ab-edd31e75d146 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:11.272829 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebf13d-0159-4657-86ab-edd31e75d146 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:11.273108 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebf13d-0159-4657-86ab-edd31e75d146 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:11.280607 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebf13d-0159-4657-86ab-edd31e75d146 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:11.305564 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebf13d-0159-4657-86ab-edd31e75d146 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:11.315315 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 579/1158] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:42:11 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:42:11.321069 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d213d-c319-41d1-b29d-375aa58d4ad7 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:11.330881 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d213d-c319-41d1-b29d-375aa58d4ad7 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:11.334952 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eceb9c0-0ecf-4418-b72e-aa5ea414ec07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:11.335650 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eceb9c0-0ecf-4418-b72e-aa5ea414ec07 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:11.335937 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eceb9c0-0ecf-4418-b72e-aa5ea414ec07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:11.336217 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eceb9c0-0ecf-4418-b72e-aa5ea414ec07 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:11.347645 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eceb9c0-0ecf-4418-b72e-aa5ea414ec07 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:11.373600 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eceb9c0-0ecf-4418-b72e-aa5ea414ec07 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:11.390295 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-5eceb9c0-0ecf-4418-b72e-aa5ea414ec07 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:42:11.391356 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 580/1159] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:42:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:11.396682 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebf13d-0159-4657-86ab-edd31e75d146 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:11.405117 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebf13d-0159-4657-86ab-edd31e75d146 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:11.409145 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319d2b5-6aac-4371-8d18-c044d0325b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:11.409710 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319d2b5-6aac-4371-8d18-c044d0325b61 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:11.409994 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319d2b5-6aac-4371-8d18-c044d0325b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:11.410269 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319d2b5-6aac-4371-8d18-c044d0325b61 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:11.410968 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319d2b5-6aac-4371-8d18-c044d0325b61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:11.411260 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319d2b5-6aac-4371-8d18-c044d0325b61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:11.436880 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319d2b5-6aac-4371-8d18-c044d0325b61 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:11.449983 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 580/1160] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:42:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:11.455290 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eceb9c0-0ecf-4418-b72e-aa5ea414ec07 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:11.464472 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eceb9c0-0ecf-4418-b72e-aa5ea414ec07 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:11.468636 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fdda1d-0edf-4e84-8587-810b4c7857fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:11.469328 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdda1d-0edf-4e84-8587-810b4c7857fb admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:11.469611 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdda1d-0edf-4e84-8587-810b4c7857fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:11.469886 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdda1d-0edf-4e84-8587-810b4c7857fb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:11.478460 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fdda1d-0edf-4e84-8587-810b4c7857fb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:11.504264 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fdda1d-0edf-4e84-8587-810b4c7857fb admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:11.517884 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-a7fdda1d-0edf-4e84-8587-810b4c7857fb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:42:11.519068 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 581/1161] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:42:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:11.524714 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319d2b5-6aac-4371-8d18-c044d0325b61 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:11.533776 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319d2b5-6aac-4371-8d18-c044d0325b61 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:11.537851 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616356f-bf69-44a4-a26c-d18dd6e3b3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:11.538423 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616356f-bf69-44a4-a26c-d18dd6e3b3f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:11.538740 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616356f-bf69-44a4-a26c-d18dd6e3b3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:11.539029 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616356f-bf69-44a4-a26c-d18dd6e3b3f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:11.539767 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616356f-bf69-44a4-a26c-d18dd6e3b3f1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:11.540068 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616356f-bf69-44a4-a26c-d18dd6e3b3f1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:11.566353 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616356f-bf69-44a4-a26c-d18dd6e3b3f1 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:11.579778 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 581/1162] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:42:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:42:11.585267 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fdda1d-0edf-4e84-8587-810b4c7857fb admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:11.594351 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fdda1d-0edf-4e84-8587-810b4c7857fb admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:11.598324 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86966fdb-50c3-4cb9-b0d3-3cb25e9f39e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:11.598916 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86966fdb-50c3-4cb9-b0d3-3cb25e9f39e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:11.599200 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86966fdb-50c3-4cb9-b0d3-3cb25e9f39e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:11.599476 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86966fdb-50c3-4cb9-b0d3-3cb25e9f39e5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:11.600246 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86966fdb-50c3-4cb9-b0d3-3cb25e9f39e5 admin admin] RBAC: Adding query filter params (role.id=1c5a8286caa54ded9e44ef97f73f6776, scope.project.id=ed634cf9bb9146f7a9738325a8638b70, user.id=25cb71bb64a3456fb2dc02095c487d4b) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:11.600546 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86966fdb-50c3-4cb9-b0d3-3cb25e9f39e5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:11.626826 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86966fdb-50c3-4cb9-b0d3-3cb25e9f39e5 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:11.632304 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 582/1163] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:42:11 2021] GET /identity/v3/role_assignments?user.id=25cb71bb64a3456fb2dc02095c487d4b&scope.project.id=ed634cf9bb9146f7a9738325a8638b70&role.id=1c5a8286caa54ded9e44ef97f73f6776 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:13.640206 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777609c-3841-48bc-8ec6-9de8f77f27cf None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:13.640789 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777609c-3841-48bc-8ec6-9de8f77f27cf None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:13.640789 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777609c-3841-48bc-8ec6-9de8f77f27cf None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:13.642409 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 582/1164] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:42:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:42:13.647583 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f100ab-d3f5-4ee4-9ddd-6da8b4bcfafa None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:13.648029 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f100ab-d3f5-4ee4-9ddd-6da8b4bcfafa None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:13.648171 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f100ab-d3f5-4ee4-9ddd-6da8b4bcfafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:13.670266 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-88f100ab-d3f5-4ee4-9ddd-6da8b4bcfafa None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:42:13.671421 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-88f100ab-d3f5-4ee4-9ddd-6da8b4bcfafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:42:13.678140 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 583/1165] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:42:13 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:42:13.701878 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777609c-3841-48bc-8ec6-9de8f77f27cf None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:13.713213 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777609c-3841-48bc-8ec6-9de8f77f27cf None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:13.717104 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ccd9f-1270-4149-9d98-e5c94a4d00c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:13.717793 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ccd9f-1270-4149-9d98-e5c94a4d00c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:13.718077 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ccd9f-1270-4149-9d98-e5c94a4d00c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:13.718351 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ccd9f-1270-4149-9d98-e5c94a4d00c0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:13.728926 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ccd9f-1270-4149-9d98-e5c94a4d00c0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:42:13.735384 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-844ccd9f-1270-4149-9d98-e5c94a4d00c0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:42:13.736474 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 583/1166] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:42:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:13.742144 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f100ab-d3f5-4ee4-9ddd-6da8b4bcfafa None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:13.751300 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f100ab-d3f5-4ee4-9ddd-6da8b4bcfafa None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:13.755419 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6cb64-5f29-4fcd-909f-9d0eea1f8220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:13.755998 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6cb64-5f29-4fcd-909f-9d0eea1f8220 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:13.756285 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6cb64-5f29-4fcd-909f-9d0eea1f8220 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:13.756566 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6cb64-5f29-4fcd-909f-9d0eea1f8220 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:13.757268 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6cb64-5f29-4fcd-909f-9d0eea1f8220 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:13.757594 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6cb64-5f29-4fcd-909f-9d0eea1f8220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:13.783262 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6cb64-5f29-4fcd-909f-9d0eea1f8220 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:13.791562 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 584/1167] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:42:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:13.797430 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ccd9f-1270-4149-9d98-e5c94a4d00c0 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:13.806842 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ccd9f-1270-4149-9d98-e5c94a4d00c0 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:13.810987 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8c5c0-76f3-4119-927f-daf5c97a6439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:13.811676 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8c5c0-76f3-4119-927f-daf5c97a6439 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:13.811959 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8c5c0-76f3-4119-927f-daf5c97a6439 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:13.812234 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8c5c0-76f3-4119-927f-daf5c97a6439 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:13.823290 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8c5c0-76f3-4119-927f-daf5c97a6439 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:13.849084 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8c5c0-76f3-4119-927f-daf5c97a6439 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:13.867140 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-74e8c5c0-76f3-4119-927f-daf5c97a6439 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:42:13.868220 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 584/1168] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:42:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:13.874174 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6cb64-5f29-4fcd-909f-9d0eea1f8220 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:13.883529 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6cb64-5f29-4fcd-909f-9d0eea1f8220 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:13.888684 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafe8e1-1e9f-4623-8fb8-08ce3fe87847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:13.889264 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafe8e1-1e9f-4623-8fb8-08ce3fe87847 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:13.889554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafe8e1-1e9f-4623-8fb8-08ce3fe87847 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:13.889837 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafe8e1-1e9f-4623-8fb8-08ce3fe87847 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:13.890567 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafe8e1-1e9f-4623-8fb8-08ce3fe87847 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:13.890849 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafe8e1-1e9f-4623-8fb8-08ce3fe87847 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:13.916935 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafe8e1-1e9f-4623-8fb8-08ce3fe87847 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:13.929731 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 585/1169] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:42:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:13.935142 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8c5c0-76f3-4119-927f-daf5c97a6439 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:13.944448 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8c5c0-76f3-4119-927f-daf5c97a6439 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:13.949003 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b46d4-c526-4a11-8af8-84783829404b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:13.949708 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b46d4-c526-4a11-8af8-84783829404b admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:13.949995 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b46d4-c526-4a11-8af8-84783829404b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:13.950273 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b46d4-c526-4a11-8af8-84783829404b admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:13.962387 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b46d4-c526-4a11-8af8-84783829404b admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:13.988981 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b46d4-c526-4a11-8af8-84783829404b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:14.006347 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-067b46d4-c526-4a11-8af8-84783829404b admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 29 20:42:14.007422 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 585/1170] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:42:13 2021] GET /identity/v3/users/placement => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:14.013455 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafe8e1-1e9f-4623-8fb8-08ce3fe87847 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:14.022548 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafe8e1-1e9f-4623-8fb8-08ce3fe87847 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:14.027174 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f8b3d-55d7-44f0-a601-3049a8264899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:14.027759 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f8b3d-55d7-44f0-a601-3049a8264899 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:14.028042 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f8b3d-55d7-44f0-a601-3049a8264899 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:14.028318 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f8b3d-55d7-44f0-a601-3049a8264899 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:14.029093 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f8b3d-55d7-44f0-a601-3049a8264899 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:14.029391 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f8b3d-55d7-44f0-a601-3049a8264899 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:14.054530 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f8b3d-55d7-44f0-a601-3049a8264899 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:14.084822 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 586/1171] 10.222.0.37 () {56 vars in 1164 bytes} [Wed Dec 29 20:42:14 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:14.090918 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b46d4-c526-4a11-8af8-84783829404b admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:14.100243 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b46d4-c526-4a11-8af8-84783829404b admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:14.104226 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c260699-1140-4043-9cd1-717b5c3bc623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:14.104814 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c260699-1140-4043-9cd1-717b5c3bc623 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:14.105092 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c260699-1140-4043-9cd1-717b5c3bc623 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:14.105367 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c260699-1140-4043-9cd1-717b5c3bc623 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:14.112661 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c260699-1140-4043-9cd1-717b5c3bc623 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:14.138230 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c260699-1140-4043-9cd1-717b5c3bc623 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:14.147255 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 586/1172] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:42:14 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:42:14.153163 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f8b3d-55d7-44f0-a601-3049a8264899 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:14.162116 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f8b3d-55d7-44f0-a601-3049a8264899 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:14.166132 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f97afa-d15c-48ec-8bbf-ebb273492343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:14.166853 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f97afa-d15c-48ec-8bbf-ebb273492343 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:14.167146 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f97afa-d15c-48ec-8bbf-ebb273492343 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:14.167425 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f97afa-d15c-48ec-8bbf-ebb273492343 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:14.178723 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f97afa-d15c-48ec-8bbf-ebb273492343 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:14.204744 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f97afa-d15c-48ec-8bbf-ebb273492343 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:14.221450 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-f9f97afa-d15c-48ec-8bbf-ebb273492343 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:42:14.222484 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 587/1173] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:42:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:14.227927 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c260699-1140-4043-9cd1-717b5c3bc623 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:14.236163 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c260699-1140-4043-9cd1-717b5c3bc623 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:14.240265 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556698e-b3f2-4aa9-9861-36b8271a561f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:14.240829 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556698e-b3f2-4aa9-9861-36b8271a561f admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:14.241110 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556698e-b3f2-4aa9-9861-36b8271a561f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:14.241385 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556698e-b3f2-4aa9-9861-36b8271a561f admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:14.242057 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556698e-b3f2-4aa9-9861-36b8271a561f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:14.242348 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556698e-b3f2-4aa9-9861-36b8271a561f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:14.268638 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556698e-b3f2-4aa9-9861-36b8271a561f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:14.280987 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 587/1174] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:42:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:14.286285 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f97afa-d15c-48ec-8bbf-ebb273492343 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:14.295507 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f97afa-d15c-48ec-8bbf-ebb273492343 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:14.299548 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a8b3a-6e73-4a3e-ab9f-e3cc52da6020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:14.300240 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a8b3a-6e73-4a3e-ab9f-e3cc52da6020 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:14.300531 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a8b3a-6e73-4a3e-ab9f-e3cc52da6020 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:14.300813 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a8b3a-6e73-4a3e-ab9f-e3cc52da6020 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:14.310006 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a8b3a-6e73-4a3e-ab9f-e3cc52da6020 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:14.336326 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a8b3a-6e73-4a3e-ab9f-e3cc52da6020 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:14.349609 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-400a8b3a-6e73-4a3e-ab9f-e3cc52da6020 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:42:14.350638 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 588/1175] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:42:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:14.356245 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556698e-b3f2-4aa9-9861-36b8271a561f admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:14.365170 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556698e-b3f2-4aa9-9861-36b8271a561f admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:14.369376 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0da2b-d073-4d05-a6d9-f31a2a505db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:14.369951 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0da2b-d073-4d05-a6d9-f31a2a505db5 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:14.370899 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0da2b-d073-4d05-a6d9-f31a2a505db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:14.371187 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0da2b-d073-4d05-a6d9-f31a2a505db5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:14.371933 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0da2b-d073-4d05-a6d9-f31a2a505db5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:14.372235 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0da2b-d073-4d05-a6d9-f31a2a505db5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:14.398199 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0da2b-d073-4d05-a6d9-f31a2a505db5 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:14.411052 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 588/1176] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:42:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:14.416636 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a8b3a-6e73-4a3e-ab9f-e3cc52da6020 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:14.425696 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a8b3a-6e73-4a3e-ab9f-e3cc52da6020 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:14.429723 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a6e09-2060-4f71-8be6-440edf9c7d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:14.430283 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a6e09-2060-4f71-8be6-440edf9c7d6f admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:14.430570 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a6e09-2060-4f71-8be6-440edf9c7d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:14.430881 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a6e09-2060-4f71-8be6-440edf9c7d6f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:14.431651 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a6e09-2060-4f71-8be6-440edf9c7d6f admin admin] RBAC: Adding query filter params (role.id=e66e6a94ba014fd193b851ceb92695ae, scope.project.id=ed634cf9bb9146f7a9738325a8638b70, user.id=25cb71bb64a3456fb2dc02095c487d4b) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:14.431956 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a6e09-2060-4f71-8be6-440edf9c7d6f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:14.458630 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a6e09-2060-4f71-8be6-440edf9c7d6f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:14.463825 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 589/1177] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:42:14 2021] GET /identity/v3/role_assignments?user.id=25cb71bb64a3456fb2dc02095c487d4b&scope.project.id=ed634cf9bb9146f7a9738325a8638b70&role.id=e66e6a94ba014fd193b851ceb92695ae => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:42:16.389036 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ba724-2b24-4527-b8b7-d6afecdff3aa None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:16.389557 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ba724-2b24-4527-b8b7-d6afecdff3aa None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:16.389676 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ba724-2b24-4527-b8b7-d6afecdff3aa None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:16.391288 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 589/1178] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:42:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:42:16.396348 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797539f-ef14-466e-8c91-f14a3dc03d3c None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:16.396713 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797539f-ef14-466e-8c91-f14a3dc03d3c None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:16.396917 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797539f-ef14-466e-8c91-f14a3dc03d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:16.419379 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-8797539f-ef14-466e-8c91-f14a3dc03d3c None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:42:16.420505 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-8797539f-ef14-466e-8c91-f14a3dc03d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:42:16.427265 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 590/1179] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:42:16 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:42:16.450035 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ba724-2b24-4527-b8b7-d6afecdff3aa None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:16.461482 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ba724-2b24-4527-b8b7-d6afecdff3aa None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:16.466240 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c8749-05e7-4a03-88c7-29b2cf2c946a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:16.466973 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c8749-05e7-4a03-88c7-29b2cf2c946a admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:16.467265 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c8749-05e7-4a03-88c7-29b2cf2c946a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:16.467546 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c8749-05e7-4a03-88c7-29b2cf2c946a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:16.478375 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c8749-05e7-4a03-88c7-29b2cf2c946a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:42:16.485077 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-0b7c8749-05e7-4a03-88c7-29b2cf2c946a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:42:16.486141 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 590/1180] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:42:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:16.491845 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797539f-ef14-466e-8c91-f14a3dc03d3c None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:16.500855 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797539f-ef14-466e-8c91-f14a3dc03d3c None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:16.504934 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d922dd-d52b-46a6-8330-736d57a8c0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:16.505522 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d922dd-d52b-46a6-8330-736d57a8c0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:16.505813 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d922dd-d52b-46a6-8330-736d57a8c0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:16.506097 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d922dd-d52b-46a6-8330-736d57a8c0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:16.506836 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d922dd-d52b-46a6-8330-736d57a8c0d5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:16.507139 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d922dd-d52b-46a6-8330-736d57a8c0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:16.533440 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d922dd-d52b-46a6-8330-736d57a8c0d5 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:16.541753 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 591/1181] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:42:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:16.547675 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c8749-05e7-4a03-88c7-29b2cf2c946a admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:16.557086 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c8749-05e7-4a03-88c7-29b2cf2c946a admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:16.561105 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5269f-d846-40ea-b3e2-08a04ad7e58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:16.561820 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5269f-d846-40ea-b3e2-08a04ad7e58d admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:16.562101 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5269f-d846-40ea-b3e2-08a04ad7e58d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:16.562375 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5269f-d846-40ea-b3e2-08a04ad7e58d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:16.573432 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5269f-d846-40ea-b3e2-08a04ad7e58d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:16.599495 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5269f-d846-40ea-b3e2-08a04ad7e58d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:16.617936 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-d3f5269f-d846-40ea-b3e2-08a04ad7e58d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:42:16.618995 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 591/1182] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:42:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:42:16.624562 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d922dd-d52b-46a6-8330-736d57a8c0d5 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:16.633651 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d922dd-d52b-46a6-8330-736d57a8c0d5 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:16.637767 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61f0fd-cf48-4698-9b6f-46ef9a69a05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:16.638343 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61f0fd-cf48-4698-9b6f-46ef9a69a05b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:16.638631 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61f0fd-cf48-4698-9b6f-46ef9a69a05b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:16.638937 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61f0fd-cf48-4698-9b6f-46ef9a69a05b admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:16.639658 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61f0fd-cf48-4698-9b6f-46ef9a69a05b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:16.639910 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61f0fd-cf48-4698-9b6f-46ef9a69a05b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:16.665490 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61f0fd-cf48-4698-9b6f-46ef9a69a05b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:16.678384 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 592/1183] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:42:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:16.683720 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5269f-d846-40ea-b3e2-08a04ad7e58d admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:16.693016 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5269f-d846-40ea-b3e2-08a04ad7e58d admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:16.697102 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27e6bb-d4f1-4f61-a9b3-296511f4fb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:16.697806 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27e6bb-d4f1-4f61-a9b3-296511f4fb9c admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:16.698091 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27e6bb-d4f1-4f61-a9b3-296511f4fb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:16.698394 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27e6bb-d4f1-4f61-a9b3-296511f4fb9c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:16.710806 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27e6bb-d4f1-4f61-a9b3-296511f4fb9c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:16.737477 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27e6bb-d4f1-4f61-a9b3-296511f4fb9c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:16.755216 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-9c27e6bb-d4f1-4f61-a9b3-296511f4fb9c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 29 20:42:16.756283 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 592/1184] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:42:16 2021] GET /identity/v3/users/placement => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:16.762051 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61f0fd-cf48-4698-9b6f-46ef9a69a05b admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:16.771324 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61f0fd-cf48-4698-9b6f-46ef9a69a05b admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:16.775440 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e931e2b-b3c2-4377-9b04-0a81900100c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:16.776025 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e931e2b-b3c2-4377-9b04-0a81900100c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:16.776315 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e931e2b-b3c2-4377-9b04-0a81900100c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:16.777221 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e931e2b-b3c2-4377-9b04-0a81900100c8 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:16.778201 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e931e2b-b3c2-4377-9b04-0a81900100c8 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:16.778513 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e931e2b-b3c2-4377-9b04-0a81900100c8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:16.804668 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e931e2b-b3c2-4377-9b04-0a81900100c8 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:16.833311 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 593/1185] 10.222.0.37 () {56 vars in 1164 bytes} [Wed Dec 29 20:42:16 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:16.838718 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27e6bb-d4f1-4f61-a9b3-296511f4fb9c admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:16.848404 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27e6bb-d4f1-4f61-a9b3-296511f4fb9c admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:16.852413 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935aecb-61e3-4010-8984-7be316a0e122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:16.853115 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935aecb-61e3-4010-8984-7be316a0e122 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:16.853404 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935aecb-61e3-4010-8984-7be316a0e122 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:16.853680 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935aecb-61e3-4010-8984-7be316a0e122 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:16.866439 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935aecb-61e3-4010-8984-7be316a0e122 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:16.892175 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935aecb-61e3-4010-8984-7be316a0e122 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:16.908913 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-5935aecb-61e3-4010-8984-7be316a0e122 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:42:16.909966 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 593/1186] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:42:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:16.915710 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e931e2b-b3c2-4377-9b04-0a81900100c8 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:16.924781 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e931e2b-b3c2-4377-9b04-0a81900100c8 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:16.928780 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a05fe-31ba-4f49-9bea-113fbbdee9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:16.929351 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a05fe-31ba-4f49-9bea-113fbbdee9dd admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:16.929635 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a05fe-31ba-4f49-9bea-113fbbdee9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:16.929912 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a05fe-31ba-4f49-9bea-113fbbdee9dd admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:16.930590 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a05fe-31ba-4f49-9bea-113fbbdee9dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:16.930912 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a05fe-31ba-4f49-9bea-113fbbdee9dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:16.956903 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a05fe-31ba-4f49-9bea-113fbbdee9dd admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:16.969673 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 594/1187] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:42:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:16.975061 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935aecb-61e3-4010-8984-7be316a0e122 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:16.984372 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935aecb-61e3-4010-8984-7be316a0e122 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:16.988463 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac530995-0f36-4f17-907b-f40f1a307949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:16.989158 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac530995-0f36-4f17-907b-f40f1a307949 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:16.989444 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac530995-0f36-4f17-907b-f40f1a307949 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:16.989720 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac530995-0f36-4f17-907b-f40f1a307949 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:16.998753 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac530995-0f36-4f17-907b-f40f1a307949 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:17.024493 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac530995-0f36-4f17-907b-f40f1a307949 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:17.038253 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-ac530995-0f36-4f17-907b-f40f1a307949 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:42:17.039299 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 594/1188] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:42:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 29 20:42:17.045102 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a05fe-31ba-4f49-9bea-113fbbdee9dd admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:17.054175 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a05fe-31ba-4f49-9bea-113fbbdee9dd admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:17.058201 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a8ea8-611c-48e7-b851-d190157123a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:17.058816 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a8ea8-611c-48e7-b851-d190157123a8 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:17.059108 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a8ea8-611c-48e7-b851-d190157123a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:17.059384 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a8ea8-611c-48e7-b851-d190157123a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:17.060108 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a8ea8-611c-48e7-b851-d190157123a8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:17.060404 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a8ea8-611c-48e7-b851-d190157123a8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:17.086536 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a8ea8-611c-48e7-b851-d190157123a8 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:17.099555 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 595/1189] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:42:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:17.105536 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac530995-0f36-4f17-907b-f40f1a307949 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:17.114515 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac530995-0f36-4f17-907b-f40f1a307949 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:17.118509 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6b525-cd24-4b95-b3c7-2f1f692732d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:17.119339 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6b525-cd24-4b95-b3c7-2f1f692732d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:17.119627 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6b525-cd24-4b95-b3c7-2f1f692732d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:17.119907 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6b525-cd24-4b95-b3c7-2f1f692732d3 admin admin] PATH_INFO: `/v3/projects/ed634cf9bb9146f7a9738325a8638b70/users/25cb71bb64a3456fb2dc02095c487d4b/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:17.121991 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6b525-cd24-4b95-b3c7-2f1f692732d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed634cf9bb9146f7a9738325a8638b70, user_id=25cb71bb64a3456fb2dc02095c487d4b, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:17.148578 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6b525-cd24-4b95-b3c7-2f1f692732d3 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:17.161187 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 595/1190] 10.222.0.37 () {58 vars in 1460 bytes} [Wed Dec 29 20:42:17 2021] PUT /identity/v3/projects/ed634cf9bb9146f7a9738325a8638b70/users/25cb71bb64a3456fb2dc02095c487d4b/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:42:19.100321 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65c6e0-e4b7-4fad-be36-f4de9f207e89 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:19.100863 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65c6e0-e4b7-4fad-be36-f4de9f207e89 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:19.100863 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65c6e0-e4b7-4fad-be36-f4de9f207e89 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:19.102521 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 596/1191] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:42:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 29 20:42:19.108554 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55f05c-945a-4da4-a82e-b591d3d4a13e None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:19.108967 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55f05c-945a-4da4-a82e-b591d3d4a13e None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:19.109122 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55f05c-945a-4da4-a82e-b591d3d4a13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:19.131197 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-bc55f05c-945a-4da4-a82e-b591d3d4a13e None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:42:19.132263 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-bc55f05c-945a-4da4-a82e-b591d3d4a13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:42:19.193552 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 596/1192] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:42:19 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:42:19.217048 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65c6e0-e4b7-4fad-be36-f4de9f207e89 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:19.228437 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65c6e0-e4b7-4fad-be36-f4de9f207e89 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:19.232442 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2137f-6a5c-436d-83e8-e7d05b8d0f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:19.233143 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2137f-6a5c-436d-83e8-e7d05b8d0f2c admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:19.233424 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2137f-6a5c-436d-83e8-e7d05b8d0f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:19.233701 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2137f-6a5c-436d-83e8-e7d05b8d0f2c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:19.244486 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2137f-6a5c-436d-83e8-e7d05b8d0f2c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 29 20:42:19.250738 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-d1c2137f-6a5c-436d-83e8-e7d05b8d0f2c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 29 20:42:19.251799 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 597/1193] 10.222.0.37 () {56 vars in 1117 bytes} [Wed Dec 29 20:42:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:19.257479 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55f05c-945a-4da4-a82e-b591d3d4a13e None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:19.266517 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55f05c-945a-4da4-a82e-b591d3d4a13e None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:19.270515 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027495c-056b-4719-b26e-4ed3fa4cfec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:19.271130 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027495c-056b-4719-b26e-4ed3fa4cfec5 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:19.271415 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027495c-056b-4719-b26e-4ed3fa4cfec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:19.271691 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027495c-056b-4719-b26e-4ed3fa4cfec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:19.272386 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027495c-056b-4719-b26e-4ed3fa4cfec5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:19.272678 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027495c-056b-4719-b26e-4ed3fa4cfec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:19.298516 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027495c-056b-4719-b26e-4ed3fa4cfec5 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:19.306712 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 597/1194] 10.222.0.37 () {56 vars in 1120 bytes} [Wed Dec 29 20:42:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:19.312271 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2137f-6a5c-436d-83e8-e7d05b8d0f2c admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:19.321933 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2137f-6a5c-436d-83e8-e7d05b8d0f2c admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:19.326627 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b878f-dc80-4d59-90ee-3f3bbeba67bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:19.327334 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b878f-dc80-4d59-90ee-3f3bbeba67bf admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:19.327619 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b878f-dc80-4d59-90ee-3f3bbeba67bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:19.327898 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b878f-dc80-4d59-90ee-3f3bbeba67bf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:19.338623 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b878f-dc80-4d59-90ee-3f3bbeba67bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:19.364418 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b878f-dc80-4d59-90ee-3f3bbeba67bf admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:19.381698 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-7a0b878f-dc80-4d59-90ee-3f3bbeba67bf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:42:19.382680 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 598/1195] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:42:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:19.388159 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027495c-056b-4719-b26e-4ed3fa4cfec5 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:19.397195 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027495c-056b-4719-b26e-4ed3fa4cfec5 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:19.401154 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4e21e-4170-4e17-b639-84164758bda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:19.401726 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4e21e-4170-4e17-b639-84164758bda0 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:19.402013 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4e21e-4170-4e17-b639-84164758bda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:19.402292 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4e21e-4170-4e17-b639-84164758bda0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:19.402996 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4e21e-4170-4e17-b639-84164758bda0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:19.403293 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4e21e-4170-4e17-b639-84164758bda0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:19.428775 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4e21e-4170-4e17-b639-84164758bda0 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:19.441849 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 598/1196] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:42:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:42:19.447032 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b878f-dc80-4d59-90ee-3f3bbeba67bf admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:19.455994 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b878f-dc80-4d59-90ee-3f3bbeba67bf admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:19.459983 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df2484-d7ac-4dbd-af20-8fa59b0fc049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:19.460679 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df2484-d7ac-4dbd-af20-8fa59b0fc049 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:19.460966 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df2484-d7ac-4dbd-af20-8fa59b0fc049 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:19.461249 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df2484-d7ac-4dbd-af20-8fa59b0fc049 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:19.473439 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df2484-d7ac-4dbd-af20-8fa59b0fc049 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:19.499391 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df2484-d7ac-4dbd-af20-8fa59b0fc049 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:19.516343 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-92df2484-d7ac-4dbd-af20-8fa59b0fc049 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 29 20:42:19.517368 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 599/1197] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:42:19 2021] GET /identity/v3/users/placement => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:19.522857 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4e21e-4170-4e17-b639-84164758bda0 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:19.532365 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4e21e-4170-4e17-b639-84164758bda0 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:19.536407 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad2bf3-8cf6-4aac-9813-408a29602c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:19.536986 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad2bf3-8cf6-4aac-9813-408a29602c5e admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:19.537273 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad2bf3-8cf6-4aac-9813-408a29602c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:19.537552 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad2bf3-8cf6-4aac-9813-408a29602c5e admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:19.538336 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad2bf3-8cf6-4aac-9813-408a29602c5e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:19.538634 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad2bf3-8cf6-4aac-9813-408a29602c5e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:19.564918 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad2bf3-8cf6-4aac-9813-408a29602c5e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:19.593488 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 599/1198] 10.222.0.37 () {56 vars in 1164 bytes} [Wed Dec 29 20:42:19 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:19.598889 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df2484-d7ac-4dbd-af20-8fa59b0fc049 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:19.607944 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df2484-d7ac-4dbd-af20-8fa59b0fc049 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:19.611922 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef71f2-62e6-45e3-8b24-f19dc4023ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:19.612483 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef71f2-62e6-45e3-8b24-f19dc4023ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:19.612767 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef71f2-62e6-45e3-8b24-f19dc4023ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:19.613044 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef71f2-62e6-45e3-8b24-f19dc4023ce2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:19.621073 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef71f2-62e6-45e3-8b24-f19dc4023ce2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:19.646953 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef71f2-62e6-45e3-8b24-f19dc4023ce2 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:19.657252 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 600/1199] 10.222.0.37 () {58 vars in 1324 bytes} [Wed Dec 29 20:42:19 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:42:19.662729 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad2bf3-8cf6-4aac-9813-408a29602c5e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:19.671809 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad2bf3-8cf6-4aac-9813-408a29602c5e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:19.675876 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162df34-f5cf-4768-8e43-19a8f20f5a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:19.676581 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162df34-f5cf-4768-8e43-19a8f20f5a0c admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:19.676869 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162df34-f5cf-4768-8e43-19a8f20f5a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:19.677150 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162df34-f5cf-4768-8e43-19a8f20f5a0c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:19.688891 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162df34-f5cf-4768-8e43-19a8f20f5a0c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:19.714984 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162df34-f5cf-4768-8e43-19a8f20f5a0c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:19.731389 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-4162df34-f5cf-4768-8e43-19a8f20f5a0c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 29 20:42:19.732434 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 600/1200] 10.222.0.37 () {56 vars in 1129 bytes} [Wed Dec 29 20:42:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:19.737687 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef71f2-62e6-45e3-8b24-f19dc4023ce2 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:19.746529 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef71f2-62e6-45e3-8b24-f19dc4023ce2 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:19.750554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fd34a-9c49-47bb-b8c3-02a1141a8a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:19.751150 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fd34a-9c49-47bb-b8c3-02a1141a8a4c admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:19.751436 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fd34a-9c49-47bb-b8c3-02a1141a8a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:19.751713 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fd34a-9c49-47bb-b8c3-02a1141a8a4c admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:19.752377 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2fd34a-9c49-47bb-b8c3-02a1141a8a4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:19.752670 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2fd34a-9c49-47bb-b8c3-02a1141a8a4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:19.778412 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2fd34a-9c49-47bb-b8c3-02a1141a8a4c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:19.790561 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 601/1201] 10.222.0.37 () {56 vars in 1130 bytes} [Wed Dec 29 20:42:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:19.796007 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162df34-f5cf-4768-8e43-19a8f20f5a0c admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:19.804977 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162df34-f5cf-4768-8e43-19a8f20f5a0c admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:19.809640 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4aa1af-5e45-4222-acc0-fedbee1d4242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:19.810333 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4aa1af-5e45-4222-acc0-fedbee1d4242 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:19.810617 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4aa1af-5e45-4222-acc0-fedbee1d4242 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:19.810925 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4aa1af-5e45-4222-acc0-fedbee1d4242 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:19.819896 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4aa1af-5e45-4222-acc0-fedbee1d4242 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:19.846020 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4aa1af-5e45-4222-acc0-fedbee1d4242 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:19.859940 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING keystone.server.flask.application [None req-3d4aa1af-5e45-4222-acc0-fedbee1d4242 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 29 20:42:19.861007 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 601/1202] 10.222.0.37 () {56 vars in 1132 bytes} [Wed Dec 29 20:42:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:19.866613 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fd34a-9c49-47bb-b8c3-02a1141a8a4c admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:19.876514 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fd34a-9c49-47bb-b8c3-02a1141a8a4c admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:19.880541 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711df5ee-bcb0-4385-95b5-463192aaeb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:19.881115 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711df5ee-bcb0-4385-95b5-463192aaeb77 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:19.881401 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711df5ee-bcb0-4385-95b5-463192aaeb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:19.881679 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711df5ee-bcb0-4385-95b5-463192aaeb77 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:19.882416 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711df5ee-bcb0-4385-95b5-463192aaeb77 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:19.882744 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711df5ee-bcb0-4385-95b5-463192aaeb77 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:19.908838 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711df5ee-bcb0-4385-95b5-463192aaeb77 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:19.922194 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 602/1203] 10.222.0.37 () {56 vars in 1169 bytes} [Wed Dec 29 20:42:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:19.928061 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4aa1af-5e45-4222-acc0-fedbee1d4242 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:19.937814 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4aa1af-5e45-4222-acc0-fedbee1d4242 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:19.942094 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67c2c1-dc7d-4449-8bef-ec17a6d32d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:19.942671 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67c2c1-dc7d-4449-8bef-ec17a6d32d7a admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:19.942983 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67c2c1-dc7d-4449-8bef-ec17a6d32d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:19.943264 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67c2c1-dc7d-4449-8bef-ec17a6d32d7a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:19.944040 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67c2c1-dc7d-4449-8bef-ec17a6d32d7a admin admin] RBAC: Adding query filter params (role.id=e66e6a94ba014fd193b851ceb92695ae, scope.project.id=ed634cf9bb9146f7a9738325a8638b70, user.id=25cb71bb64a3456fb2dc02095c487d4b) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:19.944347 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67c2c1-dc7d-4449-8bef-ec17a6d32d7a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:19.969738 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67c2c1-dc7d-4449-8bef-ec17a6d32d7a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:19.975227 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 602/1204] 10.222.0.37 () {56 vars in 1395 bytes} [Wed Dec 29 20:42:19 2021] GET /identity/v3/role_assignments?user.id=25cb71bb64a3456fb2dc02095c487d4b&scope.project.id=ed634cf9bb9146f7a9738325a8638b70&role.id=e66e6a94ba014fd193b851ceb92695ae => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:42:21.958209 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89028adf-5c8e-4245-b7b1-153ea8138e7a None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:21.958731 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89028adf-5c8e-4245-b7b1-153ea8138e7a None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:21.958821 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89028adf-5c8e-4245-b7b1-153ea8138e7a None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:21.960462 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 603/1205] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:42:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:42:21.965556 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d9105-f45b-4310-9d58-30c235cc1f55 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:21.965926 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d9105-f45b-4310-9d58-30c235cc1f55 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:21.966120 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d9105-f45b-4310-9d58-30c235cc1f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:21.989685 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-ad4d9105-f45b-4310-9d58-30c235cc1f55 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:42:21.990848 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-ad4d9105-f45b-4310-9d58-30c235cc1f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:42:21.998222 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 603/1206] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:42:21 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:42:22.020611 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89028adf-5c8e-4245-b7b1-153ea8138e7a None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:22.032135 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89028adf-5c8e-4245-b7b1-153ea8138e7a None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:22.036043 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564179a0-832f-4c56-8349-a44d23eb5dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:22.036746 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564179a0-832f-4c56-8349-a44d23eb5dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:22.037033 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564179a0-832f-4c56-8349-a44d23eb5dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:22.037308 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564179a0-832f-4c56-8349-a44d23eb5dc5 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:22.037925 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564179a0-832f-4c56-8349-a44d23eb5dc5 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:22.063411 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564179a0-832f-4c56-8349-a44d23eb5dc5 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:22.074365 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-564179a0-832f-4c56-8349-a44d23eb5dc5 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 29 20:42:22.075412 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 604/1207] 10.222.0.37 () {56 vars in 1138 bytes} [Wed Dec 29 20:42:22 2021] GET /identity/v3/services/placement => generated 90 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:22.081083 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d9105-f45b-4310-9d58-30c235cc1f55 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:22.089442 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d9105-f45b-4310-9d58-30c235cc1f55 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:22.093410 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f53ffc-b9ef-429a-aca9-ef33b45d6953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:22.093982 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f53ffc-b9ef-429a-aca9-ef33b45d6953 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:22.094265 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f53ffc-b9ef-429a-aca9-ef33b45d6953 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:22.094541 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f53ffc-b9ef-429a-aca9-ef33b45d6953 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:22.095234 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f53ffc-b9ef-429a-aca9-ef33b45d6953 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:22.095526 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f53ffc-b9ef-429a-aca9-ef33b45d6953 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:22.121840 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f53ffc-b9ef-429a-aca9-ef33b45d6953 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:22.126436 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 604/1208] 10.222.0.37 () {56 vars in 1137 bytes} [Wed Dec 29 20:42:22 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:22.131749 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564179a0-832f-4c56-8349-a44d23eb5dc5 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:22.140843 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564179a0-832f-4c56-8349-a44d23eb5dc5 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:22.144864 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ef94e-616e-4954-9399-d4b2d034573e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:22.145427 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ef94e-616e-4954-9399-d4b2d034573e admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:22.145715 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ef94e-616e-4954-9399-d4b2d034573e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:22.145999 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ef94e-616e-4954-9399-d4b2d034573e admin admin] PATH_INFO: `/v3/services` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:22.146675 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ef94e-616e-4954-9399-d4b2d034573e admin admin] RBAC: Adding query filter params (type=placement) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:22.146981 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ef94e-616e-4954-9399-d4b2d034573e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:22.172300 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ef94e-616e-4954-9399-d4b2d034573e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:22.176447 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 605/1209] 10.222.0.37 () {56 vars in 1137 bytes} [Wed Dec 29 20:42:22 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:24.107458 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea21f3-6941-4a8e-8154-48485a9e194e None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:24.108004 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea21f3-6941-4a8e-8154-48485a9e194e None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:24.108004 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea21f3-6941-4a8e-8154-48485a9e194e None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:24.109714 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 605/1210] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:42:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:42:24.114991 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21979d-30c0-4a4c-8101-1bd55b4cb66c None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:24.115365 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21979d-30c0-4a4c-8101-1bd55b4cb66c None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:24.115505 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21979d-30c0-4a4c-8101-1bd55b4cb66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:24.138711 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-3f21979d-30c0-4a4c-8101-1bd55b4cb66c None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:42:24.139850 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-3f21979d-30c0-4a4c-8101-1bd55b4cb66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:42:24.146563 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 606/1211] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:42:24 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:42:24.168452 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea21f3-6941-4a8e-8154-48485a9e194e None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:24.179736 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea21f3-6941-4a8e-8154-48485a9e194e None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:24.184081 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d31e0-d027-4432-ab4f-a17a98ad6f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:24.184646 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d31e0-d027-4432-ab4f-a17a98ad6f55 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:24.184928 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d31e0-d027-4432-ab4f-a17a98ad6f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:24.185203 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d31e0-d027-4432-ab4f-a17a98ad6f55 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:24.185979 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d31e0-d027-4432-ab4f-a17a98ad6f55 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:24.211808 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d31e0-d027-4432-ab4f-a17a98ad6f55 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:24.224013 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 606/1212] 10.222.0.37 () {60 vars in 1162 bytes} [Wed Dec 29 20:42:24 2021] POST /identity/v3/services => generated 246 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:42:26.206928 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6210d3-7e51-4fa6-99c6-0687b2f36bee None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:26.207441 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6210d3-7e51-4fa6-99c6-0687b2f36bee None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:26.207441 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6210d3-7e51-4fa6-99c6-0687b2f36bee None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:26.209059 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 607/1213] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:42:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:42:26.215006 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c6cb1-e6ef-482e-95ee-37e7d2ef77a7 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:26.215370 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c6cb1-e6ef-482e-95ee-37e7d2ef77a7 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:26.215586 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c6cb1-e6ef-482e-95ee-37e7d2ef77a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:26.237482 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-2a9c6cb1-e6ef-482e-95ee-37e7d2ef77a7 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:42:26.238610 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-2a9c6cb1-e6ef-482e-95ee-37e7d2ef77a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:42:26.256160 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 607/1214] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:42:26 2021] POST /identity/v3/auth/tokens => generated 3516 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:42:26.278940 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6210d3-7e51-4fa6-99c6-0687b2f36bee None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:26.290327 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6210d3-7e51-4fa6-99c6-0687b2f36bee None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:26.294230 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e20af-56d9-4c19-ade5-28c0070bbe08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:26.294978 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e20af-56d9-4c19-ade5-28c0070bbe08 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:26.295264 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e20af-56d9-4c19-ade5-28c0070bbe08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:26.295543 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e20af-56d9-4c19-ade5-28c0070bbe08 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:26.296161 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e20af-56d9-4c19-ade5-28c0070bbe08 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:26.321979 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e20af-56d9-4c19-ade5-28c0070bbe08 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:26.332635 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-c92e20af-56d9-4c19-ade5-28c0070bbe08 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 29 20:42:26.333656 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 608/1215] 10.222.0.37 () {56 vars in 1138 bytes} [Wed Dec 29 20:42:26 2021] GET /identity/v3/services/placement => generated 90 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:26.340061 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c6cb1-e6ef-482e-95ee-37e7d2ef77a7 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:26.348476 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c6cb1-e6ef-482e-95ee-37e7d2ef77a7 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:26.352559 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc29d9f-1e93-4e3b-84e1-f291437780c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:26.353138 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc29d9f-1e93-4e3b-84e1-f291437780c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:26.353428 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc29d9f-1e93-4e3b-84e1-f291437780c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:26.353709 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc29d9f-1e93-4e3b-84e1-f291437780c2 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:26.354383 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc29d9f-1e93-4e3b-84e1-f291437780c2 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:26.354713 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc29d9f-1e93-4e3b-84e1-f291437780c2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:26.380522 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc29d9f-1e93-4e3b-84e1-f291437780c2 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:26.385616 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 608/1216] 10.222.0.37 () {56 vars in 1137 bytes} [Wed Dec 29 20:42:26 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:26.391839 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e20af-56d9-4c19-ade5-28c0070bbe08 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:26.400715 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e20af-56d9-4c19-ade5-28c0070bbe08 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:26.404746 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847170a-5994-4edd-9051-ad43b8fea86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:26.405299 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847170a-5994-4edd-9051-ad43b8fea86f admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:26.405582 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847170a-5994-4edd-9051-ad43b8fea86f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:26.405860 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847170a-5994-4edd-9051-ad43b8fea86f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:26.406583 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847170a-5994-4edd-9051-ad43b8fea86f admin admin] RBAC: Adding query filter params (interface=public, service_id=9b94e87cf06d46bf90aaebf76309963b, region_id=RegionOne) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:26.406911 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847170a-5994-4edd-9051-ad43b8fea86f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:26.431723 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847170a-5994-4edd-9051-ad43b8fea86f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:26.437281 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 609/1217] 10.222.0.37 () {56 vars in 1272 bytes} [Wed Dec 29 20:42:26 2021] GET /identity/v3/endpoints?service_id=9b94e87cf06d46bf90aaebf76309963b&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:26.442685 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc29d9f-1e93-4e3b-84e1-f291437780c2 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:26.452197 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc29d9f-1e93-4e3b-84e1-f291437780c2 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:26.456290 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9574095-4011-44a5-8c7c-8d1a9b3ecba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:26.456855 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9574095-4011-44a5-8c7c-8d1a9b3ecba1 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:26.457190 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9574095-4011-44a5-8c7c-8d1a9b3ecba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:26.457427 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9574095-4011-44a5-8c7c-8d1a9b3ecba1 admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:26.458066 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9574095-4011-44a5-8c7c-8d1a9b3ecba1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:26.483510 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9574095-4011-44a5-8c7c-8d1a9b3ecba1 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:26.490304 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 609/1218] 10.222.0.37 () {56 vars in 1108 bytes} [Wed Dec 29 20:42:26 2021] GET /identity/v3/services => generated 2430 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:42:28.496002 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d02477-1286-4e2e-aec1-d8675fc11611 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:28.496527 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d02477-1286-4e2e-aec1-d8675fc11611 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:28.496616 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d02477-1286-4e2e-aec1-d8675fc11611 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:28.498313 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 610/1219] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:42:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:42:28.503389 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d81949-a698-47c3-8054-18001b67622a None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:28.503770 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d81949-a698-47c3-8054-18001b67622a None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:28.503959 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d81949-a698-47c3-8054-18001b67622a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:28.526237 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-46d81949-a698-47c3-8054-18001b67622a None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:42:28.528422 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-46d81949-a698-47c3-8054-18001b67622a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:42:28.535224 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 610/1220] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:42:28 2021] POST /identity/v3/auth/tokens => generated 3516 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:42:28.557575 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d02477-1286-4e2e-aec1-d8675fc11611 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:28.570407 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d02477-1286-4e2e-aec1-d8675fc11611 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:28.574797 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0859c-2bdc-415b-9fa7-8c6fe1fe1e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:28.575503 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0859c-2bdc-415b-9fa7-8c6fe1fe1e27 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:28.575793 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0859c-2bdc-415b-9fa7-8c6fe1fe1e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:28.576076 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0859c-2bdc-415b-9fa7-8c6fe1fe1e27 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:28.576689 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0859c-2bdc-415b-9fa7-8c6fe1fe1e27 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:28.602702 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0859c-2bdc-415b-9fa7-8c6fe1fe1e27 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:28.614053 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING keystone.server.flask.application [None req-19b0859c-2bdc-415b-9fa7-8c6fe1fe1e27 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 29 20:42:28.615139 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 611/1221] 10.222.0.37 () {56 vars in 1138 bytes} [Wed Dec 29 20:42:28 2021] GET /identity/v3/services/placement => generated 90 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 29 20:42:28.620918 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d81949-a698-47c3-8054-18001b67622a None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:28.629430 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d81949-a698-47c3-8054-18001b67622a None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:28.633497 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2887462-87e2-43da-bf17-5df910e7e29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:28.634076 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2887462-87e2-43da-bf17-5df910e7e29f admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:28.634365 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2887462-87e2-43da-bf17-5df910e7e29f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:28.634647 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2887462-87e2-43da-bf17-5df910e7e29f admin admin] PATH_INFO: `/v3/services` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:28.635340 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2887462-87e2-43da-bf17-5df910e7e29f admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:42:28.635636 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2887462-87e2-43da-bf17-5df910e7e29f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:28.661124 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2887462-87e2-43da-bf17-5df910e7e29f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:28.666143 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 611/1222] 10.222.0.37 () {56 vars in 1137 bytes} [Wed Dec 29 20:42:28 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:42:28.672234 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0859c-2bdc-415b-9fa7-8c6fe1fe1e27 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:42:28.682279 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0859c-2bdc-415b-9fa7-8c6fe1fe1e27 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:42:28.686488 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b771020-3241-4f2d-b21b-78b8892f043f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:42:28.687076 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b771020-3241-4f2d-b21b-78b8892f043f admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:42:28.687364 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b771020-3241-4f2d-b21b-78b8892f043f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:42:28.687647 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b771020-3241-4f2d-b21b-78b8892f043f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:42:28.688331 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b771020-3241-4f2d-b21b-78b8892f043f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:42:28.713650 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b771020-3241-4f2d-b21b-78b8892f043f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:42:28.733233 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 612/1223] 10.222.0.37 () {60 vars in 1165 bytes} [Wed Dec 29 20:42:28 2021] POST /identity/v3/endpoints => generated 331 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:44:06.714874 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f41cd-6ad8-4fc2-a8d4-e57e4f913032 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:06.715794 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f41cd-6ad8-4fc2-a8d4-e57e4f913032 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:06.716238 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f41cd-6ad8-4fc2-a8d4-e57e4f913032 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:06.718963 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 612/1224] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:44:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:44:06.723332 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8382a8-8fbd-4071-b7e5-6b75910b96f1 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:06.724877 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8382a8-8fbd-4071-b7e5-6b75910b96f1 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:06.725561 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8382a8-8fbd-4071-b7e5-6b75910b96f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:06.823934 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-3f8382a8-8fbd-4071-b7e5-6b75910b96f1 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:44:06.825337 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-3f8382a8-8fbd-4071-b7e5-6b75910b96f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:06.970232 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 613/1225] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:44:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:44:06.991627 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f41cd-6ad8-4fc2-a8d4-e57e4f913032 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:44:06.993273 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-887f41cd-6ad8-4fc2-a8d4-e57e4f913032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:07.186581 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f41cd-6ad8-4fc2-a8d4-e57e4f913032 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:44:07.312764 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ed34e-88b1-41e3-a840-199d538bfe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:44:07.313361 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ed34e-88b1-41e3-a840-199d538bfe7b admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:07.313651 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ed34e-88b1-41e3-a840-199d538bfe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:07.314074 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ed34e-88b1-41e3-a840-199d538bfe7b admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:07.314816 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ed34e-88b1-41e3-a840-199d538bfe7b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:44:07.341202 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ed34e-88b1-41e3-a840-199d538bfe7b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:44:07.356608 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 613/1226] 10.222.0.37 () {56 vars in 1108 bytes} [Wed Dec 29 20:44:06 2021] GET /identity/v3/projects => generated 2553 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:44:09.380735 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a2636-5a6f-407a-87bf-6a833d4583e7 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:09.381223 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a2636-5a6f-407a-87bf-6a833d4583e7 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:09.381315 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a2636-5a6f-407a-87bf-6a833d4583e7 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:09.383019 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 614/1227] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:44:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:44:09.388103 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c848c2-6c7d-4182-a07a-d8d2f5102fd2 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:09.388533 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c848c2-6c7d-4182-a07a-d8d2f5102fd2 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:09.388666 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c848c2-6c7d-4182-a07a-d8d2f5102fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:09.473350 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-49c848c2-6c7d-4182-a07a-d8d2f5102fd2 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:44:09.475193 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-49c848c2-6c7d-4182-a07a-d8d2f5102fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:09.578627 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 614/1228] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:44:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:44:09.625567 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f11a6a-aef4-481e-abbe-67759aa99e06 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:09.625868 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f11a6a-aef4-481e-abbe-67759aa99e06 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:09.626159 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f11a6a-aef4-481e-abbe-67759aa99e06 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:09.627848 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 615/1229] 10.222.0.37 () {54 vars in 963 bytes} [Wed Dec 29 20:44:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:44:09.633982 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac77420-5919-4aa8-9219-5ad4ebfcc76c None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:09.634281 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac77420-5919-4aa8-9219-5ad4ebfcc76c None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:09.634564 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac77420-5919-4aa8-9219-5ad4ebfcc76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:09.729590 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-1ac77420-5919-4aa8-9219-5ad4ebfcc76c None None] MFA Rules not processed for user `55d700adb7db4848a97bab6cf4105481`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:44:09.730759 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-1ac77420-5919-4aa8-9219-5ad4ebfcc76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:09.813705 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 615/1230] 10.222.0.37 () {58 vars in 1060 bytes} [Wed Dec 29 20:44:09 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:44:09.823528 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f11a6a-aef4-481e-abbe-67759aa99e06 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:44:09.824986 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-66f11a6a-aef4-481e-abbe-67759aa99e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:09.940445 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f11a6a-aef4-481e-abbe-67759aa99e06 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:44:10.024167 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820eba9-2016-4191-954c-252690117ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:44:10.024743 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820eba9-2016-4191-954c-252690117ddc service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:10.025032 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820eba9-2016-4191-954c-252690117ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:10.025315 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820eba9-2016-4191-954c-252690117ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:10.026875 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-8820eba9-2016-4191-954c-252690117ddc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:10.149725 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820eba9-2016-4191-954c-252690117ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:44:10.175716 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820eba9-2016-4191-954c-252690117ddc service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:44:10.202388 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 616/1231] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:44:09 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:44:12.482070 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f680d0-4898-445b-95f4-9abfde098174 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:12.482618 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f680d0-4898-445b-95f4-9abfde098174 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:12.482618 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f680d0-4898-445b-95f4-9abfde098174 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:12.484339 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 616/1232] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:44:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:44:12.489383 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964df229-e020-4bf7-83e6-8931554e52f8 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:12.489775 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964df229-e020-4bf7-83e6-8931554e52f8 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:12.490032 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964df229-e020-4bf7-83e6-8931554e52f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:12.574125 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-964df229-e020-4bf7-83e6-8931554e52f8 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:44:12.575294 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-964df229-e020-4bf7-83e6-8931554e52f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:12.679050 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 617/1233] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:44:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:44:12.716266 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f680d0-4898-445b-95f4-9abfde098174 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:44:12.717721 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-34f680d0-4898-445b-95f4-9abfde098174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:12.832912 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f680d0-4898-445b-95f4-9abfde098174 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:44:12.914220 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bad099-7d80-472f-82e0-2db1db52eb00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:44:12.914829 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bad099-7d80-472f-82e0-2db1db52eb00 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:12.915115 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bad099-7d80-472f-82e0-2db1db52eb00 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:12.915392 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bad099-7d80-472f-82e0-2db1db52eb00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:12.916897 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-57bad099-7d80-472f-82e0-2db1db52eb00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:13.035751 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bad099-7d80-472f-82e0-2db1db52eb00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:44:13.061315 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bad099-7d80-472f-82e0-2db1db52eb00 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:44:13.080737 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 617/1234] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:44:12 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:44:15.312290 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e662b-c20c-415b-b818-6dc1d93905a4 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:15.312722 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e662b-c20c-415b-b818-6dc1d93905a4 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:15.312864 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e662b-c20c-415b-b818-6dc1d93905a4 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:15.314546 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 618/1235] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:44:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:44:15.320266 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b161005-3c30-449e-9674-a2c27e3df318 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:15.320663 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b161005-3c30-449e-9674-a2c27e3df318 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:15.320825 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b161005-3c30-449e-9674-a2c27e3df318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:15.402975 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-0b161005-3c30-449e-9674-a2c27e3df318 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:44:15.404117 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-0b161005-3c30-449e-9674-a2c27e3df318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:15.506757 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 618/1236] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:44:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:44:15.540688 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e662b-c20c-415b-b818-6dc1d93905a4 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:44:15.542052 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-797e662b-c20c-415b-b818-6dc1d93905a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:15.679646 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e662b-c20c-415b-b818-6dc1d93905a4 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:44:15.778922 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1513d23-8ae9-4db9-ae3f-bacab76e49b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:44:15.779698 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1513d23-8ae9-4db9-ae3f-bacab76e49b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:15.779991 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1513d23-8ae9-4db9-ae3f-bacab76e49b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:15.780267 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1513d23-8ae9-4db9-ae3f-bacab76e49b6 admin admin] PATH_INFO: `/v3/projects/10a6996925de4b25877e75bb73e7bd71` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:15.790872 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1513d23-8ae9-4db9-ae3f-bacab76e49b6 admin admin] RBAC: Authorizing `identity:get_project(project_id=10a6996925de4b25877e75bb73e7bd71)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:44:15.816213 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1513d23-8ae9-4db9-ae3f-bacab76e49b6 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:44:15.818280 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 619/1237] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:44:15 2021] GET /identity/v3/projects/10a6996925de4b25877e75bb73e7bd71 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:44:15.830540 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b161005-3c30-449e-9674-a2c27e3df318 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:44:15.831696 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-0b161005-3c30-449e-9674-a2c27e3df318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:15.938854 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b161005-3c30-449e-9674-a2c27e3df318 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:44:16.020171 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af8f96-e9be-485e-8829-f62735e78ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:44:16.020889 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af8f96-e9be-485e-8829-f62735e78ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:16.021329 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af8f96-e9be-485e-8829-f62735e78ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:16.021836 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af8f96-e9be-485e-8829-f62735e78ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:16.023381 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-b7af8f96-e9be-485e-8829-f62735e78ee6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:16.140563 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af8f96-e9be-485e-8829-f62735e78ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:44:16.167166 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af8f96-e9be-485e-8829-f62735e78ee6 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:44:16.186194 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 619/1238] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:44:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:44:18.695161 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c95d4-e82d-46ba-bf13-e4343638c6a8 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:18.695716 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c95d4-e82d-46ba-bf13-e4343638c6a8 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:18.695716 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c95d4-e82d-46ba-bf13-e4343638c6a8 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:18.697645 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 620/1239] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:44:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:44:18.703010 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce16ee0-c500-479b-9548-ec369fd4420c None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:18.703427 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce16ee0-c500-479b-9548-ec369fd4420c None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:18.703572 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce16ee0-c500-479b-9548-ec369fd4420c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:18.792459 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-3ce16ee0-c500-479b-9548-ec369fd4420c None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:44:18.793624 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-3ce16ee0-c500-479b-9548-ec369fd4420c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:18.896067 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 620/1240] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:44:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:44:18.929265 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c95d4-e82d-46ba-bf13-e4343638c6a8 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:44:18.930712 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-7c7c95d4-e82d-46ba-bf13-e4343638c6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:19.068261 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c95d4-e82d-46ba-bf13-e4343638c6a8 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:44:19.167862 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c56661-4240-4a9c-aa00-b08f7269cc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:44:19.168635 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c56661-4240-4a9c-aa00-b08f7269cc6b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:19.168914 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c56661-4240-4a9c-aa00-b08f7269cc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:19.169186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c56661-4240-4a9c-aa00-b08f7269cc6b admin admin] PATH_INFO: `/v3/projects/10a6996925de4b25877e75bb73e7bd71` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:19.179963 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c56661-4240-4a9c-aa00-b08f7269cc6b admin admin] RBAC: Authorizing `identity:get_project(project_id=10a6996925de4b25877e75bb73e7bd71)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:44:19.206316 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c56661-4240-4a9c-aa00-b08f7269cc6b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:44:19.207851 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 621/1241] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:44:18 2021] GET /identity/v3/projects/10a6996925de4b25877e75bb73e7bd71 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:44:19.219786 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce16ee0-c500-479b-9548-ec369fd4420c None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:44:19.220935 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-3ce16ee0-c500-479b-9548-ec369fd4420c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:19.322726 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce16ee0-c500-479b-9548-ec369fd4420c None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:44:19.402026 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832ab22-048d-4e02-8d10-a2e3e33d65db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:44:19.402593 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832ab22-048d-4e02-8d10-a2e3e33d65db service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:19.402903 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832ab22-048d-4e02-8d10-a2e3e33d65db service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:19.403181 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832ab22-048d-4e02-8d10-a2e3e33d65db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:19.404689 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-a832ab22-048d-4e02-8d10-a2e3e33d65db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:19.524346 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a832ab22-048d-4e02-8d10-a2e3e33d65db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:44:19.550124 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a832ab22-048d-4e02-8d10-a2e3e33d65db service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:44:19.571063 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 621/1242] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:44:19 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:44:22.194832 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ca61b-9369-45bc-911a-6b7a9496eac3 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:22.195324 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ca61b-9369-45bc-911a-6b7a9496eac3 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:22.195324 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ca61b-9369-45bc-911a-6b7a9496eac3 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:22.197213 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 622/1243] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:44:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:44:22.202558 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c64b3-2b6e-48e1-a7df-a0d7bc0c6ae4 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:22.202992 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c64b3-2b6e-48e1-a7df-a0d7bc0c6ae4 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:22.203173 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c64b3-2b6e-48e1-a7df-a0d7bc0c6ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:22.296783 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-9f2c64b3-2b6e-48e1-a7df-a0d7bc0c6ae4 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:44:22.297975 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-9f2c64b3-2b6e-48e1-a7df-a0d7bc0c6ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:22.415684 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 622/1244] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:44:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:44:22.451879 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ca61b-9369-45bc-911a-6b7a9496eac3 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:44:22.453253 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-9f5ca61b-9369-45bc-911a-6b7a9496eac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:22.577773 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ca61b-9369-45bc-911a-6b7a9496eac3 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:44:22.660597 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b7e1d-2d7e-4095-b10f-8380b55e96a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:44:22.661764 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b7e1d-2d7e-4095-b10f-8380b55e96a9 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:22.662062 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b7e1d-2d7e-4095-b10f-8380b55e96a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:22.662432 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b7e1d-2d7e-4095-b10f-8380b55e96a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:22.664001 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-659b7e1d-2d7e-4095-b10f-8380b55e96a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:22.789643 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b7e1d-2d7e-4095-b10f-8380b55e96a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:44:22.814684 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b7e1d-2d7e-4095-b10f-8380b55e96a9 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:44:22.837934 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 623/1245] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:44:22 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:44:24.935492 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae23716-2eeb-4b77-bfc3-8e849a861a23 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:24.936033 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae23716-2eeb-4b77-bfc3-8e849a861a23 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:24.936123 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae23716-2eeb-4b77-bfc3-8e849a861a23 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:24.937823 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 623/1246] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:44:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:44:24.943771 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883d42c-65eb-4b8b-878c-1d67f39c78d0 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:24.944564 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883d42c-65eb-4b8b-878c-1d67f39c78d0 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:24.944845 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883d42c-65eb-4b8b-878c-1d67f39c78d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:25.029445 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-e883d42c-65eb-4b8b-878c-1d67f39c78d0 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:44:25.030820 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-e883d42c-65eb-4b8b-878c-1d67f39c78d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:25.140293 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 624/1247] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:44:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:44:25.175308 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae23716-2eeb-4b77-bfc3-8e849a861a23 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:44:25.177303 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-6ae23716-2eeb-4b77-bfc3-8e849a861a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:25.296582 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae23716-2eeb-4b77-bfc3-8e849a861a23 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:44:25.381459 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355d02a-2faa-41ad-9c18-f453c6cba638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:44:25.382035 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355d02a-2faa-41ad-9c18-f453c6cba638 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:25.382317 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355d02a-2faa-41ad-9c18-f453c6cba638 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:25.382590 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355d02a-2faa-41ad-9c18-f453c6cba638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:25.384138 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-c355d02a-2faa-41ad-9c18-f453c6cba638 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:25.509351 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355d02a-2faa-41ad-9c18-f453c6cba638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:44:25.534910 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355d02a-2faa-41ad-9c18-f453c6cba638 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:44:25.556777 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 624/1248] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:44:25 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:44:27.592028 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166411b6-db32-4987-ac34-0a328e1d7740 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:27.592555 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166411b6-db32-4987-ac34-0a328e1d7740 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:27.593038 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166411b6-db32-4987-ac34-0a328e1d7740 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:27.596272 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 625/1249] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:44:27 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:44:27.601613 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bac1b5-f839-4069-8843-337554d1ac20 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:27.602034 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bac1b5-f839-4069-8843-337554d1ac20 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:27.602219 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bac1b5-f839-4069-8843-337554d1ac20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:27.690868 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-73bac1b5-f839-4069-8843-337554d1ac20 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:44:27.692021 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-73bac1b5-f839-4069-8843-337554d1ac20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:27.795365 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 625/1250] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:44:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:44:27.827231 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166411b6-db32-4987-ac34-0a328e1d7740 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:44:27.828654 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-166411b6-db32-4987-ac34-0a328e1d7740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:27.967160 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166411b6-db32-4987-ac34-0a328e1d7740 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:44:28.067726 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc24b41-0ed4-41cb-a1f0-df6c155e23c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:44:28.068493 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc24b41-0ed4-41cb-a1f0-df6c155e23c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:28.068774 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc24b41-0ed4-41cb-a1f0-df6c155e23c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:28.069048 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc24b41-0ed4-41cb-a1f0-df6c155e23c4 admin admin] PATH_INFO: `/v3/projects/10a6996925de4b25877e75bb73e7bd71` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:28.079608 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc24b41-0ed4-41cb-a1f0-df6c155e23c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=10a6996925de4b25877e75bb73e7bd71)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:44:28.106168 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc24b41-0ed4-41cb-a1f0-df6c155e23c4 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:44:28.107722 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 626/1251] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:44:27 2021] GET /identity/v3/projects/10a6996925de4b25877e75bb73e7bd71 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:44:28.119475 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bac1b5-f839-4069-8843-337554d1ac20 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:44:28.120615 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-73bac1b5-f839-4069-8843-337554d1ac20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:28.223165 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bac1b5-f839-4069-8843-337554d1ac20 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:44:28.386148 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3d7b6-05f5-48a3-aad0-70a4ec2560ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:44:28.386750 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3d7b6-05f5-48a3-aad0-70a4ec2560ee service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:28.387033 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3d7b6-05f5-48a3-aad0-70a4ec2560ee service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:28.387304 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3d7b6-05f5-48a3-aad0-70a4ec2560ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:28.388812 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-eda3d7b6-05f5-48a3-aad0-70a4ec2560ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:28.508327 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3d7b6-05f5-48a3-aad0-70a4ec2560ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:44:28.533602 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3d7b6-05f5-48a3-aad0-70a4ec2560ee service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:44:28.552855 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 626/1252] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:44:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:44:30.736187 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfebb4-ccd3-4add-b52f-c7de5efd396a None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:30.736740 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfebb4-ccd3-4add-b52f-c7de5efd396a None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:30.736740 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfebb4-ccd3-4add-b52f-c7de5efd396a None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:30.738401 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 627/1253] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:44:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:44:30.744189 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99748e2f-e36e-4a92-a690-a419a4f5d25e None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:30.744608 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99748e2f-e36e-4a92-a690-a419a4f5d25e None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:30.744748 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99748e2f-e36e-4a92-a690-a419a4f5d25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:30.828693 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-99748e2f-e36e-4a92-a690-a419a4f5d25e None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:44:30.829838 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-99748e2f-e36e-4a92-a690-a419a4f5d25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:30.934554 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 627/1254] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:44:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:44:30.970615 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfebb4-ccd3-4add-b52f-c7de5efd396a None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:44:30.972060 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-f9cfebb4-ccd3-4add-b52f-c7de5efd396a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:31.088964 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfebb4-ccd3-4add-b52f-c7de5efd396a None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:44:31.170207 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a739005-ff57-4388-9de5-f1bfb536dba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:44:31.170805 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a739005-ff57-4388-9de5-f1bfb536dba4 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:31.171095 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a739005-ff57-4388-9de5-f1bfb536dba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:31.171375 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a739005-ff57-4388-9de5-f1bfb536dba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:31.172889 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-9a739005-ff57-4388-9de5-f1bfb536dba4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:31.294525 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a739005-ff57-4388-9de5-f1bfb536dba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:44:31.320334 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a739005-ff57-4388-9de5-f1bfb536dba4 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:44:31.340219 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 628/1255] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:44:30 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:44:33.340119 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c87f05-c387-43da-89de-bc5baa61d71a None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:33.340595 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c87f05-c387-43da-89de-bc5baa61d71a None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:33.340684 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c87f05-c387-43da-89de-bc5baa61d71a None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:33.342344 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 628/1256] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:44:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:44:33.347770 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942269dd-7b0d-4761-be1f-917d08b18082 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:33.348167 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942269dd-7b0d-4761-be1f-917d08b18082 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:33.348329 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942269dd-7b0d-4761-be1f-917d08b18082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:33.431407 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-942269dd-7b0d-4761-be1f-917d08b18082 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:44:33.432534 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-942269dd-7b0d-4761-be1f-917d08b18082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:33.537172 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 629/1257] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:44:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:44:33.575812 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c87f05-c387-43da-89de-bc5baa61d71a None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:44:33.577267 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-d9c87f05-c387-43da-89de-bc5baa61d71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:33.694680 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c87f05-c387-43da-89de-bc5baa61d71a None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:44:33.776131 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6319ce-3f65-41e7-8296-ba222943c45e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:44:33.776709 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6319ce-3f65-41e7-8296-ba222943c45e service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:33.776997 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6319ce-3f65-41e7-8296-ba222943c45e service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:33.777278 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6319ce-3f65-41e7-8296-ba222943c45e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:33.778849 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-9f6319ce-3f65-41e7-8296-ba222943c45e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:33.900219 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6319ce-3f65-41e7-8296-ba222943c45e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:44:33.925790 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6319ce-3f65-41e7-8296-ba222943c45e service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:44:33.945193 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 629/1258] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:44:33 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:44:36.288683 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae93ce6-8526-483f-9e45-3f3fdda3f84b None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:36.289226 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae93ce6-8526-483f-9e45-3f3fdda3f84b None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:36.289226 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae93ce6-8526-483f-9e45-3f3fdda3f84b None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:36.290825 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 630/1259] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:44:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:44:36.296001 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95252c-23ab-446e-bc11-8ca30dc8fc2b None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:36.296422 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95252c-23ab-446e-bc11-8ca30dc8fc2b None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:36.296567 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95252c-23ab-446e-bc11-8ca30dc8fc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:36.379355 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-6d95252c-23ab-446e-bc11-8ca30dc8fc2b None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:44:36.380682 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-6d95252c-23ab-446e-bc11-8ca30dc8fc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:36.483714 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 630/1260] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:44:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:44:36.532448 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8746226-6be3-4764-9380-a413b6281d83 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:36.532744 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8746226-6be3-4764-9380-a413b6281d83 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:36.533031 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8746226-6be3-4764-9380-a413b6281d83 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:36.534718 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 631/1261] 10.222.0.37 () {54 vars in 963 bytes} [Wed Dec 29 20:44:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:44:36.541174 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12513d7f-7fb3-4d4d-b51e-c9332bde8dfc None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:36.541419 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12513d7f-7fb3-4d4d-b51e-c9332bde8dfc None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:36.541705 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12513d7f-7fb3-4d4d-b51e-c9332bde8dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:36.638970 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-12513d7f-7fb3-4d4d-b51e-c9332bde8dfc None None] MFA Rules not processed for user `55d700adb7db4848a97bab6cf4105481`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:44:36.640136 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-12513d7f-7fb3-4d4d-b51e-c9332bde8dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:36.728080 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 631/1262] 10.222.0.37 () {58 vars in 1060 bytes} [Wed Dec 29 20:44:36 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:44:36.737148 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8746226-6be3-4764-9380-a413b6281d83 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:44:36.740648 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-e8746226-6be3-4764-9380-a413b6281d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:36.865348 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8746226-6be3-4764-9380-a413b6281d83 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:44:36.878497 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f9149-dac8-4668-b02d-898e151ac6af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:44:36.879108 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f9149-dac8-4668-b02d-898e151ac6af service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:36.879394 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f9149-dac8-4668-b02d-898e151ac6af service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:36.880237 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f9149-dac8-4668-b02d-898e151ac6af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:36.881819 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-998f9149-dac8-4668-b02d-898e151ac6af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:36.995304 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f9149-dac8-4668-b02d-898e151ac6af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:44:37.020630 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f9149-dac8-4668-b02d-898e151ac6af service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:44:37.041177 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 632/1263] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:44:36 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:44:41.794828 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de420b-f7c7-49f6-99ae-2f5399483671 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:41.795320 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de420b-f7c7-49f6-99ae-2f5399483671 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:41.795431 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de420b-f7c7-49f6-99ae-2f5399483671 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:41.797112 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 632/1264] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:44:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:44:41.804810 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f27ac6-4aa6-4322-9b1e-0d992e220cbb None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:41.805353 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f27ac6-4aa6-4322-9b1e-0d992e220cbb None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:41.805453 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f27ac6-4aa6-4322-9b1e-0d992e220cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:41.882255 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-64f27ac6-4aa6-4322-9b1e-0d992e220cbb None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:44:41.883357 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-64f27ac6-4aa6-4322-9b1e-0d992e220cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:41.890896 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 633/1265] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:44:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:44:41.931683 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de420b-f7c7-49f6-99ae-2f5399483671 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:44:41.933757 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-15de420b-f7c7-49f6-99ae-2f5399483671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:41.963609 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de420b-f7c7-49f6-99ae-2f5399483671 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:44:41.967153 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facca389-fb37-4f96-952a-77161872703a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:44:41.967728 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facca389-fb37-4f96-952a-77161872703a service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:41.968018 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facca389-fb37-4f96-952a-77161872703a service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:41.968301 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facca389-fb37-4f96-952a-77161872703a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:41.979995 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facca389-fb37-4f96-952a-77161872703a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:44:42.008944 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facca389-fb37-4f96-952a-77161872703a service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:44:42.019264 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 633/1266] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:44:41 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:44:44.843041 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8a4d8-9124-4ad7-be99-0c62bae96c72 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:44.843573 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8a4d8-9124-4ad7-be99-0c62bae96c72 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:44.843684 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8a4d8-9124-4ad7-be99-0c62bae96c72 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:44.845258 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 634/1267] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:44:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:44:44.850460 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7b6ac-6a33-4e4f-af90-261a8305ff7c None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:44.850880 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7b6ac-6a33-4e4f-af90-261a8305ff7c None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:44.851065 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7b6ac-6a33-4e4f-af90-261a8305ff7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:44.873245 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-17f7b6ac-6a33-4e4f-af90-261a8305ff7c None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:44:44.874403 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-17f7b6ac-6a33-4e4f-af90-261a8305ff7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:44.882647 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 634/1268] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:44:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:44:44.920125 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8a4d8-9124-4ad7-be99-0c62bae96c72 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:44:44.930447 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8a4d8-9124-4ad7-be99-0c62bae96c72 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:44:44.933695 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c3eb1-20dc-49fd-a109-2ba9561741da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:44:44.934264 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c3eb1-20dc-49fd-a109-2ba9561741da service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:44.934554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c3eb1-20dc-49fd-a109-2ba9561741da service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:44.934864 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c3eb1-20dc-49fd-a109-2ba9561741da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:44.944005 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c3eb1-20dc-49fd-a109-2ba9561741da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:44:44.969755 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c3eb1-20dc-49fd-a109-2ba9561741da service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:44:44.978671 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 635/1269] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:44:44 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:44:49.368211 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72e62c-39d3-4670-a321-7eba74eb303f None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:49.368635 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72e62c-39d3-4670-a321-7eba74eb303f None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:49.368722 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72e62c-39d3-4670-a321-7eba74eb303f None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:49.370396 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 635/1270] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:44:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:44:49.376169 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4337253-3534-4b04-87f5-33750767331e None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:49.376601 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4337253-3534-4b04-87f5-33750767331e None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:49.378984 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4337253-3534-4b04-87f5-33750767331e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:49.483554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-f4337253-3534-4b04-87f5-33750767331e None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:44:49.484712 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-f4337253-3534-4b04-87f5-33750767331e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:49.491860 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 636/1271] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:44:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:44:49.529930 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72e62c-39d3-4670-a321-7eba74eb303f None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:44:49.540441 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72e62c-39d3-4670-a321-7eba74eb303f None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:44:49.543784 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92c65d-f9dc-4d40-bac0-8f0f7ff25608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:44:49.544444 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92c65d-f9dc-4d40-bac0-8f0f7ff25608 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:49.544826 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92c65d-f9dc-4d40-bac0-8f0f7ff25608 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:49.545168 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92c65d-f9dc-4d40-bac0-8f0f7ff25608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:49.554019 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92c65d-f9dc-4d40-bac0-8f0f7ff25608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:44:49.579732 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92c65d-f9dc-4d40-bac0-8f0f7ff25608 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:44:49.589781 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 636/1272] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:44:49 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:44:53.972294 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038caaa1-6bcb-4a44-9eb8-985d309e3a70 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:53.973097 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038caaa1-6bcb-4a44-9eb8-985d309e3a70 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:53.974643 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038caaa1-6bcb-4a44-9eb8-985d309e3a70 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:53.978407 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 637/1273] 10.222.0.37 () {54 vars in 921 bytes} [Wed Dec 29 20:44:53 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:44:53.984590 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f8489-148c-4959-a962-25ef83eded7f None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:53.985036 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f8489-148c-4959-a962-25ef83eded7f None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:53.985481 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f8489-148c-4959-a962-25ef83eded7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:54.104594 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-0d5f8489-148c-4959-a962-25ef83eded7f None None] MFA Rules not processed for user `25cb71bb64a3456fb2dc02095c487d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:44:54.106134 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-0d5f8489-148c-4959-a962-25ef83eded7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:54.203697 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 637/1274] 10.222.0.37 () {58 vars in 1018 bytes} [Wed Dec 29 20:44:53 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:44:54.583781 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee663e4-7a12-4c31-a482-6afae034e75b None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:54.584069 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee663e4-7a12-4c31-a482-6afae034e75b None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:54.584350 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee663e4-7a12-4c31-a482-6afae034e75b None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:54.586549 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 638/1275] 10.222.0.37 () {54 vars in 921 bytes} [Wed Dec 29 20:44:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:44:54.594462 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbda184-3aff-4f0c-b673-764ad807e5ab None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:54.605524 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbda184-3aff-4f0c-b673-764ad807e5ab None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:54.605886 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbda184-3aff-4f0c-b673-764ad807e5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:54.638425 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-7fbda184-3aff-4f0c-b673-764ad807e5ab None None] MFA Rules not processed for user `25cb71bb64a3456fb2dc02095c487d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:44:54.639935 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-7fbda184-3aff-4f0c-b673-764ad807e5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:54.648304 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 638/1276] 10.222.0.37 () {58 vars in 1018 bytes} [Wed Dec 29 20:44:54 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:44:58.612771 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5f757-d8cb-44cf-a4f3-37e3738576bf None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:58.613317 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5f757-d8cb-44cf-a4f3-37e3738576bf None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:58.613604 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5f757-d8cb-44cf-a4f3-37e3738576bf None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:58.616552 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 639/1277] 10.222.0.37 () {54 vars in 921 bytes} [Wed Dec 29 20:44:58 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:44:58.621562 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b7e2b-e764-48f9-92d8-5551b1a84d2a None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:58.622414 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b7e2b-e764-48f9-92d8-5551b1a84d2a None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:58.622936 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b7e2b-e764-48f9-92d8-5551b1a84d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:58.645668 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-eb3b7e2b-e764-48f9-92d8-5551b1a84d2a None None] MFA Rules not processed for user `25cb71bb64a3456fb2dc02095c487d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:44:58.647181 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-eb3b7e2b-e764-48f9-92d8-5551b1a84d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:44:58.655294 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 639/1278] 10.222.0.37 () {58 vars in 1018 bytes} [Wed Dec 29 20:44:58 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:44:59.991900 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94fb20-5ecf-4bf0-a012-663c56f2b797 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:59.992453 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94fb20-5ecf-4bf0-a012-663c56f2b797 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:59.992453 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94fb20-5ecf-4bf0-a012-663c56f2b797 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:44:59.994014 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 640/1279] 10.222.0.37 () {54 vars in 921 bytes} [Wed Dec 29 20:44:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:44:59.998821 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0d4e1-aa9b-4335-8fd2-b90c55632ef0 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:44:59.999225 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0d4e1-aa9b-4335-8fd2-b90c55632ef0 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:44:59.999393 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0d4e1-aa9b-4335-8fd2-b90c55632ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:00.021195 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-fbb0d4e1-aa9b-4335-8fd2-b90c55632ef0 None None] MFA Rules not processed for user `25cb71bb64a3456fb2dc02095c487d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:45:00.022337 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-fbb0d4e1-aa9b-4335-8fd2-b90c55632ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:45:00.029815 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 640/1280] 10.222.0.37 () {58 vars in 1018 bytes} [Wed Dec 29 20:44:59 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:45:03.313022 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa86f29-9719-4cbe-8cdd-fba724f5a04b None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:03.313397 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa86f29-9719-4cbe-8cdd-fba724f5a04b None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:03.313835 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa86f29-9719-4cbe-8cdd-fba724f5a04b None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:03.315464 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 641/1281] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:45:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:45:03.321411 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345edc6-f28e-4d3e-a1e0-c36b0f42bfae None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:03.321840 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345edc6-f28e-4d3e-a1e0-c36b0f42bfae None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:03.321976 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345edc6-f28e-4d3e-a1e0-c36b0f42bfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:03.345269 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-a345edc6-f28e-4d3e-a1e0-c36b0f42bfae None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:45:03.346427 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-a345edc6-f28e-4d3e-a1e0-c36b0f42bfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:45:03.353402 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 641/1282] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:45:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:45:03.444327 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20a32a-f1d5-4338-bf40-5ae368d8fb29 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:03.444538 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20a32a-f1d5-4338-bf40-5ae368d8fb29 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:03.444823 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20a32a-f1d5-4338-bf40-5ae368d8fb29 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:03.446471 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 642/1283] 10.222.0.37 () {54 vars in 959 bytes} [Wed Dec 29 20:45:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:45:03.451783 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a46ab-45ab-44e1-ab56-f5dac5bf1175 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:03.452078 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a46ab-45ab-44e1-ab56-f5dac5bf1175 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:03.452362 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a46ab-45ab-44e1-ab56-f5dac5bf1175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:03.518273 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-5c2a46ab-45ab-44e1-ab56-f5dac5bf1175 None None] MFA Rules not processed for user `51ef7e54d97a4320bda0c1926d190d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:45:03.519518 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-5c2a46ab-45ab-44e1-ab56-f5dac5bf1175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:45:03.605165 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 642/1284] 10.222.0.37 () {58 vars in 1056 bytes} [Wed Dec 29 20:45:03 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:45:03.613107 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20a32a-f1d5-4338-bf40-5ae368d8fb29 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:45:03.626805 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20a32a-f1d5-4338-bf40-5ae368d8fb29 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:45:03.631656 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0794968-4984-4d1e-9032-e6e11c83f799 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:45:03.632219 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0794968-4984-4d1e-9032-e6e11c83f799 service nova] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:03.632506 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0794968-4984-4d1e-9032-e6e11c83f799 service nova] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:03.632785 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0794968-4984-4d1e-9032-e6e11c83f799 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:03.640600 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0794968-4984-4d1e-9032-e6e11c83f799 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:45:03.666084 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0794968-4984-4d1e-9032-e6e11c83f799 service nova] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:45:03.675018 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 643/1285] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:45:03 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:45:05.832504 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f1f3f-e096-464d-970d-6f9acd424e93 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:05.833499 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f1f3f-e096-464d-970d-6f9acd424e93 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:05.833757 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f1f3f-e096-464d-970d-6f9acd424e93 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:05.835492 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 643/1286] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:45:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:45:05.840602 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a56ff-db37-45d5-86c5-a1b6b3c0184c None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:05.840985 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a56ff-db37-45d5-86c5-a1b6b3c0184c None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:05.841173 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a56ff-db37-45d5-86c5-a1b6b3c0184c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:05.863157 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-2d7a56ff-db37-45d5-86c5-a1b6b3c0184c None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:45:05.864512 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-2d7a56ff-db37-45d5-86c5-a1b6b3c0184c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:45:05.871428 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 644/1287] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:45:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:45:05.964506 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e83de0-3800-4fa6-b9f9-52a6cdb1ed3c None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:05.964797 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e83de0-3800-4fa6-b9f9-52a6cdb1ed3c None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:05.965109 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e83de0-3800-4fa6-b9f9-52a6cdb1ed3c None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:05.966823 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 644/1288] 10.222.0.37 () {54 vars in 959 bytes} [Wed Dec 29 20:45:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:45:05.971860 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53ed26-d555-42c7-99fe-41704498fbc6 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:05.972163 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53ed26-d555-42c7-99fe-41704498fbc6 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:05.972453 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53ed26-d555-42c7-99fe-41704498fbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:05.994340 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-bd53ed26-d555-42c7-99fe-41704498fbc6 None None] MFA Rules not processed for user `51ef7e54d97a4320bda0c1926d190d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:45:05.995502 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-bd53ed26-d555-42c7-99fe-41704498fbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:45:06.003422 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 645/1289] 10.222.0.37 () {58 vars in 1056 bytes} [Wed Dec 29 20:45:05 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:45:06.011412 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e83de0-3800-4fa6-b9f9-52a6cdb1ed3c None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:45:06.024990 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e83de0-3800-4fa6-b9f9-52a6cdb1ed3c None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:45:06.029827 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689f0df-0a34-47d7-8678-82896c1e242a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:45:06.030385 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689f0df-0a34-47d7-8678-82896c1e242a service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:06.030696 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689f0df-0a34-47d7-8678-82896c1e242a service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:06.030984 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689f0df-0a34-47d7-8678-82896c1e242a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:06.038758 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689f0df-0a34-47d7-8678-82896c1e242a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:45:06.064111 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689f0df-0a34-47d7-8678-82896c1e242a service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:45:06.073821 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 645/1290] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:45:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:45:08.332260 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d52c87-3678-40c0-8d8b-531837e685db None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:08.333653 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d52c87-3678-40c0-8d8b-531837e685db None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:08.333957 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d52c87-3678-40c0-8d8b-531837e685db None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:08.335681 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 646/1291] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:45:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:45:08.340719 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab8994-ec4d-484e-b8a0-9adb5b6a447d None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:08.341162 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab8994-ec4d-484e-b8a0-9adb5b6a447d None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:08.341287 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab8994-ec4d-484e-b8a0-9adb5b6a447d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:08.363612 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-5dab8994-ec4d-484e-b8a0-9adb5b6a447d None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:45:08.364840 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-5dab8994-ec4d-484e-b8a0-9adb5b6a447d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:45:08.371662 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 646/1292] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:45:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:45:08.458462 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d52c87-3678-40c0-8d8b-531837e685db None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:45:08.471687 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d52c87-3678-40c0-8d8b-531837e685db None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:45:08.476834 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00455ff-67cd-4fc5-b688-3fa13aacd461 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:45:08.477393 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00455ff-67cd-4fc5-b688-3fa13aacd461 service nova] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:08.477677 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00455ff-67cd-4fc5-b688-3fa13aacd461 service nova] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:08.477981 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00455ff-67cd-4fc5-b688-3fa13aacd461 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:08.485878 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00455ff-67cd-4fc5-b688-3fa13aacd461 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:45:08.512244 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00455ff-67cd-4fc5-b688-3fa13aacd461 service nova] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:45:08.521105 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 647/1293] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:45:08 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:45:10.712177 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6e935-8f7e-4f28-921d-225d67b35560 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:10.712737 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6e935-8f7e-4f28-921d-225d67b35560 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:10.712737 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6e935-8f7e-4f28-921d-225d67b35560 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:10.714430 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 647/1294] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:45:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:45:10.719604 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276c06a-4365-480a-8bee-145af4f9e75d None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:10.720038 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276c06a-4365-480a-8bee-145af4f9e75d None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:10.720210 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276c06a-4365-480a-8bee-145af4f9e75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:10.742685 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-c276c06a-4365-480a-8bee-145af4f9e75d None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:45:10.743858 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c276c06a-4365-480a-8bee-145af4f9e75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:45:10.750737 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 648/1295] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:45:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:45:10.837421 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6e935-8f7e-4f28-921d-225d67b35560 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:45:10.851412 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6e935-8f7e-4f28-921d-225d67b35560 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:45:10.858539 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c5bfc-ab97-4452-8ab5-72cdc84859d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:45:10.859138 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c5bfc-ab97-4452-8ab5-72cdc84859d5 service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:10.859426 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c5bfc-ab97-4452-8ab5-72cdc84859d5 service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:10.859705 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c5bfc-ab97-4452-8ab5-72cdc84859d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:10.867779 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c5bfc-ab97-4452-8ab5-72cdc84859d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:45:10.892828 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c5bfc-ab97-4452-8ab5-72cdc84859d5 service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:45:10.902850 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 648/1296] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:45:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:45:13.146407 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8cffb-a976-440f-828e-7d54a1b22c7e None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:13.146965 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8cffb-a976-440f-828e-7d54a1b22c7e None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:13.146965 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8cffb-a976-440f-828e-7d54a1b22c7e None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:13.148585 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 649/1297] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:45:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:45:13.153787 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea8fc8-2db5-4bbd-9d0e-64878b6b9661 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:13.154185 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea8fc8-2db5-4bbd-9d0e-64878b6b9661 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:13.154357 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea8fc8-2db5-4bbd-9d0e-64878b6b9661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:13.178061 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-86ea8fc8-2db5-4bbd-9d0e-64878b6b9661 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:45:13.179208 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-86ea8fc8-2db5-4bbd-9d0e-64878b6b9661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:45:13.186038 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 649/1298] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:45:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:45:13.272880 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8cffb-a976-440f-828e-7d54a1b22c7e None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:45:13.286725 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8cffb-a976-440f-828e-7d54a1b22c7e None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:45:13.291558 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbff37-958c-4d6c-ae59-ea4e77ed7bd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:45:13.292112 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbff37-958c-4d6c-ae59-ea4e77ed7bd7 service nova] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:13.292412 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbff37-958c-4d6c-ae59-ea4e77ed7bd7 service nova] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:13.292672 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbff37-958c-4d6c-ae59-ea4e77ed7bd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:13.300326 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbff37-958c-4d6c-ae59-ea4e77ed7bd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:45:13.326922 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbff37-958c-4d6c-ae59-ea4e77ed7bd7 service nova] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:45:13.336615 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 650/1299] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:45:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:45:15.391752 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ca8d8-95f1-464f-8719-4413c1b8dd2b None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:15.392276 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ca8d8-95f1-464f-8719-4413c1b8dd2b None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:15.392394 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ca8d8-95f1-464f-8719-4413c1b8dd2b None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:15.393985 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 650/1300] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:45:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:45:15.399660 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0a700-ed90-43d1-adb6-ab355dca9b32 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:15.400055 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0a700-ed90-43d1-adb6-ab355dca9b32 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:15.400223 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0a700-ed90-43d1-adb6-ab355dca9b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:15.422448 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-45c0a700-ed90-43d1-adb6-ab355dca9b32 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:45:15.423602 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-45c0a700-ed90-43d1-adb6-ab355dca9b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:45:15.430991 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 651/1301] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:45:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:45:15.516835 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ca8d8-95f1-464f-8719-4413c1b8dd2b None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:45:15.530232 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ca8d8-95f1-464f-8719-4413c1b8dd2b None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:45:15.534943 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe6af6-d3a1-4265-963d-a1b009531c38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:45:15.536048 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe6af6-d3a1-4265-963d-a1b009531c38 service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:15.536332 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe6af6-d3a1-4265-963d-a1b009531c38 service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:15.536609 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe6af6-d3a1-4265-963d-a1b009531c38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:15.544271 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe6af6-d3a1-4265-963d-a1b009531c38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:45:15.570183 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe6af6-d3a1-4265-963d-a1b009531c38 service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:45:15.579159 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 651/1302] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:45:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:45:17.648046 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2eca7-3284-44d6-95af-794ade102191 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:17.648595 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2eca7-3284-44d6-95af-794ade102191 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:17.648595 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2eca7-3284-44d6-95af-794ade102191 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:17.650267 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 652/1303] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:45:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:45:17.655374 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b39d01-d7b9-4281-8220-5235df6e31bd None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:17.655771 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b39d01-d7b9-4281-8220-5235df6e31bd None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:17.655971 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b39d01-d7b9-4281-8220-5235df6e31bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:17.678428 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-66b39d01-d7b9-4281-8220-5235df6e31bd None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:45:17.679586 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-66b39d01-d7b9-4281-8220-5235df6e31bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:45:17.686317 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 652/1304] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:45:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:45:17.773064 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2eca7-3284-44d6-95af-794ade102191 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:45:17.786746 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2eca7-3284-44d6-95af-794ade102191 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:45:17.791555 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ecbf5-9bd1-4ba6-af1b-ab8534e2d5a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:45:17.792115 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ecbf5-9bd1-4ba6-af1b-ab8534e2d5a3 service nova] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:17.792402 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ecbf5-9bd1-4ba6-af1b-ab8534e2d5a3 service nova] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:17.792681 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ecbf5-9bd1-4ba6-af1b-ab8534e2d5a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:17.800378 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ecbf5-9bd1-4ba6-af1b-ab8534e2d5a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:45:17.826334 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ecbf5-9bd1-4ba6-af1b-ab8534e2d5a3 service nova] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:45:17.835371 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 653/1305] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:45:17 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:45:19.778776 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77620807-b964-428c-bac0-e179d66e1019 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:19.779310 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77620807-b964-428c-bac0-e179d66e1019 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:19.779455 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77620807-b964-428c-bac0-e179d66e1019 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:19.781000 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 653/1306] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:45:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:45:19.786743 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190b03a-b806-4e55-89ef-ced2615470a6 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:19.787177 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190b03a-b806-4e55-89ef-ced2615470a6 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:19.787304 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190b03a-b806-4e55-89ef-ced2615470a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:19.809069 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-0190b03a-b806-4e55-89ef-ced2615470a6 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:45:19.810225 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-0190b03a-b806-4e55-89ef-ced2615470a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:45:19.817043 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 654/1307] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:45:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:45:19.904285 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77620807-b964-428c-bac0-e179d66e1019 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:45:19.918880 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77620807-b964-428c-bac0-e179d66e1019 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:45:19.923701 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eab32e-5863-4126-a9c2-d40e811f53b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:45:19.924267 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eab32e-5863-4126-a9c2-d40e811f53b8 service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:19.924559 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eab32e-5863-4126-a9c2-d40e811f53b8 service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:19.924839 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eab32e-5863-4126-a9c2-d40e811f53b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:19.933115 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eab32e-5863-4126-a9c2-d40e811f53b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:45:19.960026 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eab32e-5863-4126-a9c2-d40e811f53b8 service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:45:19.968879 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 654/1308] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:45:19 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:45:22.016692 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aae950-af45-4c96-9fde-a6592b01df35 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:22.017298 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aae950-af45-4c96-9fde-a6592b01df35 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:22.017298 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aae950-af45-4c96-9fde-a6592b01df35 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:22.018972 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 655/1309] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:45:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:45:22.024758 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c7097-351f-40aa-a65d-906707e5e164 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:22.025154 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c7097-351f-40aa-a65d-906707e5e164 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:22.025321 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c7097-351f-40aa-a65d-906707e5e164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:22.047861 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-f88c7097-351f-40aa-a65d-906707e5e164 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:45:22.049012 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-f88c7097-351f-40aa-a65d-906707e5e164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:45:22.055813 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 655/1310] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:45:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:45:22.142618 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aae950-af45-4c96-9fde-a6592b01df35 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:45:22.156065 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aae950-af45-4c96-9fde-a6592b01df35 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:45:22.161852 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d825a4d-f058-4d96-a741-2ac21550c25c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:45:22.162414 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d825a4d-f058-4d96-a741-2ac21550c25c service nova] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:22.162727 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d825a4d-f058-4d96-a741-2ac21550c25c service nova] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:22.163011 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d825a4d-f058-4d96-a741-2ac21550c25c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:22.170874 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d825a4d-f058-4d96-a741-2ac21550c25c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:45:22.196112 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d825a4d-f058-4d96-a741-2ac21550c25c service nova] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:45:22.205196 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 656/1311] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:45:22 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:45:24.286613 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d430f7-c34f-49d6-8e9b-0c7716661290 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:24.287234 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d430f7-c34f-49d6-8e9b-0c7716661290 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:24.287234 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d430f7-c34f-49d6-8e9b-0c7716661290 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:24.288805 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 656/1312] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:45:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:45:24.293946 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc76bf-adfb-40f1-9436-5c63ab345400 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:24.294388 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc76bf-adfb-40f1-9436-5c63ab345400 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:24.294513 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc76bf-adfb-40f1-9436-5c63ab345400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:24.318024 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-40fc76bf-adfb-40f1-9436-5c63ab345400 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:45:24.319224 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-40fc76bf-adfb-40f1-9436-5c63ab345400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:45:24.326636 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 657/1313] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:45:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:45:24.412830 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d430f7-c34f-49d6-8e9b-0c7716661290 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:45:24.426542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d430f7-c34f-49d6-8e9b-0c7716661290 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:45:24.431464 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e05632-e7cb-4af0-b384-0a0a2181f052 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:45:24.432027 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e05632-e7cb-4af0-b384-0a0a2181f052 service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:24.432313 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e05632-e7cb-4af0-b384-0a0a2181f052 service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:24.432591 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e05632-e7cb-4af0-b384-0a0a2181f052 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:24.440294 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e05632-e7cb-4af0-b384-0a0a2181f052 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:45:24.466322 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e05632-e7cb-4af0-b384-0a0a2181f052 service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:45:24.475221 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 657/1314] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:45:24 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:45:26.524287 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd7b35-6926-47d6-bb9c-07069ffd7dba None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:26.524850 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd7b35-6926-47d6-bb9c-07069ffd7dba None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:26.524850 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd7b35-6926-47d6-bb9c-07069ffd7dba None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:26.526558 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 658/1315] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:45:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:45:26.531900 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5253f-d7d4-41b6-872b-bcd85e0219d7 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:26.532326 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5253f-d7d4-41b6-872b-bcd85e0219d7 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:26.532465 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5253f-d7d4-41b6-872b-bcd85e0219d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:26.555198 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-5ed5253f-d7d4-41b6-872b-bcd85e0219d7 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:45:26.556327 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-5ed5253f-d7d4-41b6-872b-bcd85e0219d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:45:26.563287 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 658/1316] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:45:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:45:26.652016 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd7b35-6926-47d6-bb9c-07069ffd7dba None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:45:26.666295 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd7b35-6926-47d6-bb9c-07069ffd7dba None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:45:26.671110 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b65458-31a0-4e4f-8a46-80a79d47f38f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:45:26.671672 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b65458-31a0-4e4f-8a46-80a79d47f38f service nova] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:26.671955 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b65458-31a0-4e4f-8a46-80a79d47f38f service nova] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:26.672230 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b65458-31a0-4e4f-8a46-80a79d47f38f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:26.680009 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b65458-31a0-4e4f-8a46-80a79d47f38f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:45:26.704969 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b65458-31a0-4e4f-8a46-80a79d47f38f service nova] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:45:26.714219 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 659/1317] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:45:26 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:45:28.773473 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3e3e8-c926-4a3c-9fb3-c176c754ff23 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:28.774015 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3e3e8-c926-4a3c-9fb3-c176c754ff23 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:28.774015 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3e3e8-c926-4a3c-9fb3-c176c754ff23 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:28.775733 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 659/1318] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:45:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:45:28.780902 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7430a0-1acf-4f06-b9bc-7d9d92783729 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:28.781332 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7430a0-1acf-4f06-b9bc-7d9d92783729 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:28.781502 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7430a0-1acf-4f06-b9bc-7d9d92783729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:28.803869 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-5f7430a0-1acf-4f06-b9bc-7d9d92783729 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:45:28.804990 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-5f7430a0-1acf-4f06-b9bc-7d9d92783729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:45:28.811729 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 660/1319] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:45:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:45:28.897840 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3e3e8-c926-4a3c-9fb3-c176c754ff23 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:45:28.911004 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3e3e8-c926-4a3c-9fb3-c176c754ff23 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:45:28.915804 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e5655-9125-405e-ae73-9587219816c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:45:28.916362 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e5655-9125-405e-ae73-9587219816c2 service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:28.916650 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e5655-9125-405e-ae73-9587219816c2 service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:28.916931 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e5655-9125-405e-ae73-9587219816c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:28.925081 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e5655-9125-405e-ae73-9587219816c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:45:28.951949 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e5655-9125-405e-ae73-9587219816c2 service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:45:28.961037 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 660/1320] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:45:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:45:39.088131 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc049f-831d-4aec-9fe2-b38272cffd88 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:39.088734 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc049f-831d-4aec-9fe2-b38272cffd88 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:39.088734 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc049f-831d-4aec-9fe2-b38272cffd88 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:39.090374 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 661/1321] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:45:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:45:39.095576 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d17b77-9e19-4f04-bbde-202dc354aa11 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:39.096025 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d17b77-9e19-4f04-bbde-202dc354aa11 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:39.096131 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d17b77-9e19-4f04-bbde-202dc354aa11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:39.119129 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-49d17b77-9e19-4f04-bbde-202dc354aa11 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:45:39.120260 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-49d17b77-9e19-4f04-bbde-202dc354aa11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:45:39.127211 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 661/1322] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:45:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:45:39.188796 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaf229-a8a9-4895-bec4-12ec1f81d069 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:39.189016 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaf229-a8a9-4895-bec4-12ec1f81d069 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:39.189302 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaf229-a8a9-4895-bec4-12ec1f81d069 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:39.191197 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 662/1323] 10.222.0.37 () {54 vars in 961 bytes} [Wed Dec 29 20:45:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:45:39.196183 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c7998-f0db-4c08-963b-c5cb27dd58d0 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:39.196477 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c7998-f0db-4c08-963b-c5cb27dd58d0 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:39.196759 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c7998-f0db-4c08-963b-c5cb27dd58d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:39.263108 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-433c7998-f0db-4c08-963b-c5cb27dd58d0 None None] MFA Rules not processed for user `72f5c4b1a0e942ae9a16cda3b34e0cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:45:39.264235 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-433c7998-f0db-4c08-963b-c5cb27dd58d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:45:39.330136 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 662/1324] 10.222.0.37 () {58 vars in 1058 bytes} [Wed Dec 29 20:45:39 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:45:39.337712 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eaf229-a8a9-4895-bec4-12ec1f81d069 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:45:39.348872 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eaf229-a8a9-4895-bec4-12ec1f81d069 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:45:39.352178 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb67f49-ef70-4e7e-be27-aea0890a8d72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:45:39.352773 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb67f49-ef70-4e7e-be27-aea0890a8d72 service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:39.353062 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb67f49-ef70-4e7e-be27-aea0890a8d72 service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:39.353344 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb67f49-ef70-4e7e-be27-aea0890a8d72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:39.361948 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb67f49-ef70-4e7e-be27-aea0890a8d72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:45:39.387435 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb67f49-ef70-4e7e-be27-aea0890a8d72 service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:45:39.397554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 663/1325] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:45:39 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:45:56.082759 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583fcb2-dee5-4220-b839-0db80bab0a43 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:56.083310 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583fcb2-dee5-4220-b839-0db80bab0a43 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:56.083310 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583fcb2-dee5-4220-b839-0db80bab0a43 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:56.085028 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 663/1326] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:45:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:45:56.091194 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc6402-eeb9-4728-a93b-a177f4e9b001 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:56.091625 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc6402-eeb9-4728-a93b-a177f4e9b001 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:56.091765 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc6402-eeb9-4728-a93b-a177f4e9b001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:56.114148 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-11cc6402-eeb9-4728-a93b-a177f4e9b001 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:45:56.115325 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-11cc6402-eeb9-4728-a93b-a177f4e9b001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:45:56.122670 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 664/1327] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:45:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:45:56.184042 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb83ba-2ccc-464e-942e-935efb9d4a7f None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:56.184333 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb83ba-2ccc-464e-942e-935efb9d4a7f None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:56.184623 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb83ba-2ccc-464e-942e-935efb9d4a7f None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:56.186289 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 664/1328] 10.222.0.37 () {54 vars in 956 bytes} [Wed Dec 29 20:45:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:45:56.191834 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4276c-509b-4eb5-b1e7-83d68fa81a0f None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:56.192126 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4276c-509b-4eb5-b1e7-83d68fa81a0f None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:56.192407 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4276c-509b-4eb5-b1e7-83d68fa81a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:56.264932 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-e6b4276c-509b-4eb5-b1e7-83d68fa81a0f None None] MFA Rules not processed for user `f1976a528ee24585bcaccc83e308fec0`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:45:56.266068 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-e6b4276c-509b-4eb5-b1e7-83d68fa81a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:45:56.331650 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 665/1329] 10.222.0.37 () {58 vars in 1053 bytes} [Wed Dec 29 20:45:56 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:45:56.341209 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb83ba-2ccc-464e-942e-935efb9d4a7f None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:45:56.351478 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb83ba-2ccc-464e-942e-935efb9d4a7f None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:45:56.355310 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b3f3f-49ee-4db5-8214-5df03b291f4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1976a528ee24585bcaccc83e308fec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:45:56.355871 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b3f3f-49ee-4db5-8214-5df03b291f4f service glance] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:56.356159 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b3f3f-49ee-4db5-8214-5df03b291f4f service glance] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:56.356439 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b3f3f-49ee-4db5-8214-5df03b291f4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:56.364868 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b3f3f-49ee-4db5-8214-5df03b291f4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:45:56.390099 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b3f3f-49ee-4db5-8214-5df03b291f4f service glance] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:45:56.399357 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 665/1330] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:45:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:45:56.775415 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b266c-9f5d-47eb-b8e9-f76021d765af None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:56.775711 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b266c-9f5d-47eb-b8e9-f76021d765af None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:56.775993 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b266c-9f5d-47eb-b8e9-f76021d765af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:56.842423 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-3e9b266c-9f5d-47eb-b8e9-f76021d765af None None] MFA Rules not processed for user `1959af22edbf47cd8afca70831d476c0`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:45:56.843580 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-3e9b266c-9f5d-47eb-b8e9-f76021d765af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:45:56.915109 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 666/1331] 10.222.0.37 () {58 vars in 1014 bytes} [Wed Dec 29 20:45:56 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:45:56.954898 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecd3f8-7cf0-4995-8170-e18132d4f59d None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:56.955199 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecd3f8-7cf0-4995-8170-e18132d4f59d None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:56.955482 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecd3f8-7cf0-4995-8170-e18132d4f59d None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:56.957152 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 666/1332] 10.222.0.37 () {54 vars in 942 bytes} [Wed Dec 29 20:45:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:45:56.963413 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835adc52-9806-4dee-a8dc-38dc5feae3ba None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:56.963709 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835adc52-9806-4dee-a8dc-38dc5feae3ba None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:56.963992 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835adc52-9806-4dee-a8dc-38dc5feae3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:57.030748 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-835adc52-9806-4dee-a8dc-38dc5feae3ba None None] MFA Rules not processed for user `cbd2861e377640c9b76d0dfb08cf088e`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:45:57.031806 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-835adc52-9806-4dee-a8dc-38dc5feae3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:45:57.109120 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 667/1333] 10.222.0.37 () {58 vars in 1039 bytes} [Wed Dec 29 20:45:56 2021] POST /identity/v3/auth/tokens => generated 3734 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:45:57.117571 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecd3f8-7cf0-4995-8170-e18132d4f59d None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:45:57.130557 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecd3f8-7cf0-4995-8170-e18132d4f59d None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:45:57.135715 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499298b-95e5-4ae4-b0eb-69157ee97677 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd2861e377640c9b76d0dfb08cf088e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:45:57.136275 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499298b-95e5-4ae4-b0eb-69157ee97677 service swift] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:45:57.136564 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499298b-95e5-4ae4-b0eb-69157ee97677 service swift] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:45:57.136844 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499298b-95e5-4ae4-b0eb-69157ee97677 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:45:57.144516 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499298b-95e5-4ae4-b0eb-69157ee97677 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:45:57.169581 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499298b-95e5-4ae4-b0eb-69157ee97677 service swift] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:45:57.177159 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 667/1334] 10.222.0.37 () {60 vars in 1384 bytes} [Wed Dec 29 20:45:57 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 29 20:46:16.112066 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c66e3-ab68-4c7e-af81-550e59361162 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:16.112679 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c66e3-ab68-4c7e-af81-550e59361162 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:16.112679 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c66e3-ab68-4c7e-af81-550e59361162 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:16.114277 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 668/1335] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:46:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:46:16.120016 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7b361-dc38-4591-8dcc-d19cd51d10a0 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:16.120457 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7b361-dc38-4591-8dcc-d19cd51d10a0 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:16.120558 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7b361-dc38-4591-8dcc-d19cd51d10a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:16.143103 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-4fa7b361-dc38-4591-8dcc-d19cd51d10a0 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:46:16.144191 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-4fa7b361-dc38-4591-8dcc-d19cd51d10a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:46:16.151049 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 668/1336] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:46:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:46:16.173675 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c66e3-ab68-4c7e-af81-550e59361162 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:16.185836 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c66e3-ab68-4c7e-af81-550e59361162 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:16.189766 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ff9dc-e129-41ed-81f5-c82d0ff51b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:16.190337 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ff9dc-e129-41ed-81f5-c82d0ff51b15 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:16.190626 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ff9dc-e129-41ed-81f5-c82d0ff51b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:16.190934 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ff9dc-e129-41ed-81f5-c82d0ff51b15 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:16.191629 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ff9dc-e129-41ed-81f5-c82d0ff51b15 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:16.216954 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ff9dc-e129-41ed-81f5-c82d0ff51b15 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:16.232251 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 669/1337] 10.222.0.37 () {56 vars in 1108 bytes} [Wed Dec 29 20:46:16 2021] GET /identity/v3/projects => generated 2553 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:46:18.158641 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1cb76-5f8f-4bb2-afc4-468fc3e61263 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:18.159198 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1cb76-5f8f-4bb2-afc4-468fc3e61263 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:18.159198 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1cb76-5f8f-4bb2-afc4-468fc3e61263 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:18.160836 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 669/1338] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:46:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:46:18.166573 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2e6c5-a521-45cb-8dc1-9578b512d053 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:18.167038 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2e6c5-a521-45cb-8dc1-9578b512d053 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:18.167166 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2e6c5-a521-45cb-8dc1-9578b512d053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:18.189076 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-3af2e6c5-a521-45cb-8dc1-9578b512d053 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:46:18.190225 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-3af2e6c5-a521-45cb-8dc1-9578b512d053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:46:18.197776 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 670/1339] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:46:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:46:18.219775 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1cb76-5f8f-4bb2-afc4-468fc3e61263 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:18.231846 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1cb76-5f8f-4bb2-afc4-468fc3e61263 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:18.236334 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599d97b-e615-426f-bde7-ddafcc12ce27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:18.237265 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599d97b-e615-426f-bde7-ddafcc12ce27 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:18.237652 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599d97b-e615-426f-bde7-ddafcc12ce27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:18.238031 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599d97b-e615-426f-bde7-ddafcc12ce27 admin admin] PATH_INFO: `/v3/projects/10a6996925de4b25877e75bb73e7bd71` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:18.252343 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599d97b-e615-426f-bde7-ddafcc12ce27 admin admin] RBAC: Authorizing `identity:get_project(project_id=10a6996925de4b25877e75bb73e7bd71)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:18.278237 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599d97b-e615-426f-bde7-ddafcc12ce27 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:18.279834 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 670/1340] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:46:18 2021] GET /identity/v3/projects/10a6996925de4b25877e75bb73e7bd71 => generated 298 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:46:18.286638 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2e6c5-a521-45cb-8dc1-9578b512d053 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:18.295509 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2e6c5-a521-45cb-8dc1-9578b512d053 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:18.299837 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5d68d-87c1-4d1a-8cea-7527c906a1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:18.300441 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5d68d-87c1-4d1a-8cea-7527c906a1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:18.300728 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5d68d-87c1-4d1a-8cea-7527c906a1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:18.301006 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5d68d-87c1-4d1a-8cea-7527c906a1c6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:18.301724 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5d68d-87c1-4d1a-8cea-7527c906a1c6 admin admin] RBAC: Adding query filter params (scope.project.id=10a6996925de4b25877e75bb73e7bd71) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:46:18.302020 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5d68d-87c1-4d1a-8cea-7527c906a1c6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:18.329867 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5d68d-87c1-4d1a-8cea-7527c906a1c6 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:18.336647 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 671/1341] 10.222.0.37 () {56 vars in 1231 bytes} [Wed Dec 29 20:46:18 2021] GET /identity/v3/role_assignments?scope.project.id=10a6996925de4b25877e75bb73e7bd71 => generated 1934 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:46:18.342512 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599d97b-e615-426f-bde7-ddafcc12ce27 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:18.351934 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599d97b-e615-426f-bde7-ddafcc12ce27 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:18.356020 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bc20f-f1e8-4047-8afc-0da313f5cad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:18.356809 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bc20f-f1e8-4047-8afc-0da313f5cad8 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:18.357100 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bc20f-f1e8-4047-8afc-0da313f5cad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:18.357379 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bc20f-f1e8-4047-8afc-0da313f5cad8 admin admin] PATH_INFO: `/v3/users/03328de5575045b39a05fe986384adab` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:18.376213 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bc20f-f1e8-4047-8afc-0da313f5cad8 admin admin] RBAC: Authorizing `identity:get_user(user_id=03328de5575045b39a05fe986384adab)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:18.402799 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bc20f-f1e8-4047-8afc-0da313f5cad8 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:18.404344 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 671/1342] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:46:18 2021] GET /identity/v3/users/03328de5575045b39a05fe986384adab => generated 275 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:46:18.410139 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5d68d-87c1-4d1a-8cea-7527c906a1c6 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:18.420236 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5d68d-87c1-4d1a-8cea-7527c906a1c6 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:18.424247 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75c321-bbb2-477f-bc35-a5e235355847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:18.425017 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75c321-bbb2-477f-bc35-a5e235355847 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:18.425300 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75c321-bbb2-477f-bc35-a5e235355847 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:18.425574 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75c321-bbb2-477f-bc35-a5e235355847 admin admin] PATH_INFO: `/v3/users/a36a939159da4f1da66be9e4aad8ddd2` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:18.426624 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75c321-bbb2-477f-bc35-a5e235355847 admin admin] RBAC: Authorizing `identity:get_user(user_id=a36a939159da4f1da66be9e4aad8ddd2)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:18.452802 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75c321-bbb2-477f-bc35-a5e235355847 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:18.454235 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 672/1343] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:46:18 2021] GET /identity/v3/users/a36a939159da4f1da66be9e4aad8ddd2 => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:46:20.489222 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ef09b-eea4-4e53-9a15-28ffc00ffe06 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:20.489783 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ef09b-eea4-4e53-9a15-28ffc00ffe06 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:20.489783 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ef09b-eea4-4e53-9a15-28ffc00ffe06 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:20.491484 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 672/1344] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:46:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:46:20.497079 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900335be-319a-4b03-9eb0-74da5c509e45 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:20.497500 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900335be-319a-4b03-9eb0-74da5c509e45 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:20.497641 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900335be-319a-4b03-9eb0-74da5c509e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:20.520665 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-900335be-319a-4b03-9eb0-74da5c509e45 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:46:20.521788 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-900335be-319a-4b03-9eb0-74da5c509e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:46:20.529240 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 673/1345] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:46:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:46:20.551235 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ef09b-eea4-4e53-9a15-28ffc00ffe06 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:20.563410 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ef09b-eea4-4e53-9a15-28ffc00ffe06 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:20.567379 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41301506-85fa-476f-9f5d-41bb03ed38d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:20.568144 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41301506-85fa-476f-9f5d-41bb03ed38d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:20.568431 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41301506-85fa-476f-9f5d-41bb03ed38d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:20.568712 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41301506-85fa-476f-9f5d-41bb03ed38d1 admin admin] PATH_INFO: `/v3/projects/3254768b950741409b4b08384a7fc310` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:20.581605 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41301506-85fa-476f-9f5d-41bb03ed38d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=3254768b950741409b4b08384a7fc310)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:20.608223 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41301506-85fa-476f-9f5d-41bb03ed38d1 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:20.609753 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 673/1346] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:46:20 2021] GET /identity/v3/projects/3254768b950741409b4b08384a7fc310 => generated 311 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:46:20.615621 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900335be-319a-4b03-9eb0-74da5c509e45 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:20.624308 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900335be-319a-4b03-9eb0-74da5c509e45 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:20.628363 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd09c4-b982-4f5f-842c-e8f3871cdb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:20.628928 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd09c4-b982-4f5f-842c-e8f3871cdb50 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:20.629213 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd09c4-b982-4f5f-842c-e8f3871cdb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:20.629491 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd09c4-b982-4f5f-842c-e8f3871cdb50 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:20.630199 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd09c4-b982-4f5f-842c-e8f3871cdb50 admin admin] RBAC: Adding query filter params (scope.project.id=3254768b950741409b4b08384a7fc310) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:46:20.630491 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd09c4-b982-4f5f-842c-e8f3871cdb50 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:20.657435 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd09c4-b982-4f5f-842c-e8f3871cdb50 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:20.663246 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 674/1347] 10.222.0.37 () {56 vars in 1231 bytes} [Wed Dec 29 20:46:20 2021] GET /identity/v3/role_assignments?scope.project.id=3254768b950741409b4b08384a7fc310 => generated 877 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:46:20.669662 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41301506-85fa-476f-9f5d-41bb03ed38d1 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:20.678870 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41301506-85fa-476f-9f5d-41bb03ed38d1 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:20.682987 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2dcb74-9682-4952-bdb4-35c53695a1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:20.683763 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dcb74-9682-4952-bdb4-35c53695a1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:20.684047 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dcb74-9682-4952-bdb4-35c53695a1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:20.684323 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dcb74-9682-4952-bdb4-35c53695a1e6 admin admin] PATH_INFO: `/v3/users/400a099d23df4df7937d86e2e5b3c769` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:20.703401 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2dcb74-9682-4952-bdb4-35c53695a1e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=400a099d23df4df7937d86e2e5b3c769)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:20.729466 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2dcb74-9682-4952-bdb4-35c53695a1e6 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:20.730983 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 674/1348] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:46:20 2021] GET /identity/v3/users/400a099d23df4df7937d86e2e5b3c769 => generated 286 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:46:20.736689 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd09c4-b982-4f5f-842c-e8f3871cdb50 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:20.746002 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd09c4-b982-4f5f-842c-e8f3871cdb50 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:20.750075 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8df7c7-7e42-4b6d-9a73-216ca3569a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:20.750886 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8df7c7-7e42-4b6d-9a73-216ca3569a70 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:20.751169 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8df7c7-7e42-4b6d-9a73-216ca3569a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:20.751441 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8df7c7-7e42-4b6d-9a73-216ca3569a70 admin admin] PATH_INFO: `/v3/users/93a806b10e374e72aee28b4d432fde06` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:20.770917 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8df7c7-7e42-4b6d-9a73-216ca3569a70 admin admin] RBAC: Authorizing `identity:get_user(user_id=93a806b10e374e72aee28b4d432fde06)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:20.796682 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8df7c7-7e42-4b6d-9a73-216ca3569a70 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:20.798204 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 675/1349] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:46:20 2021] GET /identity/v3/users/93a806b10e374e72aee28b4d432fde06 => generated 285 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:46:22.833085 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c79524-be30-41d2-97d2-d9a738cbc1c5 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:22.833624 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c79524-be30-41d2-97d2-d9a738cbc1c5 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:22.833702 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c79524-be30-41d2-97d2-d9a738cbc1c5 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:22.836167 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 675/1350] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:46:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:46:22.841426 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf493f-634d-4992-aa31-97c49c2164f1 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:22.841903 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf493f-634d-4992-aa31-97c49c2164f1 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:22.841984 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf493f-634d-4992-aa31-97c49c2164f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:22.865333 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-83cf493f-634d-4992-aa31-97c49c2164f1 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:46:22.866566 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-83cf493f-634d-4992-aa31-97c49c2164f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:46:22.886885 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 676/1351] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:46:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:46:22.895904 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c79524-be30-41d2-97d2-d9a738cbc1c5 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:22.908325 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c79524-be30-41d2-97d2-d9a738cbc1c5 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:22.912384 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008ffa8-7fb0-4208-9039-172eaf58e612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:22.913267 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008ffa8-7fb0-4208-9039-172eaf58e612 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:22.913556 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008ffa8-7fb0-4208-9039-172eaf58e612 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:22.914490 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008ffa8-7fb0-4208-9039-172eaf58e612 admin admin] PATH_INFO: `/v3/projects/51478d7b99934b4da1d0ead6c2df4867` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:22.927310 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008ffa8-7fb0-4208-9039-172eaf58e612 admin admin] RBAC: Authorizing `identity:get_project(project_id=51478d7b99934b4da1d0ead6c2df4867)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:22.954173 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008ffa8-7fb0-4208-9039-172eaf58e612 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:22.955877 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 676/1352] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:46:22 2021] GET /identity/v3/projects/51478d7b99934b4da1d0ead6c2df4867 => generated 361 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:46:22.962600 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf493f-634d-4992-aa31-97c49c2164f1 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:22.971435 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf493f-634d-4992-aa31-97c49c2164f1 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:22.975491 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26216b-c006-4b10-b1e2-fcf4d99c1b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:22.976058 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26216b-c006-4b10-b1e2-fcf4d99c1b64 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:22.976491 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26216b-c006-4b10-b1e2-fcf4d99c1b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:22.976855 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26216b-c006-4b10-b1e2-fcf4d99c1b64 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:22.977574 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26216b-c006-4b10-b1e2-fcf4d99c1b64 admin admin] RBAC: Adding query filter params (scope.project.id=51478d7b99934b4da1d0ead6c2df4867) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:46:22.977869 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26216b-c006-4b10-b1e2-fcf4d99c1b64 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:23.003176 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26216b-c006-4b10-b1e2-fcf4d99c1b64 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:23.009144 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 677/1353] 10.222.0.37 () {56 vars in 1231 bytes} [Wed Dec 29 20:46:22 2021] GET /identity/v3/role_assignments?scope.project.id=51478d7b99934b4da1d0ead6c2df4867 => generated 526 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:46:23.014821 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008ffa8-7fb0-4208-9039-172eaf58e612 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:23.024640 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008ffa8-7fb0-4208-9039-172eaf58e612 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:23.028713 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d556675-9250-43b9-9244-71412b1ddb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:23.029498 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d556675-9250-43b9-9244-71412b1ddb78 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:23.029783 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d556675-9250-43b9-9244-71412b1ddb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:23.030062 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d556675-9250-43b9-9244-71412b1ddb78 admin admin] PATH_INFO: `/v3/users/b9f5a221ce5441729df14b52a271f9b0` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:23.048306 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d556675-9250-43b9-9244-71412b1ddb78 admin admin] RBAC: Authorizing `identity:get_user(user_id=b9f5a221ce5441729df14b52a271f9b0)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:23.074800 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d556675-9250-43b9-9244-71412b1ddb78 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:23.076276 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 677/1354] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:46:23 2021] GET /identity/v3/users/b9f5a221ce5441729df14b52a271f9b0 => generated 311 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:46:25.057093 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db4736-2a93-4353-beed-e486c6340e14 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:25.057636 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db4736-2a93-4353-beed-e486c6340e14 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:25.057729 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db4736-2a93-4353-beed-e486c6340e14 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:25.059404 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 678/1355] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:46:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:46:25.064644 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9948b96-52aa-42ee-b5e8-941cac12609c None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:25.065070 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9948b96-52aa-42ee-b5e8-941cac12609c None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:25.065207 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9948b96-52aa-42ee-b5e8-941cac12609c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:25.088457 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-b9948b96-52aa-42ee-b5e8-941cac12609c None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:46:25.089610 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-b9948b96-52aa-42ee-b5e8-941cac12609c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:46:25.096378 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 678/1356] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:46:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:46:25.119587 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db4736-2a93-4353-beed-e486c6340e14 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:25.132384 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db4736-2a93-4353-beed-e486c6340e14 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:25.137074 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd2639-11d4-4a27-9055-0052090e7d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:25.137816 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd2639-11d4-4a27-9055-0052090e7d4f admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:25.138102 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd2639-11d4-4a27-9055-0052090e7d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:25.138383 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd2639-11d4-4a27-9055-0052090e7d4f admin admin] PATH_INFO: `/v3/projects/9d612e74acbd4ec5ba77fbe2eb639fcf` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:25.139497 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd2639-11d4-4a27-9055-0052090e7d4f admin admin] RBAC: Authorizing `identity:get_project(project_id=9d612e74acbd4ec5ba77fbe2eb639fcf)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:25.165065 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd2639-11d4-4a27-9055-0052090e7d4f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:25.166569 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 679/1357] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:46:25 2021] GET /identity/v3/projects/9d612e74acbd4ec5ba77fbe2eb639fcf => generated 344 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:46:25.172265 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9948b96-52aa-42ee-b5e8-941cac12609c None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:25.181679 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9948b96-52aa-42ee-b5e8-941cac12609c None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:25.185793 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1a042-871e-4be7-b3e5-2505fe018a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:25.186362 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1a042-871e-4be7-b3e5-2505fe018a10 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:25.186671 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1a042-871e-4be7-b3e5-2505fe018a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:25.186956 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1a042-871e-4be7-b3e5-2505fe018a10 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:25.187681 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1a042-871e-4be7-b3e5-2505fe018a10 admin admin] RBAC: Adding query filter params (scope.project.id=9d612e74acbd4ec5ba77fbe2eb639fcf) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:46:25.187979 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1a042-871e-4be7-b3e5-2505fe018a10 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:25.213825 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1a042-871e-4be7-b3e5-2505fe018a10 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:25.219487 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 679/1358] 10.222.0.37 () {56 vars in 1231 bytes} [Wed Dec 29 20:46:25 2021] GET /identity/v3/role_assignments?scope.project.id=9d612e74acbd4ec5ba77fbe2eb639fcf => generated 879 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:46:25.224946 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd2639-11d4-4a27-9055-0052090e7d4f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:25.234969 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd2639-11d4-4a27-9055-0052090e7d4f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:25.239135 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed26c9-9d9f-4d03-9436-7e66f06c09e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:25.239938 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed26c9-9d9f-4d03-9436-7e66f06c09e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:25.240227 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed26c9-9d9f-4d03-9436-7e66f06c09e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:25.240508 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed26c9-9d9f-4d03-9436-7e66f06c09e7 admin admin] PATH_INFO: `/v3/users/a36a939159da4f1da66be9e4aad8ddd2` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:25.241610 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed26c9-9d9f-4d03-9436-7e66f06c09e7 admin admin] RBAC: Authorizing `identity:get_user(user_id=a36a939159da4f1da66be9e4aad8ddd2)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:25.267410 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed26c9-9d9f-4d03-9436-7e66f06c09e7 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:25.268860 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 680/1359] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:46:25 2021] GET /identity/v3/users/a36a939159da4f1da66be9e4aad8ddd2 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:46:27.241502 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218295f-f44a-41df-83eb-4e9b2a7cccec None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:27.242599 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218295f-f44a-41df-83eb-4e9b2a7cccec None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:27.242599 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218295f-f44a-41df-83eb-4e9b2a7cccec None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:27.244515 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 680/1360] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:46:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:46:27.249904 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c95193-2bff-41bd-bf20-3d815ede6412 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:27.250298 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c95193-2bff-41bd-bf20-3d815ede6412 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:27.250469 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c95193-2bff-41bd-bf20-3d815ede6412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:27.272834 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-f5c95193-2bff-41bd-bf20-3d815ede6412 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:46:27.273970 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-f5c95193-2bff-41bd-bf20-3d815ede6412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:46:27.280952 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 681/1361] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:46:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:46:27.302596 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218295f-f44a-41df-83eb-4e9b2a7cccec None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:27.314946 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218295f-f44a-41df-83eb-4e9b2a7cccec None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:27.318931 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74f3c4-3d47-437e-86b1-24e0e08f9ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:27.319719 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74f3c4-3d47-437e-86b1-24e0e08f9ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:27.320678 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74f3c4-3d47-437e-86b1-24e0e08f9ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:27.321016 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74f3c4-3d47-437e-86b1-24e0e08f9ad7 admin admin] PATH_INFO: `/v3/projects/d597e08c87414635a5cee6f44e4de1ec` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:27.333413 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74f3c4-3d47-437e-86b1-24e0e08f9ad7 admin admin] RBAC: Authorizing `identity:get_project(project_id=d597e08c87414635a5cee6f44e4de1ec)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:27.358948 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74f3c4-3d47-437e-86b1-24e0e08f9ad7 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:27.360510 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 681/1362] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:46:27 2021] GET /identity/v3/projects/d597e08c87414635a5cee6f44e4de1ec => generated 312 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:46:27.366173 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c95193-2bff-41bd-bf20-3d815ede6412 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:27.375521 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c95193-2bff-41bd-bf20-3d815ede6412 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:27.379664 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03424784-3af6-43c5-a356-b35326343f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:27.380233 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03424784-3af6-43c5-a356-b35326343f2c admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:27.380519 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03424784-3af6-43c5-a356-b35326343f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:27.380801 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03424784-3af6-43c5-a356-b35326343f2c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:27.381517 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03424784-3af6-43c5-a356-b35326343f2c admin admin] RBAC: Adding query filter params (scope.project.id=d597e08c87414635a5cee6f44e4de1ec) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:46:27.381812 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03424784-3af6-43c5-a356-b35326343f2c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:27.407782 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03424784-3af6-43c5-a356-b35326343f2c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:27.413144 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 682/1363] 10.222.0.37 () {56 vars in 1231 bytes} [Wed Dec 29 20:46:27 2021] GET /identity/v3/role_assignments?scope.project.id=d597e08c87414635a5cee6f44e4de1ec => generated 526 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:46:27.419335 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74f3c4-3d47-437e-86b1-24e0e08f9ad7 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:27.428578 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74f3c4-3d47-437e-86b1-24e0e08f9ad7 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:27.433151 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189293b2-711f-41fd-96ff-880f3787db10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:27.433929 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189293b2-711f-41fd-96ff-880f3787db10 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:27.434212 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189293b2-711f-41fd-96ff-880f3787db10 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:27.434490 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189293b2-711f-41fd-96ff-880f3787db10 admin admin] PATH_INFO: `/v3/users/03328de5575045b39a05fe986384adab` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:27.435585 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189293b2-711f-41fd-96ff-880f3787db10 admin admin] RBAC: Authorizing `identity:get_user(user_id=03328de5575045b39a05fe986384adab)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:27.461773 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189293b2-711f-41fd-96ff-880f3787db10 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:27.463224 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 682/1364] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:46:27 2021] GET /identity/v3/users/03328de5575045b39a05fe986384adab => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:46:29.456707 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d605fcb-dad9-4589-b8ba-ad5f0a2862dd None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:29.457290 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d605fcb-dad9-4589-b8ba-ad5f0a2862dd None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:29.457290 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d605fcb-dad9-4589-b8ba-ad5f0a2862dd None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:29.458973 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 683/1365] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:46:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:46:29.464320 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d56e91-a017-47ed-97b3-d1cbad2f7a72 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:29.464746 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d56e91-a017-47ed-97b3-d1cbad2f7a72 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:29.464889 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d56e91-a017-47ed-97b3-d1cbad2f7a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:29.486907 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-11d56e91-a017-47ed-97b3-d1cbad2f7a72 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:46:29.488025 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-11d56e91-a017-47ed-97b3-d1cbad2f7a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:46:29.495423 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 683/1366] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:46:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:46:29.517604 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d605fcb-dad9-4589-b8ba-ad5f0a2862dd None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:29.529383 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d605fcb-dad9-4589-b8ba-ad5f0a2862dd None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:29.533294 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141800e-0d6a-46ed-8781-089e9c46b9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:29.534054 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141800e-0d6a-46ed-8781-089e9c46b9cd admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:29.534342 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141800e-0d6a-46ed-8781-089e9c46b9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:29.534619 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141800e-0d6a-46ed-8781-089e9c46b9cd admin admin] PATH_INFO: `/v3/projects/eab36123e8944d6cbc3850dcea7e4cf4` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:29.546555 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141800e-0d6a-46ed-8781-089e9c46b9cd admin admin] RBAC: Authorizing `identity:get_project(project_id=eab36123e8944d6cbc3850dcea7e4cf4)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:29.572938 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141800e-0d6a-46ed-8781-089e9c46b9cd admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:29.574733 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 684/1367] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:46:29 2021] GET /identity/v3/projects/eab36123e8944d6cbc3850dcea7e4cf4 => generated 311 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:46:29.580626 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d56e91-a017-47ed-97b3-d1cbad2f7a72 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:29.589262 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d56e91-a017-47ed-97b3-d1cbad2f7a72 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:29.593316 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5db64-ea74-44e6-87b0-5fa11c6617b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:29.593883 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5db64-ea74-44e6-87b0-5fa11c6617b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:29.594168 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5db64-ea74-44e6-87b0-5fa11c6617b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:29.594451 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5db64-ea74-44e6-87b0-5fa11c6617b8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:29.595198 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5db64-ea74-44e6-87b0-5fa11c6617b8 admin admin] RBAC: Adding query filter params (scope.project.id=eab36123e8944d6cbc3850dcea7e4cf4) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:46:29.595495 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5db64-ea74-44e6-87b0-5fa11c6617b8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:29.621614 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5db64-ea74-44e6-87b0-5fa11c6617b8 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:29.626833 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 684/1368] 10.222.0.37 () {56 vars in 1231 bytes} [Wed Dec 29 20:46:29 2021] GET /identity/v3/role_assignments?scope.project.id=eab36123e8944d6cbc3850dcea7e4cf4 => generated 526 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:46:29.632428 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141800e-0d6a-46ed-8781-089e9c46b9cd admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:29.642314 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141800e-0d6a-46ed-8781-089e9c46b9cd admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:29.646339 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4e828-6025-4c83-8a92-e437e90b46a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:29.647143 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4e828-6025-4c83-8a92-e437e90b46a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:29.647430 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4e828-6025-4c83-8a92-e437e90b46a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:29.647703 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4e828-6025-4c83-8a92-e437e90b46a6 admin admin] PATH_INFO: `/v3/users/46856f130b344342890c397cb9747fd4` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:29.666399 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4e828-6025-4c83-8a92-e437e90b46a6 admin admin] RBAC: Authorizing `identity:get_user(user_id=46856f130b344342890c397cb9747fd4)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:29.692472 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4e828-6025-4c83-8a92-e437e90b46a6 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:29.693968 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 685/1369] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:46:29 2021] GET /identity/v3/users/46856f130b344342890c397cb9747fd4 => generated 286 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:46:31.665121 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1968d85-da41-46ed-aa23-f7ba465efdb1 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:31.665659 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1968d85-da41-46ed-aa23-f7ba465efdb1 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:31.665659 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1968d85-da41-46ed-aa23-f7ba465efdb1 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:31.667285 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 685/1370] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:46:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:46:31.672515 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36a10e-672b-46ac-b9dd-c05b8e2f2cfa None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:31.672966 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36a10e-672b-46ac-b9dd-c05b8e2f2cfa None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:31.673089 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36a10e-672b-46ac-b9dd-c05b8e2f2cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:31.697336 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-7e36a10e-672b-46ac-b9dd-c05b8e2f2cfa None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:46:31.698457 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-7e36a10e-672b-46ac-b9dd-c05b8e2f2cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:46:31.705417 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 686/1371] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:46:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:46:31.728478 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1968d85-da41-46ed-aa23-f7ba465efdb1 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:31.739989 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1968d85-da41-46ed-aa23-f7ba465efdb1 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:31.744449 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c993fa-1d97-483b-95e9-638d57eb1c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:31.745210 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c993fa-1d97-483b-95e9-638d57eb1c31 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:31.745497 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c993fa-1d97-483b-95e9-638d57eb1c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:31.745776 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c993fa-1d97-483b-95e9-638d57eb1c31 admin admin] PATH_INFO: `/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:31.759262 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c993fa-1d97-483b-95e9-638d57eb1c31 admin admin] RBAC: Authorizing `identity:get_project(project_id=ec6ddf70badd4a05b97ea6835eaebc90)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:31.785065 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c993fa-1d97-483b-95e9-638d57eb1c31 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:31.786641 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 686/1372] 10.222.0.37 () {56 vars in 1207 bytes} [Wed Dec 29 20:46:31 2021] GET /identity/v3/projects/ec6ddf70badd4a05b97ea6835eaebc90 => generated 302 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:46:31.792411 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36a10e-672b-46ac-b9dd-c05b8e2f2cfa None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:31.801051 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36a10e-672b-46ac-b9dd-c05b8e2f2cfa None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:31.805675 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525bfa4-cd2f-42f3-b3d1-2bb4c4ad3be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:31.806240 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525bfa4-cd2f-42f3-b3d1-2bb4c4ad3be2 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:31.806548 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525bfa4-cd2f-42f3-b3d1-2bb4c4ad3be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:31.807038 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525bfa4-cd2f-42f3-b3d1-2bb4c4ad3be2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:31.807760 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525bfa4-cd2f-42f3-b3d1-2bb4c4ad3be2 admin admin] RBAC: Adding query filter params (scope.project.id=ec6ddf70badd4a05b97ea6835eaebc90) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:46:31.808057 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525bfa4-cd2f-42f3-b3d1-2bb4c4ad3be2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:31.834289 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525bfa4-cd2f-42f3-b3d1-2bb4c4ad3be2 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:31.841120 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 687/1373] 10.222.0.37 () {56 vars in 1231 bytes} [Wed Dec 29 20:46:31 2021] GET /identity/v3/role_assignments?scope.project.id=ec6ddf70badd4a05b97ea6835eaebc90 => generated 1934 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:46:31.846979 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c993fa-1d97-483b-95e9-638d57eb1c31 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:31.856469 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c993fa-1d97-483b-95e9-638d57eb1c31 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:31.860602 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed3f09-5e90-4e06-8d9f-5a314f1d2e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:31.861389 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed3f09-5e90-4e06-8d9f-5a314f1d2e80 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:31.861700 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed3f09-5e90-4e06-8d9f-5a314f1d2e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:31.861979 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed3f09-5e90-4e06-8d9f-5a314f1d2e80 admin admin] PATH_INFO: `/v3/users/c1dc0b7952b54de1b266b6801d6b597d` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:31.881310 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed3f09-5e90-4e06-8d9f-5a314f1d2e80 admin admin] RBAC: Authorizing `identity:get_user(user_id=c1dc0b7952b54de1b266b6801d6b597d)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:31.907338 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed3f09-5e90-4e06-8d9f-5a314f1d2e80 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:31.908873 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 687/1374] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:46:31 2021] GET /identity/v3/users/c1dc0b7952b54de1b266b6801d6b597d => generated 283 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:46:31.915117 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525bfa4-cd2f-42f3-b3d1-2bb4c4ad3be2 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:31.924434 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525bfa4-cd2f-42f3-b3d1-2bb4c4ad3be2 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:31.928432 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb68a4-1d29-4287-a16a-a6264ba9f1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:31.929823 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb68a4-1d29-4287-a16a-a6264ba9f1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:31.930200 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb68a4-1d29-4287-a16a-a6264ba9f1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:31.930376 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb68a4-1d29-4287-a16a-a6264ba9f1a0 admin admin] PATH_INFO: `/v3/users/a36a939159da4f1da66be9e4aad8ddd2` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:31.931469 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb68a4-1d29-4287-a16a-a6264ba9f1a0 admin admin] RBAC: Authorizing `identity:get_user(user_id=a36a939159da4f1da66be9e4aad8ddd2)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:31.957154 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb68a4-1d29-4287-a16a-a6264ba9f1a0 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:31.958585 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 688/1375] 10.222.0.37 () {56 vars in 1198 bytes} [Wed Dec 29 20:46:31 2021] GET /identity/v3/users/a36a939159da4f1da66be9e4aad8ddd2 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:46:36.564056 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65186de6-c73c-4b0f-8287-a7d1b0a6eb23 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:36.564634 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65186de6-c73c-4b0f-8287-a7d1b0a6eb23 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:36.564634 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65186de6-c73c-4b0f-8287-a7d1b0a6eb23 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:36.566290 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 688/1376] 10.222.0.37 () {54 vars in 918 bytes} [Wed Dec 29 20:46:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:46:36.571850 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456c5cc-d207-412a-9ba6-6466abb745e8 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:36.572263 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456c5cc-d207-412a-9ba6-6466abb745e8 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:36.572408 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456c5cc-d207-412a-9ba6-6466abb745e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:36.596270 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-9456c5cc-d207-412a-9ba6-6466abb745e8 None None] MFA Rules not processed for user `25cb71bb64a3456fb2dc02095c487d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:46:36.597386 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-9456c5cc-d207-412a-9ba6-6466abb745e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:46:36.605212 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 689/1377] 10.222.0.37 () {58 vars in 1015 bytes} [Wed Dec 29 20:46:36 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:46:36.664884 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec588055-dc0f-415e-a796-d03f40f2e4a1 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:36.665176 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec588055-dc0f-415e-a796-d03f40f2e4a1 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:36.665454 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec588055-dc0f-415e-a796-d03f40f2e4a1 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:36.667201 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 689/1378] 10.222.0.37 () {54 vars in 918 bytes} [Wed Dec 29 20:46:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:46:36.671974 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8471a8-0329-4720-9cf8-2916f0618643 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:36.672259 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8471a8-0329-4720-9cf8-2916f0618643 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:36.672535 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8471a8-0329-4720-9cf8-2916f0618643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:36.694782 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-ac8471a8-0329-4720-9cf8-2916f0618643 None None] MFA Rules not processed for user `51ef7e54d97a4320bda0c1926d190d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:46:36.696176 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-ac8471a8-0329-4720-9cf8-2916f0618643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:46:36.704323 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 690/1379] 10.222.0.37 () {58 vars in 1015 bytes} [Wed Dec 29 20:46:36 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:46:39.026122 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef302d43-9f94-4f14-b531-03d7aa54a1b8 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:39.026646 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef302d43-9f94-4f14-b531-03d7aa54a1b8 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:39.026789 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef302d43-9f94-4f14-b531-03d7aa54a1b8 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:39.028376 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 690/1380] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 29 20:46:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:46:39.033698 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47ca79-8949-444f-916b-abb95fb06b9f None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:39.034096 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47ca79-8949-444f-916b-abb95fb06b9f None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:39.034271 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47ca79-8949-444f-916b-abb95fb06b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:39.056135 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-1b47ca79-8949-444f-916b-abb95fb06b9f None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:46:39.057283 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-1b47ca79-8949-444f-916b-abb95fb06b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:46:39.064163 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 691/1381] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 29 20:46:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:46:39.151326 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef302d43-9f94-4f14-b531-03d7aa54a1b8 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:39.164342 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef302d43-9f94-4f14-b531-03d7aa54a1b8 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:39.169061 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbf73d-16dc-4d19-bbae-78f13508aa7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:39.169620 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbf73d-16dc-4d19-bbae-78f13508aa7d service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:39.169904 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbf73d-16dc-4d19-bbae-78f13508aa7d service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:39.170180 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbf73d-16dc-4d19-bbae-78f13508aa7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:39.177827 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbbf73d-16dc-4d19-bbae-78f13508aa7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:39.204309 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbbf73d-16dc-4d19-bbae-78f13508aa7d service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:39.213242 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 691/1382] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:46:39 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:46:40.584735 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0261230-483a-44ac-9bde-53974cefec8a None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:40.585817 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0261230-483a-44ac-9bde-53974cefec8a None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:40.585938 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0261230-483a-44ac-9bde-53974cefec8a None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:40.587619 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 692/1383] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 29 20:46:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:46:40.592324 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c3773-737c-4258-83c6-33d2c363bc6b None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:40.592750 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c3773-737c-4258-83c6-33d2c363bc6b None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:40.592897 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c3773-737c-4258-83c6-33d2c363bc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:40.615664 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-652c3773-737c-4258-83c6-33d2c363bc6b None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:46:40.617426 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-652c3773-737c-4258-83c6-33d2c363bc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:46:40.624385 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 692/1384] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 29 20:46:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:46:40.772088 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0261230-483a-44ac-9bde-53974cefec8a None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:40.785723 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0261230-483a-44ac-9bde-53974cefec8a None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:40.791166 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62533c91-50ad-4875-ab93-cd69549a8331 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:40.791722 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62533c91-50ad-4875-ab93-cd69549a8331 service nova] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:40.792006 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62533c91-50ad-4875-ab93-cd69549a8331 service nova] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:40.792283 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62533c91-50ad-4875-ab93-cd69549a8331 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:40.800016 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62533c91-50ad-4875-ab93-cd69549a8331 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:40.825338 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62533c91-50ad-4875-ab93-cd69549a8331 service nova] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:40.834298 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 693/1385] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:46:40 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:46:42.344960 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4fe77-0d1d-4636-bdb3-d00495dffd3c None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:42.345495 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4fe77-0d1d-4636-bdb3-d00495dffd3c None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:42.345590 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4fe77-0d1d-4636-bdb3-d00495dffd3c None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:42.347232 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 693/1386] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 29 20:46:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:46:42.352499 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e799fc4-3505-41c2-9e09-402fe95c3866 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:42.352933 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e799fc4-3505-41c2-9e09-402fe95c3866 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:42.353081 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e799fc4-3505-41c2-9e09-402fe95c3866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:42.375268 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-7e799fc4-3505-41c2-9e09-402fe95c3866 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:46:42.376432 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-7e799fc4-3505-41c2-9e09-402fe95c3866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:46:42.383297 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 694/1387] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 29 20:46:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:46:42.531371 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4fe77-0d1d-4636-bdb3-d00495dffd3c None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:42.544759 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4fe77-0d1d-4636-bdb3-d00495dffd3c None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:42.549606 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400eebba-588d-48b0-9521-526b4d5ace1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:42.550170 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400eebba-588d-48b0-9521-526b4d5ace1a service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:42.550462 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400eebba-588d-48b0-9521-526b4d5ace1a service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:42.550780 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400eebba-588d-48b0-9521-526b4d5ace1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:42.558581 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400eebba-588d-48b0-9521-526b4d5ace1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:42.584799 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400eebba-588d-48b0-9521-526b4d5ace1a service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:42.594407 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 694/1388] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:46:42 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:46:44.004861 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4dc80-3542-44b8-911d-c6e68862ae5b None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:44.005382 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4dc80-3542-44b8-911d-c6e68862ae5b None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:44.005511 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4dc80-3542-44b8-911d-c6e68862ae5b None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:44.007852 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 695/1389] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 29 20:46:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:46:44.012640 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444916b-d45a-48e1-9e3a-1af20d668bbd None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:44.013053 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444916b-d45a-48e1-9e3a-1af20d668bbd None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:44.013204 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444916b-d45a-48e1-9e3a-1af20d668bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:44.037242 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-9444916b-d45a-48e1-9e3a-1af20d668bbd None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:46:44.038434 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-9444916b-d45a-48e1-9e3a-1af20d668bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:46:44.045542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 695/1390] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 29 20:46:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:46:44.200466 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4dc80-3542-44b8-911d-c6e68862ae5b None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:44.214774 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4dc80-3542-44b8-911d-c6e68862ae5b None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:44.219867 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105535b3-577c-47ea-97e2-7b1432120b2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:44.220444 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105535b3-577c-47ea-97e2-7b1432120b2c service nova] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:44.220731 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105535b3-577c-47ea-97e2-7b1432120b2c service nova] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:44.221015 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105535b3-577c-47ea-97e2-7b1432120b2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:44.229281 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105535b3-577c-47ea-97e2-7b1432120b2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:44.254524 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105535b3-577c-47ea-97e2-7b1432120b2c service nova] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:44.264271 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 696/1391] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:46:44 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:46:45.694007 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c83574-f11a-4240-8bd1-487b142a2480 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:45.695095 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c83574-f11a-4240-8bd1-487b142a2480 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:45.695191 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c83574-f11a-4240-8bd1-487b142a2480 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:45.697080 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 696/1392] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 29 20:46:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:46:45.702413 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7387e1e-2152-4943-a119-fbf8191b3287 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:45.702878 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7387e1e-2152-4943-a119-fbf8191b3287 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:45.703001 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7387e1e-2152-4943-a119-fbf8191b3287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:45.725375 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-b7387e1e-2152-4943-a119-fbf8191b3287 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:46:45.726721 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-b7387e1e-2152-4943-a119-fbf8191b3287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:46:45.733465 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 697/1393] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 29 20:46:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:46:45.881764 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c83574-f11a-4240-8bd1-487b142a2480 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:45.896049 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c83574-f11a-4240-8bd1-487b142a2480 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:45.901166 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af63a1-8127-493a-9fba-c986931a9b68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:45.901739 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af63a1-8127-493a-9fba-c986931a9b68 service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:45.902027 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af63a1-8127-493a-9fba-c986931a9b68 service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:45.902309 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af63a1-8127-493a-9fba-c986931a9b68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:45.910140 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af63a1-8127-493a-9fba-c986931a9b68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:45.935702 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af63a1-8127-493a-9fba-c986931a9b68 service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:45.945195 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 697/1394] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:46:45 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:46:47.280546 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d0290-cc5e-425b-8755-aec4edae34f3 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:47.281101 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d0290-cc5e-425b-8755-aec4edae34f3 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:47.281101 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d0290-cc5e-425b-8755-aec4edae34f3 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:47.282783 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 698/1395] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 29 20:46:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:46:47.287536 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf5b66-3241-4f38-af41-fea51511f9c7 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:47.287966 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf5b66-3241-4f38-af41-fea51511f9c7 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:47.288154 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf5b66-3241-4f38-af41-fea51511f9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:47.311344 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-99bf5b66-3241-4f38-af41-fea51511f9c7 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:46:47.312472 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-99bf5b66-3241-4f38-af41-fea51511f9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:46:47.319301 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 698/1396] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 29 20:46:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:46:47.466213 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d0290-cc5e-425b-8755-aec4edae34f3 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:47.479166 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d0290-cc5e-425b-8755-aec4edae34f3 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:47.483816 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37091100-2949-4b81-b9cc-0f356bdcfb1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:47.484371 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37091100-2949-4b81-b9cc-0f356bdcfb1e service nova] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:47.484657 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37091100-2949-4b81-b9cc-0f356bdcfb1e service nova] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:47.484933 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37091100-2949-4b81-b9cc-0f356bdcfb1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:47.493200 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37091100-2949-4b81-b9cc-0f356bdcfb1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:47.518744 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37091100-2949-4b81-b9cc-0f356bdcfb1e service nova] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:47.527646 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 699/1397] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:46:47 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:46:48.865364 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ffecf-e799-44b9-b40e-4d2331232676 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:48.865926 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ffecf-e799-44b9-b40e-4d2331232676 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:48.865926 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ffecf-e799-44b9-b40e-4d2331232676 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:48.868274 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 699/1398] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 29 20:46:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:46:48.873989 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec5326-294d-44fa-9b0e-22c64eb37505 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:48.874409 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec5326-294d-44fa-9b0e-22c64eb37505 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:48.874585 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec5326-294d-44fa-9b0e-22c64eb37505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:48.898395 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-abec5326-294d-44fa-9b0e-22c64eb37505 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:46:48.899577 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-abec5326-294d-44fa-9b0e-22c64eb37505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:46:48.906571 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 700/1399] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 29 20:46:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:46:49.055127 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ffecf-e799-44b9-b40e-4d2331232676 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:49.068405 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ffecf-e799-44b9-b40e-4d2331232676 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:49.074450 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85530b5d-98df-410d-9a31-e665c7156bb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:49.075045 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85530b5d-98df-410d-9a31-e665c7156bb3 service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:49.075335 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85530b5d-98df-410d-9a31-e665c7156bb3 service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:49.075616 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85530b5d-98df-410d-9a31-e665c7156bb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:49.083361 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85530b5d-98df-410d-9a31-e665c7156bb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:49.109481 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85530b5d-98df-410d-9a31-e665c7156bb3 service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:49.119382 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 700/1400] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:46:49 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:46:50.443867 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627ced3-4c70-4a43-95f3-2fa712890284 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:50.444458 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627ced3-4c70-4a43-95f3-2fa712890284 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:50.444552 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627ced3-4c70-4a43-95f3-2fa712890284 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:50.446228 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 701/1401] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 29 20:46:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:46:50.451223 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c8e0f-171d-4749-bc10-bdd40fe9591b None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:50.451641 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c8e0f-171d-4749-bc10-bdd40fe9591b None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:50.451787 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c8e0f-171d-4749-bc10-bdd40fe9591b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:50.474228 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-760c8e0f-171d-4749-bc10-bdd40fe9591b None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:46:50.475445 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-760c8e0f-171d-4749-bc10-bdd40fe9591b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:46:50.482993 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 701/1402] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 29 20:46:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:46:50.635907 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627ced3-4c70-4a43-95f3-2fa712890284 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:50.649297 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627ced3-4c70-4a43-95f3-2fa712890284 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:50.654050 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b39b15-ad4b-4997-842d-3f04ef5fbd87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:50.654615 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b39b15-ad4b-4997-842d-3f04ef5fbd87 service nova] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:50.654934 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b39b15-ad4b-4997-842d-3f04ef5fbd87 service nova] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:50.655214 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b39b15-ad4b-4997-842d-3f04ef5fbd87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:50.663426 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b39b15-ad4b-4997-842d-3f04ef5fbd87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:50.688857 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b39b15-ad4b-4997-842d-3f04ef5fbd87 service nova] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:50.697723 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 702/1403] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:46:50 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:46:52.021523 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23522459-bf3d-4512-b5e9-ac5edd212685 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:52.022075 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23522459-bf3d-4512-b5e9-ac5edd212685 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:52.022184 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23522459-bf3d-4512-b5e9-ac5edd212685 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:52.023860 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 702/1404] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 29 20:46:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:46:52.028814 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a9686-788f-49fc-a6ba-1dbcf49e2818 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:52.029204 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a9686-788f-49fc-a6ba-1dbcf49e2818 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:52.029379 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a9686-788f-49fc-a6ba-1dbcf49e2818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:52.051114 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-b44a9686-788f-49fc-a6ba-1dbcf49e2818 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:46:52.052244 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-b44a9686-788f-49fc-a6ba-1dbcf49e2818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:46:52.059528 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 703/1405] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 29 20:46:52 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:46:52.208666 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23522459-bf3d-4512-b5e9-ac5edd212685 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:52.222821 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23522459-bf3d-4512-b5e9-ac5edd212685 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:52.227892 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a9084-9782-48d2-a9b0-dc4806203e47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:52.228461 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a9084-9782-48d2-a9b0-dc4806203e47 service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:52.228749 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a9084-9782-48d2-a9b0-dc4806203e47 service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:52.229031 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a9084-9782-48d2-a9b0-dc4806203e47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:52.236894 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a9084-9782-48d2-a9b0-dc4806203e47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:52.262909 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a9084-9782-48d2-a9b0-dc4806203e47 service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:52.271746 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 703/1406] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:46:52 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:46:54.253514 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb41877-4dcd-4212-808c-7836f4bf3b38 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:54.254027 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb41877-4dcd-4212-808c-7836f4bf3b38 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:54.254027 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb41877-4dcd-4212-808c-7836f4bf3b38 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:54.255687 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 704/1407] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 29 20:46:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:46:54.261693 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0312717-7f6c-4817-8f85-b933aa7e9f17 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:54.262106 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0312717-7f6c-4817-8f85-b933aa7e9f17 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:54.262269 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0312717-7f6c-4817-8f85-b933aa7e9f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:54.284760 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-f0312717-7f6c-4817-8f85-b933aa7e9f17 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:46:54.285895 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-f0312717-7f6c-4817-8f85-b933aa7e9f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:46:54.294475 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 704/1408] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 29 20:46:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:46:54.333355 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb41877-4dcd-4212-808c-7836f4bf3b38 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:54.343594 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb41877-4dcd-4212-808c-7836f4bf3b38 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:54.346787 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cb4fd-88bf-4cf4-81e9-63538df17b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:54.347346 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cb4fd-88bf-4cf4-81e9-63538df17b05 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:54.347633 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cb4fd-88bf-4cf4-81e9-63538df17b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:54.347914 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cb4fd-88bf-4cf4-81e9-63538df17b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:54.356460 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cb4fd-88bf-4cf4-81e9-63538df17b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:54.382436 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cb4fd-88bf-4cf4-81e9-63538df17b05 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:54.391300 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 705/1409] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:46:54 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:46:56.492168 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd470a3-7702-44f1-b94b-a1b751269f81 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:56.492726 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd470a3-7702-44f1-b94b-a1b751269f81 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:56.492726 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd470a3-7702-44f1-b94b-a1b751269f81 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:56.494397 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 705/1410] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 29 20:46:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 29 20:46:56.499679 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd173e-8f66-4369-a0c4-c836c01697ce None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:56.500085 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd173e-8f66-4369-a0c4-c836c01697ce None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:56.500298 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd173e-8f66-4369-a0c4-c836c01697ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:56.522636 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-c9dd173e-8f66-4369-a0c4-c836c01697ce None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:46:56.523818 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c9dd173e-8f66-4369-a0c4-c836c01697ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:46:56.532045 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 706/1411] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 29 20:46:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:46:56.568809 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd470a3-7702-44f1-b94b-a1b751269f81 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:56.579897 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd470a3-7702-44f1-b94b-a1b751269f81 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:56.583115 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01245aca-1909-48d4-a6df-ddb8f59ea0e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:56.583680 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01245aca-1909-48d4-a6df-ddb8f59ea0e4 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:56.583966 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01245aca-1909-48d4-a6df-ddb8f59ea0e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:56.584246 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01245aca-1909-48d4-a6df-ddb8f59ea0e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:56.592883 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01245aca-1909-48d4-a6df-ddb8f59ea0e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:56.618798 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01245aca-1909-48d4-a6df-ddb8f59ea0e4 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:56.627730 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 706/1412] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:46:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:46:59.020631 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2279a-52c6-4876-9045-a296bcc6c269 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:59.021195 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2279a-52c6-4876-9045-a296bcc6c269 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:59.021195 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2279a-52c6-4876-9045-a296bcc6c269 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:59.023736 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 707/1413] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 29 20:46:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:46:59.028855 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42a54e-f9b5-466e-8016-95795ebf54ee None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:59.029275 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42a54e-f9b5-466e-8016-95795ebf54ee None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:59.029424 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42a54e-f9b5-466e-8016-95795ebf54ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:59.051373 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-0f42a54e-f9b5-466e-8016-95795ebf54ee None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:46:59.052509 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-0f42a54e-f9b5-466e-8016-95795ebf54ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:46:59.059362 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 707/1414] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 29 20:46:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:46:59.097696 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2279a-52c6-4876-9045-a296bcc6c269 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:46:59.109845 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2279a-52c6-4876-9045-a296bcc6c269 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:46:59.113091 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7dfcd-cd4b-457a-939a-db343d2099dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:46:59.113652 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7dfcd-cd4b-457a-939a-db343d2099dd service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:46:59.113962 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7dfcd-cd4b-457a-939a-db343d2099dd service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:46:59.114241 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7dfcd-cd4b-457a-939a-db343d2099dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:46:59.123171 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7dfcd-cd4b-457a-939a-db343d2099dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:46:59.149082 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7dfcd-cd4b-457a-939a-db343d2099dd service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:46:59.158320 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 708/1415] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:46:59 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:47:01.231739 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf05db6-9d8f-48aa-8908-40eef62ff070 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:01.232277 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf05db6-9d8f-48aa-8908-40eef62ff070 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:01.232277 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf05db6-9d8f-48aa-8908-40eef62ff070 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:01.233873 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 708/1416] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 29 20:47:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:47:01.239281 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568dd58-b58e-4446-af5d-54e0325655be None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:01.239716 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568dd58-b58e-4446-af5d-54e0325655be None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:01.239851 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568dd58-b58e-4446-af5d-54e0325655be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:01.262371 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-1568dd58-b58e-4446-af5d-54e0325655be None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:47:01.263571 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-1568dd58-b58e-4446-af5d-54e0325655be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:47:01.270371 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 709/1417] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 29 20:47:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:47:01.308225 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf05db6-9d8f-48aa-8908-40eef62ff070 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:47:01.318444 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf05db6-9d8f-48aa-8908-40eef62ff070 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:47:01.322519 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c012beb-3e92-42bf-9def-275f0453b4ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:47:01.323111 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c012beb-3e92-42bf-9def-275f0453b4ea service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:01.323402 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c012beb-3e92-42bf-9def-275f0453b4ea service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:01.323940 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c012beb-3e92-42bf-9def-275f0453b4ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:01.332387 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c012beb-3e92-42bf-9def-275f0453b4ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:47:01.358622 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c012beb-3e92-42bf-9def-275f0453b4ea service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:47:01.368145 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 709/1418] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:47:01 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:47:03.446009 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489cf36-e574-43a1-9e2b-7fa2fd0dc5b5 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:03.446517 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489cf36-e574-43a1-9e2b-7fa2fd0dc5b5 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:03.446517 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489cf36-e574-43a1-9e2b-7fa2fd0dc5b5 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:03.448161 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 710/1419] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 29 20:47:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:47:03.453687 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ba9ed-b16f-46d6-a54f-6a6eb6c61301 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:03.454110 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ba9ed-b16f-46d6-a54f-6a6eb6c61301 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:03.454259 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ba9ed-b16f-46d6-a54f-6a6eb6c61301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:03.476824 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-753ba9ed-b16f-46d6-a54f-6a6eb6c61301 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:47:03.477954 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-753ba9ed-b16f-46d6-a54f-6a6eb6c61301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:47:03.484823 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 710/1420] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 29 20:47:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:47:03.523274 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489cf36-e574-43a1-9e2b-7fa2fd0dc5b5 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:47:03.533411 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489cf36-e574-43a1-9e2b-7fa2fd0dc5b5 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:47:03.536566 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35e0ef-c3b9-4cf1-87db-0048f62aac62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:47:03.537126 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35e0ef-c3b9-4cf1-87db-0048f62aac62 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:03.537410 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35e0ef-c3b9-4cf1-87db-0048f62aac62 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:03.537738 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35e0ef-c3b9-4cf1-87db-0048f62aac62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:03.546620 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35e0ef-c3b9-4cf1-87db-0048f62aac62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:47:03.572084 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35e0ef-c3b9-4cf1-87db-0048f62aac62 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:47:03.581490 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 711/1421] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:47:03 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:47:05.671568 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1efa0f-7116-4c4a-a68d-997e7496edf5 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:05.672169 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1efa0f-7116-4c4a-a68d-997e7496edf5 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:05.672169 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1efa0f-7116-4c4a-a68d-997e7496edf5 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:05.673784 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 711/1422] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 29 20:47:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:47:05.678994 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cbe29-b77a-4424-a1ec-b41eae59f0b9 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:05.679411 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cbe29-b77a-4424-a1ec-b41eae59f0b9 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:05.679559 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cbe29-b77a-4424-a1ec-b41eae59f0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:05.702428 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-594cbe29-b77a-4424-a1ec-b41eae59f0b9 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:47:05.703603 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-594cbe29-b77a-4424-a1ec-b41eae59f0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:47:05.711165 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 712/1423] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 29 20:47:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:47:05.751214 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1efa0f-7116-4c4a-a68d-997e7496edf5 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:47:05.752752 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-ab1efa0f-7116-4c4a-a68d-997e7496edf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:47:05.765672 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1efa0f-7116-4c4a-a68d-997e7496edf5 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:47:05.768879 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1137a-eae9-4d48-8dd0-ce7646bde575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:47:05.769462 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1137a-eae9-4d48-8dd0-ce7646bde575 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:05.769744 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1137a-eae9-4d48-8dd0-ce7646bde575 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:05.770021 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1137a-eae9-4d48-8dd0-ce7646bde575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:05.779585 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1137a-eae9-4d48-8dd0-ce7646bde575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:47:05.804767 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1137a-eae9-4d48-8dd0-ce7646bde575 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:47:05.813544 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 712/1424] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:47:05 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:47:07.886492 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99baea13-5572-452c-9d48-90d9218f050a None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:07.887098 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99baea13-5572-452c-9d48-90d9218f050a None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:07.887098 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99baea13-5572-452c-9d48-90d9218f050a None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:07.888735 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 713/1425] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 29 20:47:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:47:07.893890 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d3a22-68d8-43df-a255-59ea7cd9b5f2 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:07.894318 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d3a22-68d8-43df-a255-59ea7cd9b5f2 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:07.894462 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d3a22-68d8-43df-a255-59ea7cd9b5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:07.917807 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-c78d3a22-68d8-43df-a255-59ea7cd9b5f2 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:47:07.919047 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-c78d3a22-68d8-43df-a255-59ea7cd9b5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:47:07.927177 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 713/1426] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 29 20:47:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:47:07.967211 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99baea13-5572-452c-9d48-90d9218f050a None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:47:07.977605 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99baea13-5572-452c-9d48-90d9218f050a None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:47:07.980766 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486874c-9e1e-439f-a66f-e8f1967f7ba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:47:07.981328 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486874c-9e1e-439f-a66f-e8f1967f7ba1 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:07.981614 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486874c-9e1e-439f-a66f-e8f1967f7ba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:07.981893 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486874c-9e1e-439f-a66f-e8f1967f7ba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:07.990294 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486874c-9e1e-439f-a66f-e8f1967f7ba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:47:08.015850 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486874c-9e1e-439f-a66f-e8f1967f7ba1 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:47:08.025514 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 714/1427] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:47:07 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:47:10.022080 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ead8a6-52cd-4033-b733-25bae6263b52 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:10.022630 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ead8a6-52cd-4033-b733-25bae6263b52 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:10.022756 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ead8a6-52cd-4033-b733-25bae6263b52 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:10.024448 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 714/1428] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 29 20:47:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:47:10.029589 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f57712-3d93-46a8-8298-fba5f4103455 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:10.030005 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f57712-3d93-46a8-8298-fba5f4103455 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:10.030159 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f57712-3d93-46a8-8298-fba5f4103455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:10.052783 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-a5f57712-3d93-46a8-8298-fba5f4103455 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:47:10.053969 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-a5f57712-3d93-46a8-8298-fba5f4103455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:47:10.060801 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 715/1429] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 29 20:47:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:47:10.098029 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ead8a6-52cd-4033-b733-25bae6263b52 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:47:10.108873 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ead8a6-52cd-4033-b733-25bae6263b52 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:47:10.112300 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05bf37-faae-4f7f-bb55-75e2111eaa37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:47:10.112892 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05bf37-faae-4f7f-bb55-75e2111eaa37 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:10.113181 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05bf37-faae-4f7f-bb55-75e2111eaa37 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:10.113458 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05bf37-faae-4f7f-bb55-75e2111eaa37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:10.123174 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05bf37-faae-4f7f-bb55-75e2111eaa37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:47:10.149172 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05bf37-faae-4f7f-bb55-75e2111eaa37 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:47:10.158497 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 715/1430] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:47:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:47:12.158565 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e9468-8871-4c48-96d9-f6780326aa4a None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:12.159132 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e9468-8871-4c48-96d9-f6780326aa4a None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:12.159132 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e9468-8871-4c48-96d9-f6780326aa4a None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:12.160819 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 716/1431] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 29 20:47:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:47:12.166355 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057963d-9e1c-49fe-9f62-ad803a515cc6 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:12.166805 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057963d-9e1c-49fe-9f62-ad803a515cc6 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:12.166953 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057963d-9e1c-49fe-9f62-ad803a515cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:12.189572 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-9057963d-9e1c-49fe-9f62-ad803a515cc6 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:47:12.190805 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-9057963d-9e1c-49fe-9f62-ad803a515cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:47:12.198121 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 716/1432] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 29 20:47:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:47:12.234516 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e9468-8871-4c48-96d9-f6780326aa4a None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:47:12.245032 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e9468-8871-4c48-96d9-f6780326aa4a None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:47:12.248201 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b60de0-42c1-4d2e-a193-e2626517656d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:47:12.248754 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b60de0-42c1-4d2e-a193-e2626517656d service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:12.249040 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b60de0-42c1-4d2e-a193-e2626517656d service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:12.249316 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b60de0-42c1-4d2e-a193-e2626517656d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:12.257793 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b60de0-42c1-4d2e-a193-e2626517656d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:47:12.283227 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b60de0-42c1-4d2e-a193-e2626517656d service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:47:12.292152 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 717/1433] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:47:12 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:47:14.299438 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82150fe-6e6c-466f-a8f0-7908b561a5bc None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:14.299952 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82150fe-6e6c-466f-a8f0-7908b561a5bc None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:14.299952 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82150fe-6e6c-466f-a8f0-7908b561a5bc None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:14.301596 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 717/1434] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 29 20:47:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:47:14.307695 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca338a-11ad-4132-a281-89cc413a9811 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:14.308144 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca338a-11ad-4132-a281-89cc413a9811 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:14.308244 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca338a-11ad-4132-a281-89cc413a9811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:14.330950 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-58ca338a-11ad-4132-a281-89cc413a9811 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:47:14.332094 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-58ca338a-11ad-4132-a281-89cc413a9811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:47:14.339156 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 718/1435] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 29 20:47:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:47:14.374513 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82150fe-6e6c-466f-a8f0-7908b561a5bc None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:47:14.385470 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82150fe-6e6c-466f-a8f0-7908b561a5bc None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:47:14.388672 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af39fb5-b737-4a27-b5f5-60a7ee7572fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:47:14.389232 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af39fb5-b737-4a27-b5f5-60a7ee7572fe service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:14.389517 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af39fb5-b737-4a27-b5f5-60a7ee7572fe service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:14.389794 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af39fb5-b737-4a27-b5f5-60a7ee7572fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:14.399035 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af39fb5-b737-4a27-b5f5-60a7ee7572fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:47:14.424373 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af39fb5-b737-4a27-b5f5-60a7ee7572fe service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:47:14.433239 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 718/1436] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:47:14 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:47:25.975569 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641953fb-f83d-4341-a0a0-efc8ea7a89c8 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:25.976123 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641953fb-f83d-4341-a0a0-efc8ea7a89c8 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:25.976123 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641953fb-f83d-4341-a0a0-efc8ea7a89c8 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:25.977827 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 719/1437] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:47:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:47:25.982947 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370a560-2b61-450a-bbd1-0c3a46df18d0 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:25.983325 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370a560-2b61-450a-bbd1-0c3a46df18d0 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:25.983515 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370a560-2b61-450a-bbd1-0c3a46df18d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:26.005281 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-8370a560-2b61-450a-bbd1-0c3a46df18d0 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:47:26.006957 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-8370a560-2b61-450a-bbd1-0c3a46df18d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:47:26.013814 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 719/1438] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:47:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:47:26.057200 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641953fb-f83d-4341-a0a0-efc8ea7a89c8 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:47:26.067531 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641953fb-f83d-4341-a0a0-efc8ea7a89c8 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:47:26.073193 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1e563-b193-458f-9718-aac2399f5eb0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1976a528ee24585bcaccc83e308fec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:47:26.073741 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1e563-b193-458f-9718-aac2399f5eb0 service glance] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:26.074279 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1e563-b193-458f-9718-aac2399f5eb0 service glance] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:26.074554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1e563-b193-458f-9718-aac2399f5eb0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:26.083189 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1e563-b193-458f-9718-aac2399f5eb0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:47:26.109262 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1e563-b193-458f-9718-aac2399f5eb0 service glance] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:47:26.118999 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 720/1439] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:47:26 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:47:28.137244 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd2037-8667-454d-9ccc-47b54283555f None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:28.137793 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd2037-8667-454d-9ccc-47b54283555f None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:28.137793 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd2037-8667-454d-9ccc-47b54283555f None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:28.139436 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 720/1440] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:47:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:47:28.144492 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3c392-abee-42cc-8ea5-c8fe8cc70ada None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:28.144908 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3c392-abee-42cc-8ea5-c8fe8cc70ada None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:28.145053 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3c392-abee-42cc-8ea5-c8fe8cc70ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:28.169104 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-34b3c392-abee-42cc-8ea5-c8fe8cc70ada None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:47:28.170234 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-34b3c392-abee-42cc-8ea5-c8fe8cc70ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:47:28.177060 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 721/1441] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:47:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:47:28.199417 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd2037-8667-454d-9ccc-47b54283555f None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:47:28.211862 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd2037-8667-454d-9ccc-47b54283555f None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:47:28.215874 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62414c6e-4a21-4a43-8876-fb0c6016d7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:47:28.216448 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62414c6e-4a21-4a43-8876-fb0c6016d7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:28.216734 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62414c6e-4a21-4a43-8876-fb0c6016d7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:28.217013 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62414c6e-4a21-4a43-8876-fb0c6016d7f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:28.217707 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62414c6e-4a21-4a43-8876-fb0c6016d7f8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:47:28.243233 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62414c6e-4a21-4a43-8876-fb0c6016d7f8 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:47:28.258545 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 721/1442] 10.222.0.37 () {56 vars in 1108 bytes} [Wed Dec 29 20:47:28 2021] GET /identity/v3/projects => generated 2553 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:47:29.757948 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff72ede-a867-4048-a791-aac1ff5ae17d None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:29.758471 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff72ede-a867-4048-a791-aac1ff5ae17d None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:29.758471 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff72ede-a867-4048-a791-aac1ff5ae17d None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:29.760145 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 722/1443] 10.222.0.37 () {54 vars in 911 bytes} [Wed Dec 29 20:47:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:47:29.764833 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276eb62-77c6-48c4-b9c4-de6697f96f2e None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:29.765212 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276eb62-77c6-48c4-b9c4-de6697f96f2e None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:29.765426 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276eb62-77c6-48c4-b9c4-de6697f96f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:29.787253 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-0276eb62-77c6-48c4-b9c4-de6697f96f2e None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:47:29.788403 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-0276eb62-77c6-48c4-b9c4-de6697f96f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:47:29.795329 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 722/1444] 10.222.0.37 () {58 vars in 1008 bytes} [Wed Dec 29 20:47:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:47:29.942699 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff72ede-a867-4048-a791-aac1ff5ae17d None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:47:29.956180 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff72ede-a867-4048-a791-aac1ff5ae17d None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:47:29.961083 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930c16a-bc54-4b31-b841-e1e787371551 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:47:29.961648 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930c16a-bc54-4b31-b841-e1e787371551 service nova] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:29.961935 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930c16a-bc54-4b31-b841-e1e787371551 service nova] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:29.962214 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930c16a-bc54-4b31-b841-e1e787371551 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:29.970000 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930c16a-bc54-4b31-b841-e1e787371551 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:47:29.997631 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930c16a-bc54-4b31-b841-e1e787371551 service nova] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:47:30.007285 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 723/1445] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:47:29 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:47:32.006351 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc52556-0f3a-429e-962f-09fa45efbff5 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:32.006954 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc52556-0f3a-429e-962f-09fa45efbff5 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:32.006954 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc52556-0f3a-429e-962f-09fa45efbff5 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:32.008750 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 723/1446] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:47:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:47:32.013754 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de39fc-cd23-411d-80d8-e51764eac05a None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:32.014144 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de39fc-cd23-411d-80d8-e51764eac05a None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:32.014314 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de39fc-cd23-411d-80d8-e51764eac05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:32.036556 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-09de39fc-cd23-411d-80d8-e51764eac05a None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:47:32.037728 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-09de39fc-cd23-411d-80d8-e51764eac05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:47:32.044467 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 724/1447] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:47:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:47:32.079697 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc52556-0f3a-429e-962f-09fa45efbff5 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:47:32.090673 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc52556-0f3a-429e-962f-09fa45efbff5 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:47:32.093840 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0924d-c046-49f4-8301-0d894cf5bfc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:47:32.094399 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0924d-c046-49f4-8301-0d894cf5bfc9 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:32.094712 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0924d-c046-49f4-8301-0d894cf5bfc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:32.094994 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0924d-c046-49f4-8301-0d894cf5bfc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:32.103594 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0924d-c046-49f4-8301-0d894cf5bfc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:47:32.128396 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0924d-c046-49f4-8301-0d894cf5bfc9 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:47:32.137749 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 724/1448] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:47:32 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:47:34.143431 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9b7de-7743-4b1f-92b5-ed79c417c27d None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:34.143957 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9b7de-7743-4b1f-92b5-ed79c417c27d None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:34.143957 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9b7de-7743-4b1f-92b5-ed79c417c27d None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:34.145575 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 725/1449] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:47:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 29 20:47:34.150992 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6c575-4e08-42f3-935f-c71c2460de4b None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:34.151433 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6c575-4e08-42f3-935f-c71c2460de4b None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:34.151567 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6c575-4e08-42f3-935f-c71c2460de4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:34.173811 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-c0e6c575-4e08-42f3-935f-c71c2460de4b None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:47:34.175010 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-c0e6c575-4e08-42f3-935f-c71c2460de4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:47:34.182379 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 725/1450] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:47:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:47:34.221469 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9b7de-7743-4b1f-92b5-ed79c417c27d None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:47:34.231839 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9b7de-7743-4b1f-92b5-ed79c417c27d None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:47:34.235045 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b1eb5-2d3e-46e2-a1dc-4d986cac037c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:47:34.235632 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b1eb5-2d3e-46e2-a1dc-4d986cac037c service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:34.235915 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b1eb5-2d3e-46e2-a1dc-4d986cac037c service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:34.236190 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b1eb5-2d3e-46e2-a1dc-4d986cac037c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:34.245028 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b1eb5-2d3e-46e2-a1dc-4d986cac037c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:47:34.270530 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b1eb5-2d3e-46e2-a1dc-4d986cac037c service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:47:34.280540 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 726/1451] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:47:34 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:47:36.393672 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d8c7d-7f5a-4a57-a314-0e7080422f8e None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:36.394230 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d8c7d-7f5a-4a57-a314-0e7080422f8e None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:36.394230 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d8c7d-7f5a-4a57-a314-0e7080422f8e None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:36.396618 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 726/1452] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:47:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:47:36.401679 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c3ded-c6a4-43de-9a1c-783ff297a2ea None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:36.402124 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c3ded-c6a4-43de-9a1c-783ff297a2ea None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:36.402230 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c3ded-c6a4-43de-9a1c-783ff297a2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:36.424649 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-1e9c3ded-c6a4-43de-9a1c-783ff297a2ea None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:47:36.425773 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-1e9c3ded-c6a4-43de-9a1c-783ff297a2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:47:36.432537 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 727/1453] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:47:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:47:36.471934 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d8c7d-7f5a-4a57-a314-0e7080422f8e None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:47:36.482255 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d8c7d-7f5a-4a57-a314-0e7080422f8e None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:47:36.485417 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45ca75-cc80-4941-a1b3-6bcb13f7b05e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:47:36.485974 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45ca75-cc80-4941-a1b3-6bcb13f7b05e service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:36.486259 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45ca75-cc80-4941-a1b3-6bcb13f7b05e service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:36.486535 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45ca75-cc80-4941-a1b3-6bcb13f7b05e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:36.495285 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45ca75-cc80-4941-a1b3-6bcb13f7b05e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:47:36.520572 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45ca75-cc80-4941-a1b3-6bcb13f7b05e service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:47:36.530036 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 727/1454] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:47:36 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:47:38.821037 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676bdd2-748b-4f15-b5bb-dfe412dc0482 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:38.821922 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676bdd2-748b-4f15-b5bb-dfe412dc0482 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:38.822217 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676bdd2-748b-4f15-b5bb-dfe412dc0482 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:38.824225 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 728/1455] 10.222.0.37 () {54 vars in 926 bytes} [Wed Dec 29 20:47:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:47:38.829599 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ac364-57d9-4a16-95d6-cf3b5942beee None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:38.830005 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ac364-57d9-4a16-95d6-cf3b5942beee None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:38.830202 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ac364-57d9-4a16-95d6-cf3b5942beee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:38.854028 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-7c1ac364-57d9-4a16-95d6-cf3b5942beee None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:47:38.855200 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-7c1ac364-57d9-4a16-95d6-cf3b5942beee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:47:38.861986 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 728/1456] 10.222.0.37 () {58 vars in 1023 bytes} [Wed Dec 29 20:47:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:47:38.901241 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676bdd2-748b-4f15-b5bb-dfe412dc0482 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:47:38.912247 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676bdd2-748b-4f15-b5bb-dfe412dc0482 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:47:38.915424 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e127f-7dce-41ad-8fe4-6476f9e28c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:47:38.915985 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e127f-7dce-41ad-8fe4-6476f9e28c7a service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:47:38.916270 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e127f-7dce-41ad-8fe4-6476f9e28c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:47:38.916550 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e127f-7dce-41ad-8fe4-6476f9e28c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:47:38.924906 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e127f-7dce-41ad-8fe4-6476f9e28c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:47:38.950478 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e127f-7dce-41ad-8fe4-6476f9e28c7a service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:47:38.959334 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 729/1457] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:47:38 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:48:43.732192 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b41f13-51c2-4ff1-b4b7-fb72f32e7bf6 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:48:43.732746 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b41f13-51c2-4ff1-b4b7-fb72f32e7bf6 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:48:43.732746 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b41f13-51c2-4ff1-b4b7-fb72f32e7bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:48:43.755226 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-c6b41f13-51c2-4ff1-b4b7-fb72f32e7bf6 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:48:43.756351 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-c6b41f13-51c2-4ff1-b4b7-fb72f32e7bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:48:43.763966 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 729/1458] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:48:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:48:43.773749 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee18c31-a7a4-4736-9b29-ffd9b2800b33 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:48:43.774294 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee18c31-a7a4-4736-9b29-ffd9b2800b33 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:48:43.774294 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee18c31-a7a4-4736-9b29-ffd9b2800b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:48:43.796663 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-5ee18c31-a7a4-4736-9b29-ffd9b2800b33 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:48:43.797777 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-5ee18c31-a7a4-4736-9b29-ffd9b2800b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:48:43.804525 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 730/1459] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:48:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:48:43.808889 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b41f13-51c2-4ff1-b4b7-fb72f32e7bf6 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:48:43.818257 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b41f13-51c2-4ff1-b4b7-fb72f32e7bf6 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:48:43.822453 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4da52-da61-4fe4-ac65-2d261429296d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:48:43.823073 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4da52-da61-4fe4-ac65-2d261429296d admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:48:43.823358 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4da52-da61-4fe4-ac65-2d261429296d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:48:43.823636 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4da52-da61-4fe4-ac65-2d261429296d admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:48:43.824581 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4da52-da61-4fe4-ac65-2d261429296d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:48:43.824874 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4da52-da61-4fe4-ac65-2d261429296d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:48:43.851312 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4da52-da61-4fe4-ac65-2d261429296d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:48:43.864284 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 730/1460] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:48:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:48:43.872332 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee18c31-a7a4-4736-9b29-ffd9b2800b33 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:48:43.880979 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee18c31-a7a4-4736-9b29-ffd9b2800b33 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:48:43.885137 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5aa866-d71e-480b-a6ea-ded7863f92d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:48:43.885742 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5aa866-d71e-480b-a6ea-ded7863f92d3 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:48:43.886031 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5aa866-d71e-480b-a6ea-ded7863f92d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:48:43.886311 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5aa866-d71e-480b-a6ea-ded7863f92d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:48:43.886976 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5aa866-d71e-480b-a6ea-ded7863f92d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:48:43.913285 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5aa866-d71e-480b-a6ea-ded7863f92d3 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:48:43.950396 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 731/1461] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:48:43 2021] POST /identity/v3/projects => generated 375 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:48:43.954900 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4da52-da61-4fe4-ac65-2d261429296d admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:48:43.964869 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4da52-da61-4fe4-ac65-2d261429296d admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:48:44.024857 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6331e-22fc-479b-9c53-1c851e1dd944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:48:44.025372 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6331e-22fc-479b-9c53-1c851e1dd944 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:48:44.025657 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6331e-22fc-479b-9c53-1c851e1dd944 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:48:44.025935 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6331e-22fc-479b-9c53-1c851e1dd944 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:48:44.026571 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6331e-22fc-479b-9c53-1c851e1dd944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:48:44.051983 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6331e-22fc-479b-9c53-1c851e1dd944 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:48:44.071168 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 731/1462] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:48:43 2021] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:48:44.075498 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5aa866-d71e-480b-a6ea-ded7863f92d3 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:48:44.085448 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5aa866-d71e-480b-a6ea-ded7863f92d3 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:48:44.089418 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d00a84-4c06-4783-a748-e9b75a952fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:48:44.089998 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d00a84-4c06-4783-a748-e9b75a952fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:48:44.090282 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d00a84-4c06-4783-a748-e9b75a952fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:48:44.090560 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d00a84-4c06-4783-a748-e9b75a952fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:48:44.091276 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d00a84-4c06-4783-a748-e9b75a952fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:48:44.116589 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d00a84-4c06-4783-a748-e9b75a952fd5 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:48:44.127287 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 732/1463] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:48:44 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:48:44.132040 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6331e-22fc-479b-9c53-1c851e1dd944 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:48:44.141470 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6331e-22fc-479b-9c53-1c851e1dd944 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:48:44.146352 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfe1fd-b769-492f-b04a-b9388e7d7838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:48:44.147224 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfe1fd-b769-492f-b04a-b9388e7d7838 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:48:44.147511 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfe1fd-b769-492f-b04a-b9388e7d7838 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:48:44.147792 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfe1fd-b769-492f-b04a-b9388e7d7838 admin admin] PATH_INFO: `/v3/projects/70508d81e5a04df1a8a60f5febb432f9/users/e5a1b0bf995745f5a84be30b8132f4e1/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:48:44.167081 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bfe1fd-b769-492f-b04a-b9388e7d7838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70508d81e5a04df1a8a60f5febb432f9, user_id=e5a1b0bf995745f5a84be30b8132f4e1, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:48:44.193775 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bfe1fd-b769-492f-b04a-b9388e7d7838 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:48:44.206980 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 732/1464] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:48:44 2021] PUT /identity/v3/projects/70508d81e5a04df1a8a60f5febb432f9/users/e5a1b0bf995745f5a84be30b8132f4e1/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:48:44.217854 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06024b7c-ee61-480d-a3db-a41aa6d95ed0 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:48:44.218151 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06024b7c-ee61-480d-a3db-a41aa6d95ed0 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:48:44.218434 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06024b7c-ee61-480d-a3db-a41aa6d95ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:48:44.255516 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-06024b7c-ee61-480d-a3db-a41aa6d95ed0 None None] MFA Rules not processed for user `e5a1b0bf995745f5a84be30b8132f4e1`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:48:44.256658 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-06024b7c-ee61-480d-a3db-a41aa6d95ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:48:44.327607 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 733/1465] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:48:44 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:48:44.338442 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfe1fd-b769-492f-b04a-b9388e7d7838 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:48:44.413550 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfe1fd-b769-492f-b04a-b9388e7d7838 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:48:44.418446 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dac12e-d24e-4501-9479-86c3f0c5e0fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:48:44.419055 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dac12e-d24e-4501-9479-86c3f0c5e0fc service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:48:44.419345 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dac12e-d24e-4501-9479-86c3f0c5e0fc service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:48:44.419630 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dac12e-d24e-4501-9479-86c3f0c5e0fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:48:44.427146 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dac12e-d24e-4501-9479-86c3f0c5e0fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:48:44.452541 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dac12e-d24e-4501-9479-86c3f0c5e0fc service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:48:44.461751 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 733/1466] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:48:44 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:48:44.538220 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a68d0-2816-468a-92ac-1ee44c4bd1dd None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:48:44.538517 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a68d0-2816-468a-92ac-1ee44c4bd1dd None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:48:44.538866 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a68d0-2816-468a-92ac-1ee44c4bd1dd None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:48:44.540516 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 734/1467] 10.222.0.37 () {52 vars in 829 bytes} [Wed Dec 29 20:48:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:48:44.544036 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dac12e-d24e-4501-9479-86c3f0c5e0fc service nova] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:48:44.611424 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dac12e-d24e-4501-9479-86c3f0c5e0fc service nova] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:48:44.616012 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361e35a-0df0-4ae3-82ca-0dc5a0dbb939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:48:44.616794 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361e35a-0df0-4ae3-82ca-0dc5a0dbb939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:48:44.617078 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361e35a-0df0-4ae3-82ca-0dc5a0dbb939 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:48:44.617355 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361e35a-0df0-4ae3-82ca-0dc5a0dbb939 admin admin] PATH_INFO: `/v3/users/e5a1b0bf995745f5a84be30b8132f4e1` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:48:44.618426 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361e35a-0df0-4ae3-82ca-0dc5a0dbb939 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5a1b0bf995745f5a84be30b8132f4e1)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:48:44.643545 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING py.warnings [None req-3361e35a-0df0-4ae3-82ca-0dc5a0dbb939 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:48:44.643545 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: warnings.warn(msg) Dec 29 20:48:44.643545 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: Dec 29 20:48:44.644732 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361e35a-0df0-4ae3-82ca-0dc5a0dbb939 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:48:44.704189 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-3361e35a-0df0-4ae3-82ca-0dc5a0dbb939 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5a1b0bf995745f5a84be30b8132f4e1'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:48:44.704872 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-3361e35a-0df0-4ae3-82ca-0dc5a0dbb939 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5a1b0bf995745f5a84be30b8132f4e1'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:48:44.716427 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-3361e35a-0df0-4ae3-82ca-0dc5a0dbb939 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5a1b0bf995745f5a84be30b8132f4e1'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:48:44.732167 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-3361e35a-0df0-4ae3-82ca-0dc5a0dbb939 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5a1b0bf995745f5a84be30b8132f4e1'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:48:44.740800 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-3361e35a-0df0-4ae3-82ca-0dc5a0dbb939 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5a1b0bf995745f5a84be30b8132f4e1'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:48:44.746577 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 734/1468] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:48:44 2021] DELETE /identity/v3/users/e5a1b0bf995745f5a84be30b8132f4e1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:48:44.750980 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d59588-b9b8-4071-9996-b4dcdad066d5 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:48:44.751279 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d59588-b9b8-4071-9996-b4dcdad066d5 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:48:44.751568 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d59588-b9b8-4071-9996-b4dcdad066d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:48:44.775206 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-35d59588-b9b8-4071-9996-b4dcdad066d5 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:48:44.776360 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-35d59588-b9b8-4071-9996-b4dcdad066d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:48:44.839407 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 735/1469] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:48:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:48:44.850186 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361e35a-0df0-4ae3-82ca-0dc5a0dbb939 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:48:44.851523 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-3361e35a-0df0-4ae3-82ca-0dc5a0dbb939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:48:44.914086 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361e35a-0df0-4ae3-82ca-0dc5a0dbb939 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:48:44.917365 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa09b0-cbbf-43d4-a351-2e7efa1bca94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:48:44.917939 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa09b0-cbbf-43d4-a351-2e7efa1bca94 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:48:44.918221 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa09b0-cbbf-43d4-a351-2e7efa1bca94 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:48:44.918497 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa09b0-cbbf-43d4-a351-2e7efa1bca94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:48:44.927766 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa09b0-cbbf-43d4-a351-2e7efa1bca94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:48:44.953039 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa09b0-cbbf-43d4-a351-2e7efa1bca94 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:48:44.961903 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 735/1470] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:48:44 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:48:45.368765 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d59588-b9b8-4071-9996-b4dcdad066d5 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:48:45.370095 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-35d59588-b9b8-4071-9996-b4dcdad066d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:48:45.381932 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d59588-b9b8-4071-9996-b4dcdad066d5 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:48:45.386224 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bf553-add2-4730-a11d-26eb1565e47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:48:45.387087 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bf553-add2-4730-a11d-26eb1565e47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:48:45.387320 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bf553-add2-4730-a11d-26eb1565e47a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:48:45.387601 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bf553-add2-4730-a11d-26eb1565e47a admin admin] PATH_INFO: `/v3/projects/70508d81e5a04df1a8a60f5febb432f9` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:48:45.388670 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0bf553-add2-4730-a11d-26eb1565e47a admin admin] RBAC: Authorizing `identity:delete_project(project_id=70508d81e5a04df1a8a60f5febb432f9)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:48:45.413840 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING py.warnings [None req-df0bf553-add2-4730-a11d-26eb1565e47a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:48:45.413840 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: warnings.warn(msg) Dec 29 20:48:45.413840 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: Dec 29 20:48:45.415129 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0bf553-add2-4730-a11d-26eb1565e47a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:48:45.470436 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-df0bf553-add2-4730-a11d-26eb1565e47a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70508d81e5a04df1a8a60f5febb432f9', 'request_id': 'req-df0bf553-add2-4730-a11d-26eb1565e47a'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:48:45.478735 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-df0bf553-add2-4730-a11d-26eb1565e47a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70508d81e5a04df1a8a60f5febb432f9', 'request_id': 'req-df0bf553-add2-4730-a11d-26eb1565e47a'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:48:45.489641 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-df0bf553-add2-4730-a11d-26eb1565e47a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70508d81e5a04df1a8a60f5febb432f9', 'request_id': 'req-df0bf553-add2-4730-a11d-26eb1565e47a'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:48:45.499171 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-df0bf553-add2-4730-a11d-26eb1565e47a admin admin] The token cache is being invalidate because project 70508d81e5a04df1a8a60f5febb432f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:48:45.499448 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-df0bf553-add2-4730-a11d-26eb1565e47a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:48:45.500046 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-df0bf553-add2-4730-a11d-26eb1565e47a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:48:45.501527 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 736/1471] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:48:45 2021] DELETE /identity/v3/projects/70508d81e5a04df1a8a60f5febb432f9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:50:09.145719 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3006c-97ed-44eb-8b9a-28a1e53a8fc3 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:09.146274 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3006c-97ed-44eb-8b9a-28a1e53a8fc3 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:09.146274 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3006c-97ed-44eb-8b9a-28a1e53a8fc3 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:09.147907 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 736/1472] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 29 20:50:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:50:09.152554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f048a1-8418-4591-aead-3ad8397eb174 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:09.152985 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f048a1-8418-4591-aead-3ad8397eb174 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:09.153119 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f048a1-8418-4591-aead-3ad8397eb174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:09.174778 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-48f048a1-8418-4591-aead-3ad8397eb174 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:50:09.175928 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-48f048a1-8418-4591-aead-3ad8397eb174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:50:09.238661 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 737/1473] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 29 20:50:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:50:09.393820 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3006c-97ed-44eb-8b9a-28a1e53a8fc3 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:50:09.395475 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-93b3006c-97ed-44eb-8b9a-28a1e53a8fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:50:09.478133 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3006c-97ed-44eb-8b9a-28a1e53a8fc3 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:50:09.482967 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7d3da-7805-4ab1-8fdb-b648e52b7d5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:50:09.483550 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7d3da-7805-4ab1-8fdb-b648e52b7d5b service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:09.483838 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7d3da-7805-4ab1-8fdb-b648e52b7d5b service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:09.484119 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7d3da-7805-4ab1-8fdb-b648e52b7d5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:09.492758 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7d3da-7805-4ab1-8fdb-b648e52b7d5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:50:09.518146 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7d3da-7805-4ab1-8fdb-b648e52b7d5b service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:50:09.527524 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 737/1474] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:50:09 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:50:09.971051 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a673c66-9ee9-4863-aa37-598d1ad3c7a4 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:09.971385 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a673c66-9ee9-4863-aa37-598d1ad3c7a4 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:09.971722 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a673c66-9ee9-4863-aa37-598d1ad3c7a4 None None] PATH_INFO: `/v3` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:09.972950 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 738/1475] 10.222.0.46 () {54 vars in 925 bytes} [Wed Dec 29 20:50:09 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:50:09.979702 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65bc03-6cff-4bb9-b702-9591f8d62283 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:09.980027 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65bc03-6cff-4bb9-b702-9591f8d62283 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:09.980315 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65bc03-6cff-4bb9-b702-9591f8d62283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:10.003018 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-eb65bc03-6cff-4bb9-b702-9591f8d62283 None None] MFA Rules not processed for user `25cb71bb64a3456fb2dc02095c487d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:50:10.004168 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-eb65bc03-6cff-4bb9-b702-9591f8d62283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:50:10.071091 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 738/1476] 10.222.0.46 () {58 vars in 1015 bytes} [Wed Dec 29 20:50:09 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:50:10.869496 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c8879-c86d-4e12-a534-941843fac9f7 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:10.870030 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c8879-c86d-4e12-a534-941843fac9f7 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:10.870030 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c8879-c86d-4e12-a534-941843fac9f7 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:10.871786 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 739/1477] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 29 20:50:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:50:10.876564 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3056f4-6357-4c0a-99a2-099163a17c76 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:10.877025 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3056f4-6357-4c0a-99a2-099163a17c76 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:10.877144 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3056f4-6357-4c0a-99a2-099163a17c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:10.899205 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-ce3056f4-6357-4c0a-99a2-099163a17c76 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:50:10.900744 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-ce3056f4-6357-4c0a-99a2-099163a17c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:50:10.907886 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 739/1478] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 29 20:50:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:50:11.056367 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c8879-c86d-4e12-a534-941843fac9f7 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:50:11.069515 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c8879-c86d-4e12-a534-941843fac9f7 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:50:11.074588 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aeb2c9-854e-4f53-8caa-77fe61f48ff0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:50:11.075177 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeb2c9-854e-4f53-8caa-77fe61f48ff0 service nova] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:11.075465 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeb2c9-854e-4f53-8caa-77fe61f48ff0 service nova] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:11.075746 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeb2c9-854e-4f53-8caa-77fe61f48ff0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:11.083540 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aeb2c9-854e-4f53-8caa-77fe61f48ff0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:50:11.109585 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aeb2c9-854e-4f53-8caa-77fe61f48ff0 service nova] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:50:11.119450 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 740/1479] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:50:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:50:13.771308 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4720f8b-3d7c-4286-bcc6-e3a06bd26a5b None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:13.771929 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4720f8b-3d7c-4286-bcc6-e3a06bd26a5b None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:13.771929 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4720f8b-3d7c-4286-bcc6-e3a06bd26a5b None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:13.774068 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 740/1480] 10.222.0.37 () {54 vars in 960 bytes} [Wed Dec 29 20:50:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:50:13.779025 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35673629-7865-4937-8b55-db2c960ee2e0 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:13.779467 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35673629-7865-4937-8b55-db2c960ee2e0 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:13.779578 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35673629-7865-4937-8b55-db2c960ee2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:13.802361 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-35673629-7865-4937-8b55-db2c960ee2e0 None None] MFA Rules not processed for user `25cb71bb64a3456fb2dc02095c487d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:50:13.803551 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-35673629-7865-4937-8b55-db2c960ee2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:50:13.810995 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 741/1481] 10.222.0.37 () {58 vars in 1057 bytes} [Wed Dec 29 20:50:13 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:50:13.818811 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4720f8b-3d7c-4286-bcc6-e3a06bd26a5b None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:50:13.831263 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4720f8b-3d7c-4286-bcc6-e3a06bd26a5b None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:50:13.836488 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c632d1d-c5f1-42cf-9b75-0fcba0082c14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25cb71bb64a3456fb2dc02095c487d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:50:13.837053 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c632d1d-c5f1-42cf-9b75-0fcba0082c14 service placement] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:13.837335 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c632d1d-c5f1-42cf-9b75-0fcba0082c14 service placement] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:13.837662 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c632d1d-c5f1-42cf-9b75-0fcba0082c14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:13.845780 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c632d1d-c5f1-42cf-9b75-0fcba0082c14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:50:13.871099 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c632d1d-c5f1-42cf-9b75-0fcba0082c14 service placement] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:50:13.880861 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 741/1482] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:50:13 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:50:22.904909 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bf450-42c5-4d4a-854e-e72ceb5602e7 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:22.905369 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bf450-42c5-4d4a-854e-e72ceb5602e7 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:22.905463 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bf450-42c5-4d4a-854e-e72ceb5602e7 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:22.907218 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 742/1483] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 29 20:50:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:50:22.911888 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217319d-5378-4230-a3d5-a1dc0f13e585 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:22.912879 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217319d-5378-4230-a3d5-a1dc0f13e585 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:22.913110 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217319d-5378-4230-a3d5-a1dc0f13e585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:22.935411 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-b217319d-5378-4230-a3d5-a1dc0f13e585 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:50:22.936543 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-b217319d-5378-4230-a3d5-a1dc0f13e585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:50:22.943616 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 742/1484] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 29 20:50:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:50:23.091889 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bf450-42c5-4d4a-854e-e72ceb5602e7 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:50:23.106047 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bf450-42c5-4d4a-854e-e72ceb5602e7 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:50:23.111037 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f051e18-e23e-49dd-88f5-23ce64741eb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:50:23.111606 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f051e18-e23e-49dd-88f5-23ce64741eb5 service nova] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:23.111894 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f051e18-e23e-49dd-88f5-23ce64741eb5 service nova] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:23.112178 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f051e18-e23e-49dd-88f5-23ce64741eb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:23.120532 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f051e18-e23e-49dd-88f5-23ce64741eb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:50:23.146363 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f051e18-e23e-49dd-88f5-23ce64741eb5 service nova] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:50:23.155835 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 743/1485] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:50:23 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:50:24.506573 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6a597-b2c9-4159-b4cc-003649606906 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:24.507277 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6a597-b2c9-4159-b4cc-003649606906 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:24.507277 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6a597-b2c9-4159-b4cc-003649606906 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:24.508879 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 743/1486] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 29 20:50:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:50:24.513485 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bf534-6ba4-471e-b01d-a9d695405849 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:24.513886 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bf534-6ba4-471e-b01d-a9d695405849 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:24.514057 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bf534-6ba4-471e-b01d-a9d695405849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:24.536744 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-bc4bf534-6ba4-471e-b01d-a9d695405849 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:50:24.538836 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-bc4bf534-6ba4-471e-b01d-a9d695405849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:50:24.545652 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 744/1487] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 29 20:50:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:50:24.695897 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6a597-b2c9-4159-b4cc-003649606906 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:50:24.709880 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6a597-b2c9-4159-b4cc-003649606906 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:50:24.715070 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769aeb9-b9b0-45d6-bbd2-b37e234458d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:50:24.715631 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769aeb9-b9b0-45d6-bbd2-b37e234458d2 service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:24.715914 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769aeb9-b9b0-45d6-bbd2-b37e234458d2 service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:24.716188 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769aeb9-b9b0-45d6-bbd2-b37e234458d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:24.723926 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769aeb9-b9b0-45d6-bbd2-b37e234458d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:50:24.749118 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769aeb9-b9b0-45d6-bbd2-b37e234458d2 service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:50:24.758373 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 744/1488] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:50:24 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:50:28.626817 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f384c-1dfa-4a49-b85f-1a4267c15357 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:28.627352 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f384c-1dfa-4a49-b85f-1a4267c15357 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:28.627352 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f384c-1dfa-4a49-b85f-1a4267c15357 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:28.629068 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 745/1489] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 29 20:50:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:50:28.635384 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294c98d-ea73-4755-ae7d-0a6ca5c38150 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:28.635791 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294c98d-ea73-4755-ae7d-0a6ca5c38150 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:28.635962 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294c98d-ea73-4755-ae7d-0a6ca5c38150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:28.659385 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-d294c98d-ea73-4755-ae7d-0a6ca5c38150 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:50:28.660508 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-d294c98d-ea73-4755-ae7d-0a6ca5c38150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:50:28.668029 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 745/1490] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 29 20:50:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:50:28.704136 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f384c-1dfa-4a49-b85f-1a4267c15357 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:50:28.705737 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-6e6f384c-1dfa-4a49-b85f-1a4267c15357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:50:28.768550 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f384c-1dfa-4a49-b85f-1a4267c15357 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:50:28.772944 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb07877-35b3-452a-a4ff-42125db44bef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:50:28.773509 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb07877-35b3-452a-a4ff-42125db44bef service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:28.773794 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb07877-35b3-452a-a4ff-42125db44bef service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:28.774074 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb07877-35b3-452a-a4ff-42125db44bef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:28.782528 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb07877-35b3-452a-a4ff-42125db44bef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:50:28.808220 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb07877-35b3-452a-a4ff-42125db44bef service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:50:28.817012 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 746/1491] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:50:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:50:30.764411 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e9e46-cf7b-4b66-9d1b-efb14745aafa None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:30.765009 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e9e46-cf7b-4b66-9d1b-efb14745aafa None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:30.765009 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e9e46-cf7b-4b66-9d1b-efb14745aafa None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:30.766668 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 746/1492] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 29 20:50:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 29 20:50:30.772534 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a6bc1-0f93-4c23-a3f6-6873de613db4 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:30.773030 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a6bc1-0f93-4c23-a3f6-6873de613db4 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:30.773265 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a6bc1-0f93-4c23-a3f6-6873de613db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:30.796018 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-f90a6bc1-0f93-4c23-a3f6-6873de613db4 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:50:30.797148 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-f90a6bc1-0f93-4c23-a3f6-6873de613db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:50:30.804201 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 747/1493] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 29 20:50:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:50:30.840280 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e9e46-cf7b-4b66-9d1b-efb14745aafa None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:50:30.850586 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e9e46-cf7b-4b66-9d1b-efb14745aafa None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:50:30.853787 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5cd91-dc50-4132-850b-b50bff330017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:50:30.854345 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5cd91-dc50-4132-850b-b50bff330017 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:30.854633 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5cd91-dc50-4132-850b-b50bff330017 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:30.854937 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5cd91-dc50-4132-850b-b50bff330017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:30.863459 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5cd91-dc50-4132-850b-b50bff330017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:50:30.889225 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5cd91-dc50-4132-850b-b50bff330017 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:50:30.899204 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 747/1494] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:50:30 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:50:34.141553 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c869f-1ef3-4fdf-8cb4-7b463ba8e7f0 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:34.142184 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c869f-1ef3-4fdf-8cb4-7b463ba8e7f0 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:34.142184 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c869f-1ef3-4fdf-8cb4-7b463ba8e7f0 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:34.143736 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 748/1495] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 29 20:50:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:50:34.151330 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b442b-676e-400d-9c12-81dc117d8ca0 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:34.151815 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b442b-676e-400d-9c12-81dc117d8ca0 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:34.151927 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b442b-676e-400d-9c12-81dc117d8ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:34.176104 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-d53b442b-676e-400d-9c12-81dc117d8ca0 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:50:34.177324 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-d53b442b-676e-400d-9c12-81dc117d8ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:50:34.184221 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 748/1496] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 29 20:50:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:50:34.241205 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c869f-1ef3-4fdf-8cb4-7b463ba8e7f0 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:50:34.242797 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-9a7c869f-1ef3-4fdf-8cb4-7b463ba8e7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:50:34.306998 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c869f-1ef3-4fdf-8cb4-7b463ba8e7f0 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:50:34.310219 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a48042-1959-47e8-add7-a621d92c891b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:50:34.310811 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a48042-1959-47e8-add7-a621d92c891b service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:34.311099 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a48042-1959-47e8-add7-a621d92c891b service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:34.311376 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a48042-1959-47e8-add7-a621d92c891b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:34.320255 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a48042-1959-47e8-add7-a621d92c891b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:50:34.345863 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a48042-1959-47e8-add7-a621d92c891b service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:50:34.355897 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 749/1497] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:50:34 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:50:36.328807 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f553b4-3760-4fbe-8aac-d40890bce6b8 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:36.329323 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f553b4-3760-4fbe-8aac-d40890bce6b8 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:36.329432 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f553b4-3760-4fbe-8aac-d40890bce6b8 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:36.331110 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 749/1498] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 29 20:50:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:50:36.336149 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0de077-40da-4dda-9f5a-7ab2e9bf42b1 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:36.336550 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0de077-40da-4dda-9f5a-7ab2e9bf42b1 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:36.336720 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0de077-40da-4dda-9f5a-7ab2e9bf42b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:36.358917 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-2c0de077-40da-4dda-9f5a-7ab2e9bf42b1 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:50:36.360025 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-2c0de077-40da-4dda-9f5a-7ab2e9bf42b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:50:36.367545 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 750/1499] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 29 20:50:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:50:36.423679 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390150a-946f-4632-b659-1d4c14fd7861 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:36.423967 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390150a-946f-4632-b659-1d4c14fd7861 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:36.424269 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390150a-946f-4632-b659-1d4c14fd7861 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:36.425936 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 750/1500] 10.222.0.37 () {54 vars in 961 bytes} [Wed Dec 29 20:50:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:50:36.431301 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992709a-790a-42a5-81ba-c5b2b0bf2621 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:36.431596 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992709a-790a-42a5-81ba-c5b2b0bf2621 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:36.431882 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992709a-790a-42a5-81ba-c5b2b0bf2621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:36.454727 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-e992709a-790a-42a5-81ba-c5b2b0bf2621 None None] MFA Rules not processed for user `72f5c4b1a0e942ae9a16cda3b34e0cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:50:36.455845 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-e992709a-790a-42a5-81ba-c5b2b0bf2621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:50:36.461753 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 751/1501] 10.222.0.37 () {58 vars in 1058 bytes} [Wed Dec 29 20:50:36 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:50:36.469009 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390150a-946f-4632-b659-1d4c14fd7861 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:50:36.480683 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390150a-946f-4632-b659-1d4c14fd7861 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:50:36.483890 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23cf03-724b-45ae-af21-42f03572f39f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:50:36.484451 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23cf03-724b-45ae-af21-42f03572f39f service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:50:36.484735 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23cf03-724b-45ae-af21-42f03572f39f service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:50:36.485013 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23cf03-724b-45ae-af21-42f03572f39f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:50:36.493918 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23cf03-724b-45ae-af21-42f03572f39f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:50:36.519718 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23cf03-724b-45ae-af21-42f03572f39f service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:50:36.528536 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 751/1502] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:50:36 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:02.593539 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88ef98-1d0f-42e6-98b2-cbb6b957fe19 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:02.594139 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88ef98-1d0f-42e6-98b2-cbb6b957fe19 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:02.594139 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88ef98-1d0f-42e6-98b2-cbb6b957fe19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:02.619584 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-6a88ef98-1d0f-42e6-98b2-cbb6b957fe19 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:02.620739 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-6a88ef98-1d0f-42e6-98b2-cbb6b957fe19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:02.633431 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 752/1503] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:02.641935 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2714dfc-9c89-4d7c-ae75-61a75f4c0cc6 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:02.643598 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2714dfc-9c89-4d7c-ae75-61a75f4c0cc6 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:02.644056 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2714dfc-9c89-4d7c-ae75-61a75f4c0cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:02.682416 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-e2714dfc-9c89-4d7c-ae75-61a75f4c0cc6 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:02.683854 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-e2714dfc-9c89-4d7c-ae75-61a75f4c0cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:02.694918 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 752/1504] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:02.699933 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88ef98-1d0f-42e6-98b2-cbb6b957fe19 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:02.710450 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88ef98-1d0f-42e6-98b2-cbb6b957fe19 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:02.722590 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410d7c0-32a7-46ed-9f93-c9cb69cd6264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:02.723450 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410d7c0-32a7-46ed-9f93-c9cb69cd6264 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:02.723892 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410d7c0-32a7-46ed-9f93-c9cb69cd6264 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:02.724338 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410d7c0-32a7-46ed-9f93-c9cb69cd6264 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:02.725207 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410d7c0-32a7-46ed-9f93-c9cb69cd6264 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:52:02.725664 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410d7c0-32a7-46ed-9f93-c9cb69cd6264 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:02.756441 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410d7c0-32a7-46ed-9f93-c9cb69cd6264 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:02.774844 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 753/1505] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:52:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:52:02.779988 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2714dfc-9c89-4d7c-ae75-61a75f4c0cc6 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:02.796783 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2714dfc-9c89-4d7c-ae75-61a75f4c0cc6 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:02.801608 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97761c4-5b68-47e1-88e8-91eb6449d96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:02.802437 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97761c4-5b68-47e1-88e8-91eb6449d96e admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:02.802969 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97761c4-5b68-47e1-88e8-91eb6449d96e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:02.803498 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97761c4-5b68-47e1-88e8-91eb6449d96e admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:02.804347 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97761c4-5b68-47e1-88e8-91eb6449d96e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:02.837648 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97761c4-5b68-47e1-88e8-91eb6449d96e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:02.888699 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 753/1506] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:02 2021] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:02.894128 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410d7c0-32a7-46ed-9f93-c9cb69cd6264 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:02.903956 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410d7c0-32a7-46ed-9f93-c9cb69cd6264 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:02.964221 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc3787-b5e8-4f14-b40a-557f94d3cb6c None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:02.964851 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc3787-b5e8-4f14-b40a-557f94d3cb6c None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:02.965336 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc3787-b5e8-4f14-b40a-557f94d3cb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.003629 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-42cc3787-b5e8-4f14-b40a-557f94d3cb6c None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:03.005185 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-42cc3787-b5e8-4f14-b40a-557f94d3cb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:03.023367 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbde28-8fd0-4c31-833a-cdeecaedb6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:03.023979 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbde28-8fd0-4c31-833a-cdeecaedb6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.024272 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbde28-8fd0-4c31-833a-cdeecaedb6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.024558 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbde28-8fd0-4c31-833a-cdeecaedb6d4 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.025200 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbde28-8fd0-4c31-833a-cdeecaedb6d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:03.056191 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbde28-8fd0-4c31-833a-cdeecaedb6d4 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:03.088489 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 754/1507] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:03.093722 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 754/1508] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:02 2021] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:03.095143 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc3787-b5e8-4f14-b40a-557f94d3cb6c None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:03.099084 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3460a1-5d2e-4bc0-ada9-28ce3944ca1c None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.099590 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3460a1-5d2e-4bc0-ada9-28ce3944ca1c None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.100023 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3460a1-5d2e-4bc0-ada9-28ce3944ca1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.106435 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc3787-b5e8-4f14-b40a-557f94d3cb6c None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:03.117169 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a06c47-1dac-4a95-a603-90b679f77440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:03.118215 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a06c47-1dac-4a95-a603-90b679f77440 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.118760 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a06c47-1dac-4a95-a603-90b679f77440 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.119283 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a06c47-1dac-4a95-a603-90b679f77440 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.120201 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a06c47-1dac-4a95-a603-90b679f77440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:03.135610 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-ce3460a1-5d2e-4bc0-ada9-28ce3944ca1c None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:03.136782 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-ce3460a1-5d2e-4bc0-ada9-28ce3944ca1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:03.153234 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 755/1509] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:52:03.159242 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3460a1-5d2e-4bc0-ada9-28ce3944ca1c None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:03.160620 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a06c47-1dac-4a95-a603-90b679f77440 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:03.174613 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 755/1510] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:03 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:52:03.177593 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3460a1-5d2e-4bc0-ada9-28ce3944ca1c None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:03.178841 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a06c47-1dac-4a95-a603-90b679f77440 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:03.184884 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7a14d-a164-40a9-81eb-d902b875ed27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:03.185487 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7a14d-a164-40a9-81eb-d902b875ed27 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.185771 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7a14d-a164-40a9-81eb-d902b875ed27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.186056 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7a14d-a164-40a9-81eb-d902b875ed27 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.186779 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7a14d-a164-40a9-81eb-d902b875ed27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:52:03.187076 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7a14d-a164-40a9-81eb-d902b875ed27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:03.193647 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a06c47-1dac-4a95-a603-90b679f77440 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:03.207307 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca702b2-0c3a-4e2d-9e25-f582a0ec0183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:03.208484 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca702b2-0c3a-4e2d-9e25-f582a0ec0183 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.208990 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca702b2-0c3a-4e2d-9e25-f582a0ec0183 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.209490 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca702b2-0c3a-4e2d-9e25-f582a0ec0183 admin admin] PATH_INFO: `/v3/projects/29638b216f1044a88c1935b8182f9952/users/612f72c7b1cd4389b0c3bf4c3ee4f656/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.243564 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7a14d-a164-40a9-81eb-d902b875ed27 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:03.244759 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca702b2-0c3a-4e2d-9e25-f582a0ec0183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29638b216f1044a88c1935b8182f9952, user_id=612f72c7b1cd4389b0c3bf4c3ee4f656, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:03.276997 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 756/1511] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:52:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:52:03.278270 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd7c77-4ad6-443e-89d2-a1e6a59d19ef None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.278562 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd7c77-4ad6-443e-89d2-a1e6a59d19ef None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.278905 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd7c77-4ad6-443e-89d2-a1e6a59d19ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.292489 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca702b2-0c3a-4e2d-9e25-f582a0ec0183 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:03.315655 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-d0fd7c77-4ad6-443e-89d2-a1e6a59d19ef None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:03.316954 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-d0fd7c77-4ad6-443e-89d2-a1e6a59d19ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:03.329662 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 756/1512] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:03 2021] PUT /identity/v3/projects/29638b216f1044a88c1935b8182f9952/users/612f72c7b1cd4389b0c3bf4c3ee4f656/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:03.332330 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04820b-6849-431b-82cb-78ac0c581ad6 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.332629 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04820b-6849-431b-82cb-78ac0c581ad6 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.332920 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04820b-6849-431b-82cb-78ac0c581ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.387793 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-ee04820b-6849-431b-82cb-78ac0c581ad6 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:03.388944 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-ee04820b-6849-431b-82cb-78ac0c581ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:03.423136 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 757/1513] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:03.424858 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd7c77-4ad6-443e-89d2-a1e6a59d19ef None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:03.435091 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd7c77-4ad6-443e-89d2-a1e6a59d19ef None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:03.441966 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2112c-9184-4d09-8437-59a214e85007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:03.443000 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2112c-9184-4d09-8437-59a214e85007 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.443479 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2112c-9184-4d09-8437-59a214e85007 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.443960 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2112c-9184-4d09-8437-59a214e85007 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.444796 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2112c-9184-4d09-8437-59a214e85007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:03.477519 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 757/1514] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:03.478977 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c006846-4fa1-4173-a3c1-691f9152e784 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.479348 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c006846-4fa1-4173-a3c1-691f9152e784 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.479526 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2112c-9184-4d09-8437-59a214e85007 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:03.479705 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c006846-4fa1-4173-a3c1-691f9152e784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.510992 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 758/1515] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:03 2021] POST /identity/v3/projects => generated 389 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:03.512286 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b490260-8fb9-4133-8f37-c57d7e2bd78f None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.512583 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b490260-8fb9-4133-8f37-c57d7e2bd78f None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.512881 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b490260-8fb9-4133-8f37-c57d7e2bd78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.519645 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-8c006846-4fa1-4173-a3c1-691f9152e784 None None] MFA Rules not processed for user `612f72c7b1cd4389b0c3bf4c3ee4f656`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:03.520807 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-8c006846-4fa1-4173-a3c1-691f9152e784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:03.535260 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-5b490260-8fb9-4133-8f37-c57d7e2bd78f None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:03.536409 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-5b490260-8fb9-4133-8f37-c57d7e2bd78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:03.596908 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 758/1516] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:03 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:03.598169 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b986bd-dbd8-4e8a-ad00-a301ac38dad1 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.598467 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b986bd-dbd8-4e8a-ad00-a301ac38dad1 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.599110 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b986bd-dbd8-4e8a-ad00-a301ac38dad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.606621 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 759/1517] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:03.608295 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3fdbc-a2f2-435f-a7f3-b98b23ae3057 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.608814 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3fdbc-a2f2-435f-a7f3-b98b23ae3057 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.609102 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3fdbc-a2f2-435f-a7f3-b98b23ae3057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.622408 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-b7b986bd-dbd8-4e8a-ad00-a301ac38dad1 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:03.624251 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-b7b986bd-dbd8-4e8a-ad00-a301ac38dad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:03.633493 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 759/1518] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:03.635064 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e530c42-7cfd-4c25-8ae0-e3e3cebd8d29 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.635526 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e530c42-7cfd-4c25-8ae0-e3e3cebd8d29 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.635901 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-36b3fdbc-a2f2-435f-a7f3-b98b23ae3057 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:03.636168 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e530c42-7cfd-4c25-8ae0-e3e3cebd8d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.637035 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-36b3fdbc-a2f2-435f-a7f3-b98b23ae3057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:03.645212 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 760/1519] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:03.646533 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578710f-625b-4218-9647-9d3de4e37403 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.646855 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578710f-625b-4218-9647-9d3de4e37403 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.647142 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578710f-625b-4218-9647-9d3de4e37403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.664765 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-1e530c42-7cfd-4c25-8ae0-e3e3cebd8d29 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:03.665910 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-1e530c42-7cfd-4c25-8ae0-e3e3cebd8d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:03.668939 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-5578710f-625b-4218-9647-9d3de4e37403 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:03.670037 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-5578710f-625b-4218-9647-9d3de4e37403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:03.673862 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 760/1520] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:03.675159 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994eab0-2ed4-471f-bfb4-cd110abcd58b None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.675159 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994eab0-2ed4-471f-bfb4-cd110abcd58b None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.675358 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994eab0-2ed4-471f-bfb4-cd110abcd58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.685372 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 761/1521] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:03.685372 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578710f-625b-4218-9647-9d3de4e37403 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:03.689031 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578710f-625b-4218-9647-9d3de4e37403 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:03.693798 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba2055-351f-4038-bb8d-3cd7e43c52b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:03.694384 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba2055-351f-4038-bb8d-3cd7e43c52b6 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.694696 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba2055-351f-4038-bb8d-3cd7e43c52b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.694982 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba2055-351f-4038-bb8d-3cd7e43c52b6 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.695612 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba2055-351f-4038-bb8d-3cd7e43c52b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:03.701355 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-2994eab0-2ed4-471f-bfb4-cd110abcd58b None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:03.702489 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-2994eab0-2ed4-471f-bfb4-cd110abcd58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:03.710225 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 761/1522] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:03.711415 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119b3bf-fc02-4e65-9b36-d48498edb539 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.711705 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119b3bf-fc02-4e65-9b36-d48498edb539 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.711988 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119b3bf-fc02-4e65-9b36-d48498edb539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.722520 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba2055-351f-4038-bb8d-3cd7e43c52b6 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:03.733920 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-0119b3bf-fc02-4e65-9b36-d48498edb539 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:03.735348 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-0119b3bf-fc02-4e65-9b36-d48498edb539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:03.746503 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 762/1524] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:03.746695 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 762/1524] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:03 2021] POST /identity/v3/users => generated 295 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:03.746796 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd3166-a789-4835-b940-a567f5bacd0a None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.746796 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd3166-a789-4835-b940-a567f5bacd0a None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.746796 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd3166-a789-4835-b940-a567f5bacd0a None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.747075 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 763/1525] 10.222.0.37 () {54 vars in 959 bytes} [Wed Dec 29 20:52:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:52:03.747879 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74483a29-80dc-403e-b7ba-6e0143a1ff1e None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.748167 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74483a29-80dc-403e-b7ba-6e0143a1ff1e None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.748455 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba2055-351f-4038-bb8d-3cd7e43c52b6 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:03.748564 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74483a29-80dc-403e-b7ba-6e0143a1ff1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.758176 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba2055-351f-4038-bb8d-3cd7e43c52b6 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:03.762237 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd214f3-db0f-4411-976d-c40f2f28ed30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:03.762840 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd214f3-db0f-4411-976d-c40f2f28ed30 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.763124 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd214f3-db0f-4411-976d-c40f2f28ed30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.763399 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd214f3-db0f-4411-976d-c40f2f28ed30 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.764079 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd214f3-db0f-4411-976d-c40f2f28ed30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:52:03.764374 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd214f3-db0f-4411-976d-c40f2f28ed30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:03.771426 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-74483a29-80dc-403e-b7ba-6e0143a1ff1e None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:03.772584 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-74483a29-80dc-403e-b7ba-6e0143a1ff1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:03.779617 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 764/1526] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:03.780845 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4ef31-853c-4734-bf48-19c152660137 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.781139 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4ef31-853c-4734-bf48-19c152660137 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.781421 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4ef31-853c-4734-bf48-19c152660137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.790425 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd214f3-db0f-4411-976d-c40f2f28ed30 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:03.803442 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-03f4ef31-853c-4734-bf48-19c152660137 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:03.803646 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 763/1527] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:52:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:52:03.804740 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8ea27-16a2-4e02-97c7-1f6c5725c012 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.805030 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8ea27-16a2-4e02-97c7-1f6c5725c012 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.805311 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8ea27-16a2-4e02-97c7-1f6c5725c012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.807898 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-03f4ef31-853c-4734-bf48-19c152660137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:03.822816 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 765/1528] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:03.823679 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4ef31-853c-4734-bf48-19c152660137 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:03.827479 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-4df8ea27-16a2-4e02-97c7-1f6c5725c012 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:03.828599 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-4df8ea27-16a2-4e02-97c7-1f6c5725c012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:03.833231 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4ef31-853c-4734-bf48-19c152660137 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:03.837398 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0b926-410d-4299-b889-526d5cbbe9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:03.837959 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 764/1529] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:03.838084 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0b926-410d-4299-b889-526d5cbbe9bb admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.838286 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0b926-410d-4299-b889-526d5cbbe9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.838615 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0b926-410d-4299-b889-526d5cbbe9bb admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.839303 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0b926-410d-4299-b889-526d5cbbe9bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:52:03.839605 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0b926-410d-4299-b889-526d5cbbe9bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:03.839820 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8ea27-16a2-4e02-97c7-1f6c5725c012 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:03.851391 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8ea27-16a2-4e02-97c7-1f6c5725c012 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:03.855898 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4437e33-9893-452a-95c7-eb73f606a764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:03.856790 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4437e33-9893-452a-95c7-eb73f606a764 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.857228 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4437e33-9893-452a-95c7-eb73f606a764 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.857660 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4437e33-9893-452a-95c7-eb73f606a764 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.858599 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4437e33-9893-452a-95c7-eb73f606a764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:03.866267 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0b926-410d-4299-b889-526d5cbbe9bb admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:03.879796 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 766/1530] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:52:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:52:03.881403 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0b926-410d-4299-b889-526d5cbbe9bb admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:03.889193 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4437e33-9893-452a-95c7-eb73f606a764 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:03.891994 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0b926-410d-4299-b889-526d5cbbe9bb admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:03.896740 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a6d0e-3ea2-4305-ae29-4334d4e55eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:03.897353 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a6d0e-3ea2-4305-ae29-4334d4e55eef admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.897642 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a6d0e-3ea2-4305-ae29-4334d4e55eef admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.897923 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a6d0e-3ea2-4305-ae29-4334d4e55eef admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.898603 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a6d0e-3ea2-4305-ae29-4334d4e55eef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:52:03.898943 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a6d0e-3ea2-4305-ae29-4334d4e55eef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:03.900600 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 765/1531] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:03 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:03.901811 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e68cad-2eed-4be4-950c-50f992f19b98 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.902105 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e68cad-2eed-4be4-950c-50f992f19b98 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.902388 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e68cad-2eed-4be4-950c-50f992f19b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.925414 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-02e68cad-2eed-4be4-950c-50f992f19b98 None None] MFA Rules not processed for user `51ef7e54d97a4320bda0c1926d190d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:03.925812 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a6d0e-3ea2-4305-ae29-4334d4e55eef admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:03.926480 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-02e68cad-2eed-4be4-950c-50f992f19b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:03.946199 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 767/1532] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:52:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:52:03.946199 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a6d0e-3ea2-4305-ae29-4334d4e55eef admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:03.956142 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a6d0e-3ea2-4305-ae29-4334d4e55eef admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:03.960252 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffb9b7-0649-4ffd-a43d-f74d5a6876b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:03.960831 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffb9b7-0649-4ffd-a43d-f74d5a6876b3 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:03.961122 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffb9b7-0649-4ffd-a43d-f74d5a6876b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:03.961406 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffb9b7-0649-4ffd-a43d-f74d5a6876b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:03.962303 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffb9b7-0649-4ffd-a43d-f74d5a6876b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:52:03.962625 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffb9b7-0649-4ffd-a43d-f74d5a6876b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:03.989052 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffb9b7-0649-4ffd-a43d-f74d5a6876b3 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:04.000278 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 766/1533] 10.222.0.37 () {58 vars in 1056 bytes} [Wed Dec 29 20:52:03 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:04.001105 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e68cad-2eed-4be4-950c-50f992f19b98 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:04.003595 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 768/1534] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:52:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:52:04.011405 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffb9b7-0649-4ffd-a43d-f74d5a6876b3 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:04.011693 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e68cad-2eed-4be4-950c-50f992f19b98 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:04.015725 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb5fe0-4c50-4bc2-a0ad-cfcc02de93e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:04.016312 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb5fe0-4c50-4bc2-a0ad-cfcc02de93e7 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:04.016598 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb5fe0-4c50-4bc2-a0ad-cfcc02de93e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:04.016877 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb5fe0-4c50-4bc2-a0ad-cfcc02de93e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:04.017604 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb5fe0-4c50-4bc2-a0ad-cfcc02de93e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:04.020612 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffb9b7-0649-4ffd-a43d-f74d5a6876b3 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:04.024705 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e42b4-351c-4f25-92dd-b8a4777ccbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:04.025281 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e42b4-351c-4f25-92dd-b8a4777ccbe0 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:04.025572 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e42b4-351c-4f25-92dd-b8a4777ccbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:04.025861 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e42b4-351c-4f25-92dd-b8a4777ccbe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:04.026545 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e42b4-351c-4f25-92dd-b8a4777ccbe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:52:04.026883 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e42b4-351c-4f25-92dd-b8a4777ccbe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:04.042954 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb5fe0-4c50-4bc2-a0ad-cfcc02de93e7 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:04.053139 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e42b4-351c-4f25-92dd-b8a4777ccbe0 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:04.067232 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 769/1535] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:52:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:52:04.068052 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e42b4-351c-4f25-92dd-b8a4777ccbe0 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:04.076756 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 767/1536] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:04 2021] POST /identity/v3/projects => generated 365 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:04.077562 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb5fe0-4c50-4bc2-a0ad-cfcc02de93e7 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:04.077846 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e42b4-351c-4f25-92dd-b8a4777ccbe0 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:04.142397 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ed43d-4d3f-41f6-b39a-cf37de38df69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:04.143041 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ed43d-4d3f-41f6-b39a-cf37de38df69 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:04.143335 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ed43d-4d3f-41f6-b39a-cf37de38df69 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:04.143617 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ed43d-4d3f-41f6-b39a-cf37de38df69 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:04.144307 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ed43d-4d3f-41f6-b39a-cf37de38df69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:52:04.144607 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ed43d-4d3f-41f6-b39a-cf37de38df69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:04.146638 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb5fe0-4c50-4bc2-a0ad-cfcc02de93e7 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:04.150823 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd591d9c-7379-4988-93fe-4595fb3506a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:04.151403 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd591d9c-7379-4988-93fe-4595fb3506a4 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:04.151690 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd591d9c-7379-4988-93fe-4595fb3506a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:04.151969 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd591d9c-7379-4988-93fe-4595fb3506a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:04.152595 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd591d9c-7379-4988-93fe-4595fb3506a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:04.169959 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ed43d-4d3f-41f6-b39a-cf37de38df69 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:04.178203 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd591d9c-7379-4988-93fe-4595fb3506a4 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:04.182726 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 770/1537] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:52:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:52:04.184249 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ed43d-4d3f-41f6-b39a-cf37de38df69 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:04.194214 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ed43d-4d3f-41f6-b39a-cf37de38df69 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:04.199636 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea209c7-46b4-4b64-bdf7-61480e9b0f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:04.200562 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea209c7-46b4-4b64-bdf7-61480e9b0f69 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:04.200889 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea209c7-46b4-4b64-bdf7-61480e9b0f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:04.201172 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea209c7-46b4-4b64-bdf7-61480e9b0f69 admin admin] PATH_INFO: `/v3/projects/bee7e931feeb451ba07870c825abc1ae/users/571a3b9c133a4831b3e2f97b588db5bb/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:04.209057 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 768/1538] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:04 2021] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:04.209057 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd591d9c-7379-4988-93fe-4595fb3506a4 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:04.223161 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea209c7-46b4-4b64-bdf7-61480e9b0f69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bee7e931feeb451ba07870c825abc1ae, user_id=571a3b9c133a4831b3e2f97b588db5bb, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:04.250185 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea209c7-46b4-4b64-bdf7-61480e9b0f69 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:04.263207 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 771/1539] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:04 2021] PUT /identity/v3/projects/bee7e931feeb451ba07870c825abc1ae/users/571a3b9c133a4831b3e2f97b588db5bb/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:04.263778 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea209c7-46b4-4b64-bdf7-61480e9b0f69 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:04.277330 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd591d9c-7379-4988-93fe-4595fb3506a4 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:04.339039 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69591e7-bcb6-4cde-9de4-7453e6e60e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:04.339628 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69591e7-bcb6-4cde-9de4-7453e6e60e9a admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:04.339918 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69591e7-bcb6-4cde-9de4-7453e6e60e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:04.340200 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69591e7-bcb6-4cde-9de4-7453e6e60e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:04.340550 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea209c7-46b4-4b64-bdf7-61480e9b0f69 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:04.340829 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69591e7-bcb6-4cde-9de4-7453e6e60e9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:04.346149 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22158713-8606-4e2f-89b3-7d094d3c6690 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:04.346776 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22158713-8606-4e2f-89b3-7d094d3c6690 service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:04.347069 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22158713-8606-4e2f-89b3-7d094d3c6690 service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:04.347351 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22158713-8606-4e2f-89b3-7d094d3c6690 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:04.367087 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69591e7-bcb6-4cde-9de4-7453e6e60e9a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:04.396239 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 769/1540] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:04 2021] POST /identity/v3/projects => generated 381 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:04.397045 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69591e7-bcb6-4cde-9de4-7453e6e60e9a admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:04.412621 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22158713-8606-4e2f-89b3-7d094d3c6690 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:04.438361 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22158713-8606-4e2f-89b3-7d094d3c6690 service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:04.447791 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 772/1541] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:04 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:04.448567 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22158713-8606-4e2f-89b3-7d094d3c6690 service nova] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:04.458418 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22158713-8606-4e2f-89b3-7d094d3c6690 service nova] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:04.463212 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305b188-58e2-46b1-9607-f31701cb13e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:04.463780 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305b188-58e2-46b1-9607-f31701cb13e9 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:04.464069 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305b188-58e2-46b1-9607-f31701cb13e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:04.464355 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305b188-58e2-46b1-9607-f31701cb13e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:04.464700 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69591e7-bcb6-4cde-9de4-7453e6e60e9a admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:04.464983 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305b188-58e2-46b1-9607-f31701cb13e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:04.468748 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fa25f-ac01-45fd-85b0-44be6a4e9541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:04.469328 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fa25f-ac01-45fd-85b0-44be6a4e9541 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:04.469613 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fa25f-ac01-45fd-85b0-44be6a4e9541 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:04.469888 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fa25f-ac01-45fd-85b0-44be6a4e9541 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:04.471106 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5fa25f-ac01-45fd-85b0-44be6a4e9541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:04.491628 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305b188-58e2-46b1-9607-f31701cb13e9 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:04.497350 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5fa25f-ac01-45fd-85b0-44be6a4e9541 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:04.520051 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 773/1542] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:04 2021] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:04.521280 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305b188-58e2-46b1-9607-f31701cb13e9 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:04.528804 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 770/1543] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:04 2021] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:04.528804 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fa25f-ac01-45fd-85b0-44be6a4e9541 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:04.591062 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305b188-58e2-46b1-9607-f31701cb13e9 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:04.593783 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fa25f-ac01-45fd-85b0-44be6a4e9541 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:04.596135 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9209f-0299-4b10-9ad8-969eac7f4524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:04.597111 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9209f-0299-4b10-9ad8-969eac7f4524 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:04.597464 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9209f-0299-4b10-9ad8-969eac7f4524 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:04.597812 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9209f-0299-4b10-9ad8-969eac7f4524 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:04.598559 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9209f-0299-4b10-9ad8-969eac7f4524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:04.598855 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17279652-158d-45f6-8f14-4ba168e54086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:04.599433 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17279652-158d-45f6-8f14-4ba168e54086 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:04.599720 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17279652-158d-45f6-8f14-4ba168e54086 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:04.599998 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17279652-158d-45f6-8f14-4ba168e54086 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:04.600613 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17279652-158d-45f6-8f14-4ba168e54086 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:04.624971 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9209f-0299-4b10-9ad8-969eac7f4524 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:04.625904 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17279652-158d-45f6-8f14-4ba168e54086 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:04.648543 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 774/1544] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:04 2021] POST /identity/v3/users => generated 283 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:04.649835 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9209f-0299-4b10-9ad8-969eac7f4524 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:04.660955 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 771/1545] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:04 2021] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:04.660955 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e43ab-e2df-44f4-a544-a4f9138a75d1 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:04.660955 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e43ab-e2df-44f4-a544-a4f9138a75d1 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:04.660955 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e43ab-e2df-44f4-a544-a4f9138a75d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:04.665431 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9209f-0299-4b10-9ad8-969eac7f4524 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:04.687411 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-b51e43ab-e2df-44f4-a544-a4f9138a75d1 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:04.688758 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-b51e43ab-e2df-44f4-a544-a4f9138a75d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:04.734666 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e6ea2-107e-4792-be87-f40fe0d46c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:04.735279 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e6ea2-107e-4792-be87-f40fe0d46c55 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:04.735566 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e6ea2-107e-4792-be87-f40fe0d46c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:04.735872 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e6ea2-107e-4792-be87-f40fe0d46c55 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:04.737073 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e6ea2-107e-4792-be87-f40fe0d46c55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:04.761610 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 772/1546] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:04.763119 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e6ea2-107e-4792-be87-f40fe0d46c55 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:04.764279 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e43ab-e2df-44f4-a544-a4f9138a75d1 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:04.776927 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e43ab-e2df-44f4-a544-a4f9138a75d1 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:04.782103 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509d784-8fa2-4716-9fe9-e12d86365085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:04.782712 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509d784-8fa2-4716-9fe9-e12d86365085 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:04.783808 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509d784-8fa2-4716-9fe9-e12d86365085 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:04.783936 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509d784-8fa2-4716-9fe9-e12d86365085 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:04.784564 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509d784-8fa2-4716-9fe9-e12d86365085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:04.789042 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 775/1547] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:04 2021] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:04.789892 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e6ea2-107e-4792-be87-f40fe0d46c55 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:04.799989 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e6ea2-107e-4792-be87-f40fe0d46c55 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:04.804230 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19cd696-4c7f-429c-97a6-5b546b9225f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:04.804846 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cd696-4c7f-429c-97a6-5b546b9225f0 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:04.805134 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cd696-4c7f-429c-97a6-5b546b9225f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:04.805415 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cd696-4c7f-429c-97a6-5b546b9225f0 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:04.807254 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19cd696-4c7f-429c-97a6-5b546b9225f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:04.815270 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509d784-8fa2-4716-9fe9-e12d86365085 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:04.834456 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19cd696-4c7f-429c-97a6-5b546b9225f0 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:04.837206 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 773/1548] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:04 2021] POST /identity/v3/users => generated 291 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:04.838098 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509d784-8fa2-4716-9fe9-e12d86365085 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:04.849907 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509d784-8fa2-4716-9fe9-e12d86365085 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:04.854435 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec259339-d1eb-4549-9376-8d9dd04081ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:04.855098 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec259339-d1eb-4549-9376-8d9dd04081ee admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:04.855387 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec259339-d1eb-4549-9376-8d9dd04081ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:04.855669 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec259339-d1eb-4549-9376-8d9dd04081ee admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:04.856030 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 776/1549] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:04 2021] POST /identity/v3/users => generated 283 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:04.856304 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec259339-d1eb-4549-9376-8d9dd04081ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:04.856886 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19cd696-4c7f-429c-97a6-5b546b9225f0 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:04.866404 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19cd696-4c7f-429c-97a6-5b546b9225f0 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:04.870687 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68743a39-4e3f-4199-ba8c-9acff49d20c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:04.871333 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68743a39-4e3f-4199-ba8c-9acff49d20c9 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:04.871622 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68743a39-4e3f-4199-ba8c-9acff49d20c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:04.871905 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68743a39-4e3f-4199-ba8c-9acff49d20c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:04.872593 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68743a39-4e3f-4199-ba8c-9acff49d20c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:04.882552 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec259339-d1eb-4549-9376-8d9dd04081ee admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:04.898455 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68743a39-4e3f-4199-ba8c-9acff49d20c9 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:04.904014 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 774/1550] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:04 2021] POST /identity/v3/users => generated 291 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:04.904828 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec259339-d1eb-4549-9376-8d9dd04081ee admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:04.912684 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 777/1551] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:04 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:04.912684 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68743a39-4e3f-4199-ba8c-9acff49d20c9 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:04.916123 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec259339-d1eb-4549-9376-8d9dd04081ee admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:04.919249 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a96d6-a27a-40e4-85c5-95cac1a9102e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:04.919823 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a96d6-a27a-40e4-85c5-95cac1a9102e admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:04.920109 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a96d6-a27a-40e4-85c5-95cac1a9102e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:04.920383 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a96d6-a27a-40e4-85c5-95cac1a9102e admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:04.921004 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a96d6-a27a-40e4-85c5-95cac1a9102e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:04.947146 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a96d6-a27a-40e4-85c5-95cac1a9102e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:04.969765 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 775/1552] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:04 2021] POST /identity/v3/users => generated 288 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:04.971540 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a96d6-a27a-40e4-85c5-95cac1a9102e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:04.977334 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68743a39-4e3f-4199-ba8c-9acff49d20c9 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:04.980645 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e8d85-d4c4-4dba-a7f8-a246a3097911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:04.980848 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a96d6-a27a-40e4-85c5-95cac1a9102e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:04.981228 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e8d85-d4c4-4dba-a7f8-a246a3097911 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:04.981520 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e8d85-d4c4-4dba-a7f8-a246a3097911 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:04.981804 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e8d85-d4c4-4dba-a7f8-a246a3097911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:04.984918 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056af3e-2a75-4207-a1f9-a219d804c1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:04.985491 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056af3e-2a75-4207-a1f9-a219d804c1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:04.985781 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056af3e-2a75-4207-a1f9-a219d804c1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:04.986092 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056af3e-2a75-4207-a1f9-a219d804c1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:04.986908 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056af3e-2a75-4207-a1f9-a219d804c1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:04.990782 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e8d85-d4c4-4dba-a7f8-a246a3097911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:05.011920 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056af3e-2a75-4207-a1f9-a219d804c1f0 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:05.015947 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e8d85-d4c4-4dba-a7f8-a246a3097911 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:05.022563 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 776/1553] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:04 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:05.023491 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056af3e-2a75-4207-a1f9-a219d804c1f0 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:05.026477 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 778/1554] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:04 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:05.027355 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e8d85-d4c4-4dba-a7f8-a246a3097911 service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:05.036581 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e8d85-d4c4-4dba-a7f8-a246a3097911 service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:05.041106 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f48ed-65f6-49e1-b8e4-0326c4cd2339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:05.041442 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f48ed-65f6-49e1-b8e4-0326c4cd2339 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:05.041733 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f48ed-65f6-49e1-b8e4-0326c4cd2339 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:05.042171 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f48ed-65f6-49e1-b8e4-0326c4cd2339 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:05.042887 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f48ed-65f6-49e1-b8e4-0326c4cd2339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:05.068544 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f48ed-65f6-49e1-b8e4-0326c4cd2339 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:05.079191 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 779/1555] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:05 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:05.080695 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f48ed-65f6-49e1-b8e4-0326c4cd2339 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:05.091240 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056af3e-2a75-4207-a1f9-a219d804c1f0 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:05.092058 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f48ed-65f6-49e1-b8e4-0326c4cd2339 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:05.094967 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b609fa-4f30-4759-aa19-f69486aa997b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:05.096288 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b609fa-4f30-4759-aa19-f69486aa997b service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:05.096803 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b609fa-4f30-4759-aa19-f69486aa997b service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:05.097179 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b609fa-4f30-4759-aa19-f69486aa997b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:05.098018 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800e766-90d5-4a09-be56-57016773f350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:05.098752 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800e766-90d5-4a09-be56-57016773f350 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:05.099110 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800e766-90d5-4a09-be56-57016773f350 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:05.099488 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800e766-90d5-4a09-be56-57016773f350 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:05.100251 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800e766-90d5-4a09-be56-57016773f350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:05.127199 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800e766-90d5-4a09-be56-57016773f350 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:05.141320 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 780/1556] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:05 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:05.143046 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800e766-90d5-4a09-be56-57016773f350 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:05.153070 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800e766-90d5-4a09-be56-57016773f350 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:05.158633 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504037d5-9625-4d16-b651-163f2595cdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:05.159384 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504037d5-9625-4d16-b651-163f2595cdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:05.159673 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504037d5-9625-4d16-b651-163f2595cdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:05.159957 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504037d5-9625-4d16-b651-163f2595cdd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:05.160660 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504037d5-9625-4d16-b651-163f2595cdd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:05.184181 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b609fa-4f30-4759-aa19-f69486aa997b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:05.186346 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504037d5-9625-4d16-b651-163f2595cdd4 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:05.198366 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 781/1557] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:05 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:05.199292 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504037d5-9625-4d16-b651-163f2595cdd4 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:05.209041 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504037d5-9625-4d16-b651-163f2595cdd4 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:05.210943 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b609fa-4f30-4759-aa19-f69486aa997b service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:05.214551 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd8d63-c23c-4eea-a9df-a3488071983e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:05.215519 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd8d63-c23c-4eea-a9df-a3488071983e admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:05.216026 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd8d63-c23c-4eea-a9df-a3488071983e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:05.216430 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd8d63-c23c-4eea-a9df-a3488071983e admin admin] PATH_INFO: `/v3/projects/34af0c88029542c8be4a5686fafd259f/users/20cdfac198da45b49624a2da3410fa3f/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:05.222688 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 777/1558] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:05 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:05.223609 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b609fa-4f30-4759-aa19-f69486aa997b service cinder] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:05.233152 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b609fa-4f30-4759-aa19-f69486aa997b service cinder] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:05.239358 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9d2e0-836a-4788-a588-43c18b3e65a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:05.239941 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9d2e0-836a-4788-a588-43c18b3e65a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:05.240231 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9d2e0-836a-4788-a588-43c18b3e65a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:05.240514 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9d2e0-836a-4788-a588-43c18b3e65a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:05.241207 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9d2e0-836a-4788-a588-43c18b3e65a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:05.244297 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd8d63-c23c-4eea-a9df-a3488071983e admin admin] RBAC: Authorizing `identity:create_grant(project_id=34af0c88029542c8be4a5686fafd259f, user_id=20cdfac198da45b49624a2da3410fa3f, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:05.266574 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9d2e0-836a-4788-a588-43c18b3e65a1 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:05.277320 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 778/1559] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:05 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:05.277320 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9d2e0-836a-4788-a588-43c18b3e65a1 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:05.282204 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd8d63-c23c-4eea-a9df-a3488071983e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:05.288322 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9d2e0-836a-4788-a588-43c18b3e65a1 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:05.294041 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527977a3-4202-4d09-b686-20de46244b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:05.294703 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527977a3-4202-4d09-b686-20de46244b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:05.295037 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527977a3-4202-4d09-b686-20de46244b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:05.295380 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527977a3-4202-4d09-b686-20de46244b64 admin admin] PATH_INFO: `/v3/projects/ffcf9686384c4da28a25fd97ff272168/users/fc138a6520b541c692e49b6f3063c5c1/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:05.306740 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 782/1560] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:05 2021] PUT /identity/v3/projects/34af0c88029542c8be4a5686fafd259f/users/20cdfac198da45b49624a2da3410fa3f/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:05.307846 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd8d63-c23c-4eea-a9df-a3488071983e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:05.317400 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527977a3-4202-4d09-b686-20de46244b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffcf9686384c4da28a25fd97ff272168, user_id=fc138a6520b541c692e49b6f3063c5c1, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:05.346385 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527977a3-4202-4d09-b686-20de46244b64 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:05.360856 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 779/1561] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:05 2021] PUT /identity/v3/projects/ffcf9686384c4da28a25fd97ff272168/users/fc138a6520b541c692e49b6f3063c5c1/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:05.365553 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527977a3-4202-4d09-b686-20de46244b64 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:05.427071 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd8d63-c23c-4eea-a9df-a3488071983e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:05.453250 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527977a3-4202-4d09-b686-20de46244b64 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:05.462297 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed305bb-ee58-4fd3-b275-a75ed9fecb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:05.464028 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed305bb-ee58-4fd3-b275-a75ed9fecb11 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:05.464329 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed305bb-ee58-4fd3-b275-a75ed9fecb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:05.464621 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed305bb-ee58-4fd3-b275-a75ed9fecb11 admin admin] PATH_INFO: `/v3/projects/a1c5870ed7d54bdb89c75497ad7a05e8/users/2ad70cc01e8b4e1bada059df068375b1/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:05.496033 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed305bb-ee58-4fd3-b275-a75ed9fecb11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c5870ed7d54bdb89c75497ad7a05e8, user_id=2ad70cc01e8b4e1bada059df068375b1, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:05.529563 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed305bb-ee58-4fd3-b275-a75ed9fecb11 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:05.547886 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 780/1562] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:05 2021] PUT /identity/v3/projects/a1c5870ed7d54bdb89c75497ad7a05e8/users/2ad70cc01e8b4e1bada059df068375b1/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:05.549008 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed305bb-ee58-4fd3-b275-a75ed9fecb11 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:05.563116 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb95995-bc14-400d-8476-56a75a750ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:05.563979 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb95995-bc14-400d-8476-56a75a750ad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:05.564774 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb95995-bc14-400d-8476-56a75a750ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:05.564926 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb95995-bc14-400d-8476-56a75a750ad2 admin admin] PATH_INFO: `/v3/projects/bd13041da7d149e39ab0525b1e164c04/users/c1a07ded28af4bd9ad945650dca10c5e/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:05.607712 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb95995-bc14-400d-8476-56a75a750ad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd13041da7d149e39ab0525b1e164c04, user_id=c1a07ded28af4bd9ad945650dca10c5e, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:05.658899 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed305bb-ee58-4fd3-b275-a75ed9fecb11 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:05.663538 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c6ec4-1d1c-4d82-93ba-8d9053264be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:05.664361 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c6ec4-1d1c-4d82-93ba-8d9053264be5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:05.664701 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c6ec4-1d1c-4d82-93ba-8d9053264be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:05.664979 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c6ec4-1d1c-4d82-93ba-8d9053264be5 admin admin] PATH_INFO: `/v3/projects/d83bfebda32544d0821c5e2cc15c6d4d/users/e8cf467bd7664df4a7f9d8c45f12a1dd/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:05.675918 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb95995-bc14-400d-8476-56a75a750ad2 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:05.690780 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c6ec4-1d1c-4d82-93ba-8d9053264be5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d83bfebda32544d0821c5e2cc15c6d4d, user_id=e8cf467bd7664df4a7f9d8c45f12a1dd, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:05.701401 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 783/1563] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:05 2021] PUT /identity/v3/projects/bd13041da7d149e39ab0525b1e164c04/users/c1a07ded28af4bd9ad945650dca10c5e/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:05.702397 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb95995-bc14-400d-8476-56a75a750ad2 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:05.721085 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c6ec4-1d1c-4d82-93ba-8d9053264be5 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:05.739633 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 781/1564] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:05 2021] PUT /identity/v3/projects/d83bfebda32544d0821c5e2cc15c6d4d/users/e8cf467bd7664df4a7f9d8c45f12a1dd/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:05.745501 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a743d-f288-484c-b3b6-ceca5b13a63c None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:05.745988 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a743d-f288-484c-b3b6-ceca5b13a63c None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:05.746460 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a743d-f288-484c-b3b6-ceca5b13a63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:05.790992 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-a51a743d-f288-484c-b3b6-ceca5b13a63c None None] MFA Rules not processed for user `20cdfac198da45b49624a2da3410fa3f`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:05.792395 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-a51a743d-f288-484c-b3b6-ceca5b13a63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:05.792712 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb95995-bc14-400d-8476-56a75a750ad2 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:05.916165 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 782/1565] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:05 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:05.919512 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0a2eb-e131-4ea2-aa05-19633b351280 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:05.919921 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0a2eb-e131-4ea2-aa05-19633b351280 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:05.920312 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0a2eb-e131-4ea2-aa05-19633b351280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:05.929502 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ba62d-5090-48b9-ab64-4453e975bb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:05.930393 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ba62d-5090-48b9-ab64-4453e975bb84 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:05.930704 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ba62d-5090-48b9-ab64-4453e975bb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:05.930996 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ba62d-5090-48b9-ab64-4453e975bb84 admin admin] PATH_INFO: `/v3/projects/4ab51ee037374f88ab16f92d853d8d12/users/26b2db123c664c398307c4fdf26c2406/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:05.945651 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-10e0a2eb-e131-4ea2-aa05-19633b351280 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:05.947470 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-10e0a2eb-e131-4ea2-aa05-19633b351280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:05.957106 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 783/1566] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:05.962041 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3fcb2-0900-4189-b88e-e001696f92d0 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:05.962515 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3fcb2-0900-4189-b88e-e001696f92d0 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:05.962966 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3fcb2-0900-4189-b88e-e001696f92d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:06.007496 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-bbe3fcb2-0900-4189-b88e-e001696f92d0 None None] MFA Rules not processed for user `2ad70cc01e8b4e1bada059df068375b1`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:06.008774 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-bbe3fcb2-0900-4189-b88e-e001696f92d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:06.103496 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ba62d-5090-48b9-ab64-4453e975bb84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ab51ee037374f88ab16f92d853d8d12, user_id=26b2db123c664c398307c4fdf26c2406, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:06.132429 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ba62d-5090-48b9-ab64-4453e975bb84 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:06.162011 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 784/1567] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:05 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:06.165588 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 784/1568] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:05 2021] PUT /identity/v3/projects/4ab51ee037374f88ab16f92d853d8d12/users/26b2db123c664c398307c4fdf26c2406/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:06.165588 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7250b-8a84-4bb4-8147-68eac0828664 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:06.165588 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7250b-8a84-4bb4-8147-68eac0828664 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:06.165893 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712efbad-fadd-49c8-866c-33fcbd5ec390 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:06.165982 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7250b-8a84-4bb4-8147-68eac0828664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:06.166085 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712efbad-fadd-49c8-866c-33fcbd5ec390 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:06.166085 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712efbad-fadd-49c8-866c-33fcbd5ec390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:06.191973 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-712efbad-fadd-49c8-866c-33fcbd5ec390 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:06.193343 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-712efbad-fadd-49c8-866c-33fcbd5ec390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:06.203604 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-6fe7250b-8a84-4bb4-8147-68eac0828664 None None] MFA Rules not processed for user `c1a07ded28af4bd9ad945650dca10c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:06.204975 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-6fe7250b-8a84-4bb4-8147-68eac0828664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:06.287452 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 785/1569] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:06.289081 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712efbad-fadd-49c8-866c-33fcbd5ec390 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:06.325977 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 785/1570] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:06 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:06.326641 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7250b-8a84-4bb4-8147-68eac0828664 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:06.330843 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-6fe7250b-8a84-4bb4-8147-68eac0828664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:06.401543 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712efbad-fadd-49c8-866c-33fcbd5ec390 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:06.413475 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c5101-0c7c-4131-8ce9-480e4d993cd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:06.414310 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c5101-0c7c-4131-8ce9-480e4d993cd5 service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:06.414798 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c5101-0c7c-4131-8ce9-480e4d993cd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:06.415240 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c5101-0c7c-4131-8ce9-480e4d993cd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:06.467574 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7250b-8a84-4bb4-8147-68eac0828664 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:06.474902 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e46a2-a60f-4c73-bcbb-c11cae14eecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:06.475512 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e46a2-a60f-4c73-bcbb-c11cae14eecc service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:06.475798 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e46a2-a60f-4c73-bcbb-c11cae14eecc service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:06.476081 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e46a2-a60f-4c73-bcbb-c11cae14eecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:06.499289 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e46a2-a60f-4c73-bcbb-c11cae14eecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:06.551956 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e46a2-a60f-4c73-bcbb-c11cae14eecc service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:06.553263 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c5101-0c7c-4131-8ce9-480e4d993cd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:06.565602 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 786/1571] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:06.566714 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e46a2-a60f-4c73-bcbb-c11cae14eecc service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:06.582016 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e46a2-a60f-4c73-bcbb-c11cae14eecc service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:06.596253 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488e8d4-5265-48f5-8513-c02b71e6ee14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:06.596859 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488e8d4-5265-48f5-8513-c02b71e6ee14 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:06.597141 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488e8d4-5265-48f5-8513-c02b71e6ee14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:06.597417 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488e8d4-5265-48f5-8513-c02b71e6ee14 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:06.598061 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488e8d4-5265-48f5-8513-c02b71e6ee14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:06.599678 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c5101-0c7c-4131-8ce9-480e4d993cd5 service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:06.613190 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 786/1572] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:06 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:06.614591 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b3afb-6096-4b0a-bc90-2756d66b0f2b None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:06.614900 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b3afb-6096-4b0a-bc90-2756d66b0f2b None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:06.615185 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b3afb-6096-4b0a-bc90-2756d66b0f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:06.652613 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-f23b3afb-6096-4b0a-bc90-2756d66b0f2b None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:06.659157 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-f23b3afb-6096-4b0a-bc90-2756d66b0f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:06.667656 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 787/1573] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:06.670798 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488e8d4-5265-48f5-8513-c02b71e6ee14 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:06.671994 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b3afb-6096-4b0a-bc90-2756d66b0f2b None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:06.686687 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b3afb-6096-4b0a-bc90-2756d66b0f2b None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:06.692956 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa6743-609b-4d74-8139-64349e43e158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:06.693807 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa6743-609b-4d74-8139-64349e43e158 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:06.694265 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa6743-609b-4d74-8139-64349e43e158 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:06.695183 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa6743-609b-4d74-8139-64349e43e158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:06.707633 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa6743-609b-4d74-8139-64349e43e158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:06.733484 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 787/1574] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:06 2021] POST /identity/v3/projects => generated 363 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:06.734385 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488e8d4-5265-48f5-8513-c02b71e6ee14 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:06.741748 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa6743-609b-4d74-8139-64349e43e158 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:06.755019 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 788/1575] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:06.756586 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef4219-3430-4bea-8375-6569bd0ea27f None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:06.757558 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef4219-3430-4bea-8375-6569bd0ea27f None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:06.757998 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef4219-3430-4bea-8375-6569bd0ea27f None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:06.760467 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 789/1576] 10.222.0.37 () {54 vars in 959 bytes} [Wed Dec 29 20:52:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:52:06.761461 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef4219-3430-4bea-8375-6569bd0ea27f None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:06.825748 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488e8d4-5265-48f5-8513-c02b71e6ee14 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:06.831000 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cc547-7dff-4980-b239-09838d4b43ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:06.831604 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cc547-7dff-4980-b239-09838d4b43ea admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:06.832025 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cc547-7dff-4980-b239-09838d4b43ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:06.832177 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cc547-7dff-4980-b239-09838d4b43ea admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:06.833028 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cc547-7dff-4980-b239-09838d4b43ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:06.857294 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef4219-3430-4bea-8375-6569bd0ea27f None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:06.863456 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690709dd-1bb6-4a9c-93d6-c15149d709f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:06.864471 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cc547-7dff-4980-b239-09838d4b43ea admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:06.864607 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690709dd-1bb6-4a9c-93d6-c15149d709f0 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:06.864923 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690709dd-1bb6-4a9c-93d6-c15149d709f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:06.865386 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690709dd-1bb6-4a9c-93d6-c15149d709f0 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:06.866267 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690709dd-1bb6-4a9c-93d6-c15149d709f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:06.902178 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690709dd-1bb6-4a9c-93d6-c15149d709f0 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:06.909529 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 788/1577] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:06 2021] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:06.910551 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6baf30-3386-4cf8-823c-8516c827e6b1 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:06.912024 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6baf30-3386-4cf8-823c-8516c827e6b1 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:06.912322 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6baf30-3386-4cf8-823c-8516c827e6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:06.941282 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 790/1578] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:06 2021] POST /identity/v3/users => generated 288 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:06.942109 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690709dd-1bb6-4a9c-93d6-c15149d709f0 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:06.973588 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690709dd-1bb6-4a9c-93d6-c15149d709f0 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:06.979591 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-2d6baf30-3386-4cf8-823c-8516c827e6b1 None None] MFA Rules not processed for user `51ef7e54d97a4320bda0c1926d190d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:06.982727 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-2d6baf30-3386-4cf8-823c-8516c827e6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:07.139012 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c067317-bc16-49c6-817b-7fdae466751e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:07.139617 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c067317-bc16-49c6-817b-7fdae466751e admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:07.139903 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c067317-bc16-49c6-817b-7fdae466751e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:07.140181 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c067317-bc16-49c6-817b-7fdae466751e admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:07.140815 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c067317-bc16-49c6-817b-7fdae466751e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:07.172752 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 789/1579] 10.222.0.37 () {58 vars in 1056 bytes} [Wed Dec 29 20:52:06 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:07.174235 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6baf30-3386-4cf8-823c-8516c827e6b1 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:07.197756 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6baf30-3386-4cf8-823c-8516c827e6b1 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:07.206034 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c067317-bc16-49c6-817b-7fdae466751e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:07.211368 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46a337-2476-4c9b-9992-30eec86dd852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:07.212015 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46a337-2476-4c9b-9992-30eec86dd852 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:07.225320 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46a337-2476-4c9b-9992-30eec86dd852 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:07.225680 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46a337-2476-4c9b-9992-30eec86dd852 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:07.226444 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46a337-2476-4c9b-9992-30eec86dd852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:07.248357 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 791/1580] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:06 2021] POST /identity/v3/users => generated 294 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:07.248357 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c067317-bc16-49c6-817b-7fdae466751e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:07.285475 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46a337-2476-4c9b-9992-30eec86dd852 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:07.313301 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 790/1581] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:07 2021] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:07.315097 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46a337-2476-4c9b-9992-30eec86dd852 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:07.395326 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c067317-bc16-49c6-817b-7fdae466751e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:07.405167 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978df25c-bff9-4d63-9b9c-8afc8179c8ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:07.406243 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978df25c-bff9-4d63-9b9c-8afc8179c8ba service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:07.406529 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978df25c-bff9-4d63-9b9c-8afc8179c8ba service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:07.408821 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978df25c-bff9-4d63-9b9c-8afc8179c8ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:07.435181 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978df25c-bff9-4d63-9b9c-8afc8179c8ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:07.499987 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978df25c-bff9-4d63-9b9c-8afc8179c8ba service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:07.500340 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46a337-2476-4c9b-9992-30eec86dd852 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:07.508623 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1e5fa-a2e3-479f-9a28-f9c902354ce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:07.509154 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1e5fa-a2e3-479f-9a28-f9c902354ce2 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:07.509465 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1e5fa-a2e3-479f-9a28-f9c902354ce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:07.509804 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1e5fa-a2e3-479f-9a28-f9c902354ce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:07.537308 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1e5fa-a2e3-479f-9a28-f9c902354ce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:07.550211 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 792/1582] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:07 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:07.553127 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978df25c-bff9-4d63-9b9c-8afc8179c8ba service cinder] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:07.582591 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1e5fa-a2e3-479f-9a28-f9c902354ce2 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:07.592936 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978df25c-bff9-4d63-9b9c-8afc8179c8ba service cinder] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:07.600345 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858b4ad-75e6-4056-81cf-7123088e7752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:07.601328 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858b4ad-75e6-4056-81cf-7123088e7752 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:07.601753 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858b4ad-75e6-4056-81cf-7123088e7752 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:07.602122 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858b4ad-75e6-4056-81cf-7123088e7752 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:07.602977 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858b4ad-75e6-4056-81cf-7123088e7752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:07.611031 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 791/1583] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:07 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:07.611966 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1e5fa-a2e3-479f-9a28-f9c902354ce2 service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:07.624619 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1e5fa-a2e3-479f-9a28-f9c902354ce2 service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:07.636312 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c71ac-46f7-4064-8cb0-1d3ebc72c45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:07.636788 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c71ac-46f7-4064-8cb0-1d3ebc72c45a admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:07.637078 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c71ac-46f7-4064-8cb0-1d3ebc72c45a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:07.637363 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c71ac-46f7-4064-8cb0-1d3ebc72c45a admin admin] PATH_INFO: `/v3/projects/1fea4c5a70434ff7905f5d0f9e3a58bb/users/c30d0167a71545e9a4064a5042a8a388/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:07.663266 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858b4ad-75e6-4056-81cf-7123088e7752 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:07.679782 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c71ac-46f7-4064-8cb0-1d3ebc72c45a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fea4c5a70434ff7905f5d0f9e3a58bb, user_id=c30d0167a71545e9a4064a5042a8a388, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:07.690995 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 793/1584] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:07 2021] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:07.692476 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858b4ad-75e6-4056-81cf-7123088e7752 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:07.711930 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858b4ad-75e6-4056-81cf-7123088e7752 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:07.712609 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c71ac-46f7-4064-8cb0-1d3ebc72c45a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:07.716727 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075d1f5-765b-40ce-84d6-9588a42e9fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:07.717664 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075d1f5-765b-40ce-84d6-9588a42e9fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:07.718107 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075d1f5-765b-40ce-84d6-9588a42e9fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:07.718487 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075d1f5-765b-40ce-84d6-9588a42e9fe4 admin admin] PATH_INFO: `/v3/projects/c0508d87074a453995712bbb2a816a9d/users/c09c5b814b224563a75350a6f77c8976/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:07.732597 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 792/1585] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:07 2021] PUT /identity/v3/projects/1fea4c5a70434ff7905f5d0f9e3a58bb/users/c30d0167a71545e9a4064a5042a8a388/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:07.737175 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c71ac-46f7-4064-8cb0-1d3ebc72c45a admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:07.764049 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075d1f5-765b-40ce-84d6-9588a42e9fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0508d87074a453995712bbb2a816a9d, user_id=c09c5b814b224563a75350a6f77c8976, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:07.800950 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075d1f5-765b-40ce-84d6-9588a42e9fe4 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:07.827403 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 794/1586] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:07 2021] PUT /identity/v3/projects/c0508d87074a453995712bbb2a816a9d/users/c09c5b814b224563a75350a6f77c8976/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:07.828754 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075d1f5-765b-40ce-84d6-9588a42e9fe4 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:07.881369 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c71ac-46f7-4064-8cb0-1d3ebc72c45a admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:07.975095 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075d1f5-765b-40ce-84d6-9588a42e9fe4 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:07.994858 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87e807-1af3-452f-bd7b-3933375d41d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:07.995762 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87e807-1af3-452f-bd7b-3933375d41d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:07.996238 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87e807-1af3-452f-bd7b-3933375d41d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:07.997679 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87e807-1af3-452f-bd7b-3933375d41d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:07.999304 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87e807-1af3-452f-bd7b-3933375d41d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:08.044761 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a7ac9-7f48-40dc-8355-91584422c959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:08.054191 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87e807-1af3-452f-bd7b-3933375d41d5 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:08.059621 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a7ac9-7f48-40dc-8355-91584422c959 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:08.063181 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a7ac9-7f48-40dc-8355-91584422c959 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:08.063541 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a7ac9-7f48-40dc-8355-91584422c959 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:08.067250 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a7ac9-7f48-40dc-8355-91584422c959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:08.070681 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 795/1587] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:07 2021] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:08.076553 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87e807-1af3-452f-bd7b-3933375d41d5 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:08.089417 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87e807-1af3-452f-bd7b-3933375d41d5 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:08.097650 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb7142-a71b-4f15-9d7c-a4d85daf4222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:08.099075 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb7142-a71b-4f15-9d7c-a4d85daf4222 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:08.099619 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb7142-a71b-4f15-9d7c-a4d85daf4222 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:08.100197 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb7142-a71b-4f15-9d7c-a4d85daf4222 admin admin] PATH_INFO: `/v3/projects/c0508d87074a453995712bbb2a816a9d/users/c09c5b814b224563a75350a6f77c8976/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:08.102883 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb7142-a71b-4f15-9d7c-a4d85daf4222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0508d87074a453995712bbb2a816a9d, user_id=c09c5b814b224563a75350a6f77c8976, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:08.149289 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb7142-a71b-4f15-9d7c-a4d85daf4222 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:08.155627 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a7ac9-7f48-40dc-8355-91584422c959 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:08.176757 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 796/1588] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:08 2021] PUT /identity/v3/projects/c0508d87074a453995712bbb2a816a9d/users/c09c5b814b224563a75350a6f77c8976/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:08.181208 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb7142-a71b-4f15-9d7c-a4d85daf4222 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:08.184578 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 793/1589] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:07 2021] GET /identity/v3/roles => generated 1420 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:08.188588 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a7ac9-7f48-40dc-8355-91584422c959 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:08.207599 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a7ac9-7f48-40dc-8355-91584422c959 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:08.343212 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb7142-a71b-4f15-9d7c-a4d85daf4222 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:08.353004 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ef420-378c-49ab-b435-264d99449441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:08.354104 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ef420-378c-49ab-b435-264d99449441 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:08.354647 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ef420-378c-49ab-b435-264d99449441 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:08.356251 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5fa1b-2d83-484a-ac55-2e48655cfd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:08.356602 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ef420-378c-49ab-b435-264d99449441 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:08.358309 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5fa1b-2d83-484a-ac55-2e48655cfd3d admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:08.358478 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ef420-378c-49ab-b435-264d99449441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:08.359718 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5fa1b-2d83-484a-ac55-2e48655cfd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:08.360121 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5fa1b-2d83-484a-ac55-2e48655cfd3d admin admin] PATH_INFO: `/v3/projects/1fea4c5a70434ff7905f5d0f9e3a58bb/users/c30d0167a71545e9a4064a5042a8a388/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:08.364472 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5fa1b-2d83-484a-ac55-2e48655cfd3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fea4c5a70434ff7905f5d0f9e3a58bb, user_id=c30d0167a71545e9a4064a5042a8a388, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:08.399679 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ef420-378c-49ab-b435-264d99449441 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:08.414043 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 797/1590] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:08 2021] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:08.418924 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc5f17-2006-4c3e-80b2-fe300965091b None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:08.419099 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5fa1b-2d83-484a-ac55-2e48655cfd3d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:08.419419 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc5f17-2006-4c3e-80b2-fe300965091b None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:08.419804 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc5f17-2006-4c3e-80b2-fe300965091b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:08.451389 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 794/1591] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:08 2021] PUT /identity/v3/projects/1fea4c5a70434ff7905f5d0f9e3a58bb/users/c30d0167a71545e9a4064a5042a8a388/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:08.452216 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5fa1b-2d83-484a-ac55-2e48655cfd3d admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:08.468412 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-e5dc5f17-2006-4c3e-80b2-fe300965091b None None] MFA Rules not processed for user `fc138a6520b541c692e49b6f3063c5c1`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:08.473324 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-e5dc5f17-2006-4c3e-80b2-fe300965091b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:08.585506 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5fa1b-2d83-484a-ac55-2e48655cfd3d admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:08.599975 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980c933-8f16-4cd8-a543-42aa9e1722cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:08.600873 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980c933-8f16-4cd8-a543-42aa9e1722cd admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:08.602471 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980c933-8f16-4cd8-a543-42aa9e1722cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:08.603209 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980c933-8f16-4cd8-a543-42aa9e1722cd admin admin] PATH_INFO: `/v3/projects/c0508d87074a453995712bbb2a816a9d/users/c09c5b814b224563a75350a6f77c8976/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:08.609321 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980c933-8f16-4cd8-a543-42aa9e1722cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0508d87074a453995712bbb2a816a9d, user_id=c09c5b814b224563a75350a6f77c8976, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:08.632353 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 798/1592] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:08 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:08.633635 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc5f17-2006-4c3e-80b2-fe300965091b None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:08.657371 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc5f17-2006-4c3e-80b2-fe300965091b None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:08.663863 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310030be-c4f1-4c0b-a6b6-f1755d557fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:08.664659 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310030be-c4f1-4c0b-a6b6-f1755d557fad admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:08.665167 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310030be-c4f1-4c0b-a6b6-f1755d557fad admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:08.666104 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310030be-c4f1-4c0b-a6b6-f1755d557fad admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:08.666636 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310030be-c4f1-4c0b-a6b6-f1755d557fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:08.702542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980c933-8f16-4cd8-a543-42aa9e1722cd admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:08.712538 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310030be-c4f1-4c0b-a6b6-f1755d557fad admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:08.734943 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 799/1594] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:08 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:08.734943 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f374ba8-5cec-4d87-b569-15b3fcef158e None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:08.734943 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f374ba8-5cec-4d87-b569-15b3fcef158e None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:08.734943 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f374ba8-5cec-4d87-b569-15b3fcef158e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:08.735771 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 795/1594] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:08 2021] PUT /identity/v3/projects/c0508d87074a453995712bbb2a816a9d/users/c09c5b814b224563a75350a6f77c8976/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:08.737076 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980c933-8f16-4cd8-a543-42aa9e1722cd admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:08.770041 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-7f374ba8-5cec-4d87-b569-15b3fcef158e None None] MFA Rules not processed for user `fc138a6520b541c692e49b6f3063c5c1`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:08.771537 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-7f374ba8-5cec-4d87-b569-15b3fcef158e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:08.846600 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 800/1595] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:08 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:08.848115 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0a984-94bd-45ac-9f63-cdf6c7e38bc5 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:08.848412 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0a984-94bd-45ac-9f63-cdf6c7e38bc5 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:08.848699 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0a984-94bd-45ac-9f63-cdf6c7e38bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:08.976796 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980c933-8f16-4cd8-a543-42aa9e1722cd admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:08.980234 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-b6b0a984-94bd-45ac-9f63-cdf6c7e38bc5 None None] MFA Rules not processed for user `c09c5b814b224563a75350a6f77c8976`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:08.985019 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-b6b0a984-94bd-45ac-9f63-cdf6c7e38bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:09.007479 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7562f1-b666-4be0-8dc7-f097ba34b35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:09.011286 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7562f1-b666-4be0-8dc7-f097ba34b35f admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:09.011606 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7562f1-b666-4be0-8dc7-f097ba34b35f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:09.011894 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7562f1-b666-4be0-8dc7-f097ba34b35f admin admin] PATH_INFO: `/v3/projects/1fea4c5a70434ff7905f5d0f9e3a58bb/users/c30d0167a71545e9a4064a5042a8a388/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:09.017925 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7562f1-b666-4be0-8dc7-f097ba34b35f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fea4c5a70434ff7905f5d0f9e3a58bb, user_id=c30d0167a71545e9a4064a5042a8a388, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:09.101116 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7562f1-b666-4be0-8dc7-f097ba34b35f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:09.133650 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 796/1596] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:08 2021] PUT /identity/v3/projects/1fea4c5a70434ff7905f5d0f9e3a58bb/users/c30d0167a71545e9a4064a5042a8a388/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:09.134802 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7562f1-b666-4be0-8dc7-f097ba34b35f admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:09.172591 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 801/1597] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:08 2021] POST /identity/v3/auth/tokens => generated 3749 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:09.173984 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f3ba9-a469-45ce-af43-a6e3f67d3319 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:09.174408 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f3ba9-a469-45ce-af43-a6e3f67d3319 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:09.174727 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f3ba9-a469-45ce-af43-a6e3f67d3319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:09.261608 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-3b5f3ba9-a469-45ce-af43-a6e3f67d3319 None None] MFA Rules not processed for user `e8cf467bd7664df4a7f9d8c45f12a1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:09.262812 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-3b5f3ba9-a469-45ce-af43-a6e3f67d3319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:09.340963 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 802/1598] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:09 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:09.341855 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f3ba9-a469-45ce-af43-a6e3f67d3319 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:09.349861 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7562f1-b666-4be0-8dc7-f097ba34b35f admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:09.361514 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a3ea0-bf07-458e-9c8f-196b46879c43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:09.363337 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a3ea0-bf07-458e-9c8f-196b46879c43 service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:09.365087 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a3ea0-bf07-458e-9c8f-196b46879c43 service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:09.365544 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a3ea0-bf07-458e-9c8f-196b46879c43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:09.506227 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f3ba9-a469-45ce-af43-a6e3f67d3319 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:09.509021 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a3ea0-bf07-458e-9c8f-196b46879c43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:09.515805 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a3c7e-0df7-4db5-beb0-197288a5ec98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:09.516527 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a3c7e-0df7-4db5-beb0-197288a5ec98 service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:09.517728 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a3c7e-0df7-4db5-beb0-197288a5ec98 service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:09.518200 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a3c7e-0df7-4db5-beb0-197288a5ec98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:09.592428 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a3ea0-bf07-458e-9c8f-196b46879c43 service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:09.646621 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 797/1599] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:09 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:09.648117 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507affb3-4b68-489d-9614-daf4f7067604 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:09.648422 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507affb3-4b68-489d-9614-daf4f7067604 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:09.648713 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507affb3-4b68-489d-9614-daf4f7067604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:09.688425 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a3c7e-0df7-4db5-beb0-197288a5ec98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:09.719295 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a3c7e-0df7-4db5-beb0-197288a5ec98 service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:09.730524 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 803/1600] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:09 2021] GET /identity/v3/auth/tokens => generated 3749 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:09.745174 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc95498-f669-4934-8db1-2158124cdc27 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:09.745713 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc95498-f669-4934-8db1-2158124cdc27 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:09.746157 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc95498-f669-4934-8db1-2158124cdc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:09.760336 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-507affb3-4b68-489d-9614-daf4f7067604 None None] MFA Rules not processed for user `c30d0167a71545e9a4064a5042a8a388`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:09.761516 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-507affb3-4b68-489d-9614-daf4f7067604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:09.805166 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-1fc95498-f669-4934-8db1-2158124cdc27 None None] MFA Rules not processed for user `e8cf467bd7664df4a7f9d8c45f12a1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:09.806668 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-1fc95498-f669-4934-8db1-2158124cdc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:09.825363 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 804/1601] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:09 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:09.905266 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc95498-f669-4934-8db1-2158124cdc27 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:09.980852 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 798/1602] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:09 2021] POST /identity/v3/auth/tokens => generated 3737 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:09.981808 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507affb3-4b68-489d-9614-daf4f7067604 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:10.016735 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507affb3-4b68-489d-9614-daf4f7067604 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:10.038409 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa13ff-6fac-448d-a173-83d8498f4e86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:10.039042 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa13ff-6fac-448d-a173-83d8498f4e86 service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:10.039586 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa13ff-6fac-448d-a173-83d8498f4e86 service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:10.039586 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa13ff-6fac-448d-a173-83d8498f4e86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:10.078164 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa13ff-6fac-448d-a173-83d8498f4e86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:10.129389 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa13ff-6fac-448d-a173-83d8498f4e86 service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:10.155707 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc95498-f669-4934-8db1-2158124cdc27 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:10.165921 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904a261-9a8d-4952-9b06-d777849de82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:10.166767 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904a261-9a8d-4952-9b06-d777849de82d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:10.167062 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904a261-9a8d-4952-9b06-d777849de82d admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:10.167345 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904a261-9a8d-4952-9b06-d777849de82d admin admin] PATH_INFO: `/v3/users/612f72c7b1cd4389b0c3bf4c3ee4f656` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:10.168468 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904a261-9a8d-4952-9b06-d777849de82d admin admin] RBAC: Authorizing `identity:delete_user(user_id=612f72c7b1cd4389b0c3bf4c3ee4f656)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:10.176530 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 799/1603] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:09 2021] GET /identity/v3/auth/tokens => generated 3688 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:10.177779 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa13ff-6fac-448d-a173-83d8498f4e86 service nova] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:10.207624 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa13ff-6fac-448d-a173-83d8498f4e86 service nova] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:10.211823 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: WARNING py.warnings [None req-8904a261-9a8d-4952-9b06-d777849de82d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:52:10.211823 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: warnings.warn(msg) Dec 29 20:52:10.211823 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: Dec 29 20:52:10.218619 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904a261-9a8d-4952-9b06-d777849de82d admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:10.222847 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2064a9-f706-4cef-876f-da523bf1eb23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:10.223992 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2064a9-f706-4cef-876f-da523bf1eb23 service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:10.232903 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2064a9-f706-4cef-876f-da523bf1eb23 service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:10.233344 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2064a9-f706-4cef-876f-da523bf1eb23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:10.264758 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2064a9-f706-4cef-876f-da523bf1eb23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:10.332255 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2064a9-f706-4cef-876f-da523bf1eb23 service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:10.347446 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-8904a261-9a8d-4952-9b06-d777849de82d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '612f72c7b1cd4389b0c3bf4c3ee4f656'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:10.373364 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-8904a261-9a8d-4952-9b06-d777849de82d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '612f72c7b1cd4389b0c3bf4c3ee4f656'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:10.376952 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-8904a261-9a8d-4952-9b06-d777849de82d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '612f72c7b1cd4389b0c3bf4c3ee4f656'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:10.377409 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 800/1604] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:10 2021] GET /identity/v3/auth/tokens => generated 3737 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:10.378326 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2064a9-f706-4cef-876f-da523bf1eb23 service cinder] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:10.390764 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-8904a261-9a8d-4952-9b06-d777849de82d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '612f72c7b1cd4389b0c3bf4c3ee4f656'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:10.398012 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2064a9-f706-4cef-876f-da523bf1eb23 service cinder] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:10.410232 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-8904a261-9a8d-4952-9b06-d777849de82d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '612f72c7b1cd4389b0c3bf4c3ee4f656'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:10.419173 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 805/1605] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:52:09 2021] DELETE /identity/v3/users/612f72c7b1cd4389b0c3bf4c3ee4f656 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:10.422532 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54daa449-36ba-4f8c-b2bf-8338e5bb3b5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:10.423915 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f532f0-74b0-421b-8f0e-dae4fba4ac94 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:10.424056 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54daa449-36ba-4f8c-b2bf-8338e5bb3b5d service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:10.424352 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f532f0-74b0-421b-8f0e-dae4fba4ac94 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:10.424639 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f532f0-74b0-421b-8f0e-dae4fba4ac94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:10.424803 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54daa449-36ba-4f8c-b2bf-8338e5bb3b5d service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:10.425236 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54daa449-36ba-4f8c-b2bf-8338e5bb3b5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:10.427168 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-54daa449-36ba-4f8c-b2bf-8338e5bb3b5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:10.472695 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-85f532f0-74b0-421b-8f0e-dae4fba4ac94 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:10.474442 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-85f532f0-74b0-421b-8f0e-dae4fba4ac94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:10.499370 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54daa449-36ba-4f8c-b2bf-8338e5bb3b5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:10.528923 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54daa449-36ba-4f8c-b2bf-8338e5bb3b5d service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:10.560205 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 801/1606] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:10 2021] GET /identity/v3/auth/tokens => generated 3688 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:10.608026 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 806/1607] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:10.642822 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54daa449-36ba-4f8c-b2bf-8338e5bb3b5d service cinder] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:10.644192 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-54daa449-36ba-4f8c-b2bf-8338e5bb3b5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:10.661002 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f532f0-74b0-421b-8f0e-dae4fba4ac94 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:10.662352 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-85f532f0-74b0-421b-8f0e-dae4fba4ac94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:10.662686 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54daa449-36ba-4f8c-b2bf-8338e5bb3b5d service cinder] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:10.761320 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331e99b-1b2b-4a12-b5e6-275191d718f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:10.761320 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331e99b-1b2b-4a12-b5e6-275191d718f2 service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:10.761627 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331e99b-1b2b-4a12-b5e6-275191d718f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:10.761795 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331e99b-1b2b-4a12-b5e6-275191d718f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:10.763538 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-5331e99b-1b2b-4a12-b5e6-275191d718f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:10.842644 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331e99b-1b2b-4a12-b5e6-275191d718f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:10.872759 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331e99b-1b2b-4a12-b5e6-275191d718f2 service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:10.884235 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 802/1608] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:10 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:10.937138 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f532f0-74b0-421b-8f0e-dae4fba4ac94 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:10.949240 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de61b6-29a7-4eef-bccb-2f88df94f837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:10.949918 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de61b6-29a7-4eef-bccb-2f88df94f837 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:10.950278 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de61b6-29a7-4eef-bccb-2f88df94f837 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:10.950810 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de61b6-29a7-4eef-bccb-2f88df94f837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:10.976438 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de61b6-29a7-4eef-bccb-2f88df94f837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:11.022392 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de61b6-29a7-4eef-bccb-2f88df94f837 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:11.049066 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 807/1609] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:11.110263 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f16ff-0c7b-47f2-8abc-d7afdbd513ae None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:11.111232 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f16ff-0c7b-47f2-8abc-d7afdbd513ae None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:11.111703 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f16ff-0c7b-47f2-8abc-d7afdbd513ae None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:11.114039 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 803/1610] 10.222.0.37 () {54 vars in 912 bytes} [Wed Dec 29 20:52:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:52:11.120041 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cbd70-2665-4429-8c69-21f8f2d79704 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:11.120341 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cbd70-2665-4429-8c69-21f8f2d79704 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:11.120691 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cbd70-2665-4429-8c69-21f8f2d79704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:11.314046 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677d7c5-dbc7-488c-8b06-da3f1fc08f67 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:11.314558 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677d7c5-dbc7-488c-8b06-da3f1fc08f67 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:11.314950 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677d7c5-dbc7-488c-8b06-da3f1fc08f67 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:11.317229 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 804/1611] 10.222.0.37 () {54 vars in 912 bytes} [Wed Dec 29 20:52:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:52:11.328770 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd1340-72fa-4466-9923-e9d44c5ffec3 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:11.329197 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd1340-72fa-4466-9923-e9d44c5ffec3 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:11.329764 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd1340-72fa-4466-9923-e9d44c5ffec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:11.495272 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-bbbd1340-72fa-4466-9923-e9d44c5ffec3 None None] MFA Rules not processed for user `55d700adb7db4848a97bab6cf4105481`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:11.496469 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-bbbd1340-72fa-4466-9923-e9d44c5ffec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:11.515348 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 805/1612] 10.222.0.37 () {58 vars in 1009 bytes} [Wed Dec 29 20:52:11 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Dec 29 20:52:11.523301 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-459cbd70-2665-4429-8c69-21f8f2d79704 None None] MFA Rules not processed for user `55d700adb7db4848a97bab6cf4105481`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:11.525031 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-459cbd70-2665-4429-8c69-21f8f2d79704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:11.536833 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd1340-72fa-4466-9923-e9d44c5ffec3 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:11.547711 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd1340-72fa-4466-9923-e9d44c5ffec3 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:11.552570 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 808/1613] 10.222.0.37 () {58 vars in 1009 bytes} [Wed Dec 29 20:52:11 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:11.567065 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4e858-7ce4-48ff-a2f1-b072f2116274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:11.567683 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4e858-7ce4-48ff-a2f1-b072f2116274 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:11.567978 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4e858-7ce4-48ff-a2f1-b072f2116274 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:11.568263 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4e858-7ce4-48ff-a2f1-b072f2116274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:11.570155 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459cbd70-2665-4429-8c69-21f8f2d79704 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:11.572273 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-459cbd70-2665-4429-8c69-21f8f2d79704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:11.583313 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4e858-7ce4-48ff-a2f1-b072f2116274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:11.588204 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459cbd70-2665-4429-8c69-21f8f2d79704 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:11.599701 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde40f3a-18e4-462b-8668-32534c11f769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:11.600418 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde40f3a-18e4-462b-8668-32534c11f769 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:11.600712 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde40f3a-18e4-462b-8668-32534c11f769 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:11.601045 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde40f3a-18e4-462b-8668-32534c11f769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:11.615485 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde40f3a-18e4-462b-8668-32534c11f769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:11.633120 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4e858-7ce4-48ff-a2f1-b072f2116274 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:11.661078 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 806/1614] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:11 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:52:11.680097 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde40f3a-18e4-462b-8668-32534c11f769 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:11.699901 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 809/1615] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:11 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:52:12.632560 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35e3cf-46a9-4ccf-b1df-1170a8e42c01 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:12.633337 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35e3cf-46a9-4ccf-b1df-1170a8e42c01 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:12.633472 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35e3cf-46a9-4ccf-b1df-1170a8e42c01 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:12.643852 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 807/1616] 10.222.0.37 () {54 vars in 960 bytes} [Wed Dec 29 20:52:12 2021] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:52:12.654641 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338c898-69b2-4d29-a555-653088f24973 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:12.655526 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338c898-69b2-4d29-a555-653088f24973 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:12.655822 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338c898-69b2-4d29-a555-653088f24973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:12.764573 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-0338c898-69b2-4d29-a555-653088f24973 None None] MFA Rules not processed for user `25cb71bb64a3456fb2dc02095c487d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:12.767282 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-0338c898-69b2-4d29-a555-653088f24973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:12.859902 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35e3cf-46a9-4ccf-b1df-1170a8e42c01 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:12.863366 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-cf35e3cf-46a9-4ccf-b1df-1170a8e42c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:13.066231 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 810/1617] 10.222.0.37 () {58 vars in 1057 bytes} [Wed Dec 29 20:52:12 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:13.076218 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338c898-69b2-4d29-a555-653088f24973 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:13.101017 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338c898-69b2-4d29-a555-653088f24973 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:13.116625 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df6efe-2ffe-441c-885e-9f4f5ece19c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25cb71bb64a3456fb2dc02095c487d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:13.116625 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df6efe-2ffe-441c-885e-9f4f5ece19c3 service placement] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:13.116857 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df6efe-2ffe-441c-885e-9f4f5ece19c3 service placement] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:13.117140 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df6efe-2ffe-441c-885e-9f4f5ece19c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:13.120060 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-84df6efe-2ffe-441c-885e-9f4f5ece19c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:13.147693 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df6efe-2ffe-441c-885e-9f4f5ece19c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:13.164732 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35e3cf-46a9-4ccf-b1df-1170a8e42c01 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:13.173030 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a1ddd-5d99-43a4-a4f2-5014a0762403 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25cb71bb64a3456fb2dc02095c487d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:13.174936 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a1ddd-5d99-43a4-a4f2-5014a0762403 service placement] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:13.175630 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a1ddd-5d99-43a4-a4f2-5014a0762403 service placement] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:13.176295 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a1ddd-5d99-43a4-a4f2-5014a0762403 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:13.187596 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a1ddd-5d99-43a4-a4f2-5014a0762403 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:13.203038 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df6efe-2ffe-441c-885e-9f4f5ece19c3 service placement] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:13.229096 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 811/1618] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:13 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:13.233285 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df6efe-2ffe-441c-885e-9f4f5ece19c3 service placement] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:13.235134 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-84df6efe-2ffe-441c-885e-9f4f5ece19c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:13.248454 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a1ddd-5d99-43a4-a4f2-5014a0762403 service placement] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:13.267536 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df6efe-2ffe-441c-885e-9f4f5ece19c3 service placement] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:13.274962 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 808/1619] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:12 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:52:13.276650 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592ed3f-8102-4240-a104-edc506140890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:13.277769 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592ed3f-8102-4240-a104-edc506140890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:13.278199 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592ed3f-8102-4240-a104-edc506140890 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:13.279165 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592ed3f-8102-4240-a104-edc506140890 admin admin] PATH_INFO: `/v3/projects/29638b216f1044a88c1935b8182f9952` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:13.280538 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6592ed3f-8102-4240-a104-edc506140890 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29638b216f1044a88c1935b8182f9952)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:13.315317 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6592ed3f-8102-4240-a104-edc506140890 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:13.424127 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-6592ed3f-8102-4240-a104-edc506140890 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29638b216f1044a88c1935b8182f9952', 'request_id': 'req-6592ed3f-8102-4240-a104-edc506140890'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:13.441653 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-6592ed3f-8102-4240-a104-edc506140890 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29638b216f1044a88c1935b8182f9952', 'request_id': 'req-6592ed3f-8102-4240-a104-edc506140890'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:13.466060 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-6592ed3f-8102-4240-a104-edc506140890 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29638b216f1044a88c1935b8182f9952', 'request_id': 'req-6592ed3f-8102-4240-a104-edc506140890'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:13.507550 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-6592ed3f-8102-4240-a104-edc506140890 admin admin] The token cache is being invalidate because project 29638b216f1044a88c1935b8182f9952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:52:13.514961 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-6592ed3f-8102-4240-a104-edc506140890 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:13.520123 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-6592ed3f-8102-4240-a104-edc506140890 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:13.541530 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 812/1620] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:52:13 2021] DELETE /identity/v3/projects/29638b216f1044a88c1935b8182f9952 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:13.542878 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f468ff-9830-4053-a501-ea28634aca19 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:13.543170 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f468ff-9830-4053-a501-ea28634aca19 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:13.543460 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f468ff-9830-4053-a501-ea28634aca19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:13.653579 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-c4f468ff-9830-4053-a501-ea28634aca19 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:13.654844 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-c4f468ff-9830-4053-a501-ea28634aca19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:13.896020 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592ed3f-8102-4240-a104-edc506140890 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:13.898908 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-6592ed3f-8102-4240-a104-edc506140890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:13.931119 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 809/1621] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:13.961377 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f468ff-9830-4053-a501-ea28634aca19 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:13.962795 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-c4f468ff-9830-4053-a501-ea28634aca19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:14.154782 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592ed3f-8102-4240-a104-edc506140890 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:14.165185 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd1a44-313a-473f-bcb0-dd33c40e5556 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25cb71bb64a3456fb2dc02095c487d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:14.166215 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd1a44-313a-473f-bcb0-dd33c40e5556 service placement] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:14.166741 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd1a44-313a-473f-bcb0-dd33c40e5556 service placement] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:14.167243 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd1a44-313a-473f-bcb0-dd33c40e5556 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:14.170623 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-62bd1a44-313a-473f-bcb0-dd33c40e5556 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:14.218144 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd1a44-313a-473f-bcb0-dd33c40e5556 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:14.235397 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f468ff-9830-4053-a501-ea28634aca19 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:14.242669 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b546bd-7ee6-4917-aa73-f8754f93cad2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25cb71bb64a3456fb2dc02095c487d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:14.244060 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b546bd-7ee6-4917-aa73-f8754f93cad2 service placement] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:14.244485 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b546bd-7ee6-4917-aa73-f8754f93cad2 service placement] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:14.244987 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b546bd-7ee6-4917-aa73-f8754f93cad2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:14.256386 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b546bd-7ee6-4917-aa73-f8754f93cad2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:14.286712 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd1a44-313a-473f-bcb0-dd33c40e5556 service placement] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:14.288055 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b546bd-7ee6-4917-aa73-f8754f93cad2 service placement] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:14.302838 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 810/1622] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:13 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:52:14.304359 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588c6ce-4b09-4f35-a179-256fe34471b1 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:14.304908 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588c6ce-4b09-4f35-a179-256fe34471b1 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:14.305300 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588c6ce-4b09-4f35-a179-256fe34471b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:14.327536 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 813/1623] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:13 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:14.398488 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-c588c6ce-4b09-4f35-a179-256fe34471b1 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:14.400002 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-c588c6ce-4b09-4f35-a179-256fe34471b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:14.428428 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 811/1624] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:14.431887 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd1a44-313a-473f-bcb0-dd33c40e5556 service placement] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:14.445956 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd1a44-313a-473f-bcb0-dd33c40e5556 service placement] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:14.470453 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad84a49-ef80-4662-ab75-bb37c3780ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:14.471477 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad84a49-ef80-4662-ab75-bb37c3780ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:14.471928 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad84a49-ef80-4662-ab75-bb37c3780ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:14.472468 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad84a49-ef80-4662-ab75-bb37c3780ae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:14.473369 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad84a49-ef80-4662-ab75-bb37c3780ae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:52:14.473858 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad84a49-ef80-4662-ab75-bb37c3780ae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:14.541194 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad84a49-ef80-4662-ab75-bb37c3780ae7 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:14.567241 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588c6ce-4b09-4f35-a179-256fe34471b1 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:14.567576 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 814/1625] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:52:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:52:14.588445 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588c6ce-4b09-4f35-a179-256fe34471b1 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:14.597221 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbadb9d-a996-411f-8f6f-ace005e80b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:14.598848 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbadb9d-a996-411f-8f6f-ace005e80b60 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:14.599304 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbadb9d-a996-411f-8f6f-ace005e80b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:14.599812 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbadb9d-a996-411f-8f6f-ace005e80b60 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:14.600659 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbadb9d-a996-411f-8f6f-ace005e80b60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:14.692632 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbadb9d-a996-411f-8f6f-ace005e80b60 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:14.761553 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 812/1626] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:14 2021] POST /identity/v3/projects => generated 373 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:14.765968 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad84a49-ef80-4662-ab75-bb37c3780ae7 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:14.778873 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad84a49-ef80-4662-ab75-bb37c3780ae7 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:15.076893 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913d788-dfc8-43d7-9e58-e9bd5fff1291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:15.078214 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913d788-dfc8-43d7-9e58-e9bd5fff1291 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:15.081216 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913d788-dfc8-43d7-9e58-e9bd5fff1291 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:15.081529 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913d788-dfc8-43d7-9e58-e9bd5fff1291 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:15.084164 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913d788-dfc8-43d7-9e58-e9bd5fff1291 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:15.167322 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913d788-dfc8-43d7-9e58-e9bd5fff1291 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:15.213574 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 815/1627] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:14 2021] POST /identity/v3/users => generated 287 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:15.214384 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbadb9d-a996-411f-8f6f-ace005e80b60 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:15.230589 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbadb9d-a996-411f-8f6f-ace005e80b60 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:15.247871 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2b05c-d0b5-4b9e-bbc2-5134d147c697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:15.248785 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2b05c-d0b5-4b9e-bbc2-5134d147c697 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:15.249647 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2b05c-d0b5-4b9e-bbc2-5134d147c697 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:15.250370 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2b05c-d0b5-4b9e-bbc2-5134d147c697 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:15.251459 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2b05c-d0b5-4b9e-bbc2-5134d147c697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:15.315732 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2b05c-d0b5-4b9e-bbc2-5134d147c697 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:15.344165 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 813/1628] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:15 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:52:15.349318 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913d788-dfc8-43d7-9e58-e9bd5fff1291 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:15.364237 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913d788-dfc8-43d7-9e58-e9bd5fff1291 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:15.379623 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996585d5-a07d-45a5-a740-ff72e0db0fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:15.380580 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996585d5-a07d-45a5-a740-ff72e0db0fed admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:15.381288 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996585d5-a07d-45a5-a740-ff72e0db0fed admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:15.381564 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996585d5-a07d-45a5-a740-ff72e0db0fed admin admin] PATH_INFO: `/v3/projects/eeaa822d892a4524b5bc6c70d4aaf94c/users/38e1373fe899446381329753f4af9853/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:15.429299 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996585d5-a07d-45a5-a740-ff72e0db0fed admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeaa822d892a4524b5bc6c70d4aaf94c, user_id=38e1373fe899446381329753f4af9853, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:15.496932 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996585d5-a07d-45a5-a740-ff72e0db0fed admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:15.536414 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 816/1629] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:15 2021] PUT /identity/v3/projects/eeaa822d892a4524b5bc6c70d4aaf94c/users/38e1373fe899446381329753f4af9853/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:15.546693 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7d840-abab-4027-869b-f6f6d0e2db2b None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:15.546965 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7d840-abab-4027-869b-f6f6d0e2db2b None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:15.547309 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7d840-abab-4027-869b-f6f6d0e2db2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:15.664083 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-e2e7d840-abab-4027-869b-f6f6d0e2db2b None None] MFA Rules not processed for user `38e1373fe899446381329753f4af9853`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:15.665499 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-e2e7d840-abab-4027-869b-f6f6d0e2db2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:15.948508 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 814/1630] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:15 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:16.086545 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996585d5-a07d-45a5-a740-ff72e0db0fed admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:16.089370 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-996585d5-a07d-45a5-a740-ff72e0db0fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:16.101119 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaa6cf-1a28-447b-b822-75e2c64b5eba None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:16.101421 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaa6cf-1a28-447b-b822-75e2c64b5eba None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:16.101702 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaa6cf-1a28-447b-b822-75e2c64b5eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:16.212722 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-9faaa6cf-1a28-447b-b822-75e2c64b5eba None None] MFA Rules not processed for user `571a3b9c133a4831b3e2f97b588db5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:16.213913 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-9faaa6cf-1a28-447b-b822-75e2c64b5eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:16.271796 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996585d5-a07d-45a5-a740-ff72e0db0fed admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:16.279383 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8a1ce-17f8-4a43-86d9-6bb76e2d35f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:16.280283 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8a1ce-17f8-4a43-86d9-6bb76e2d35f1 service nova] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:16.280863 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8a1ce-17f8-4a43-86d9-6bb76e2d35f1 service nova] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:16.281791 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8a1ce-17f8-4a43-86d9-6bb76e2d35f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:16.294404 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8a1ce-17f8-4a43-86d9-6bb76e2d35f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:16.339203 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8a1ce-17f8-4a43-86d9-6bb76e2d35f1 service nova] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:16.362527 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 817/1631] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:16 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:16.434634 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 815/1632] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:16 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:16.487264 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462e2fe-16a2-4b4e-8c87-e6dce232c955 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:16.487744 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462e2fe-16a2-4b4e-8c87-e6dce232c955 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:16.488260 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462e2fe-16a2-4b4e-8c87-e6dce232c955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:16.522366 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-7462e2fe-16a2-4b4e-8c87-e6dce232c955 None None] MFA Rules not processed for user `571a3b9c133a4831b3e2f97b588db5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:16.523573 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-7462e2fe-16a2-4b4e-8c87-e6dce232c955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:16.534716 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 818/1633] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:16 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:16.604295 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faaa6cf-1a28-447b-b822-75e2c64b5eba None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:16.627560 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faaa6cf-1a28-447b-b822-75e2c64b5eba None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:16.645488 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eef1b0-bb91-4be5-b073-e88159fe60e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:16.646386 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eef1b0-bb91-4be5-b073-e88159fe60e8 service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:16.646870 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eef1b0-bb91-4be5-b073-e88159fe60e8 service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:16.647323 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eef1b0-bb91-4be5-b073-e88159fe60e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:16.661914 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eef1b0-bb91-4be5-b073-e88159fe60e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:16.710646 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eef1b0-bb91-4be5-b073-e88159fe60e8 service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:16.734795 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 816/1634] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:16 2021] GET /identity/v3/auth/tokens => generated 3696 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:17.665439 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462e2fe-16a2-4b4e-8c87-e6dce232c955 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:17.776399 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462e2fe-16a2-4b4e-8c87-e6dce232c955 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:17.782493 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a03a6-536c-487d-8e8e-eff62ba2f59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:17.783697 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a03a6-536c-487d-8e8e-eff62ba2f59b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:17.784004 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a03a6-536c-487d-8e8e-eff62ba2f59b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:17.784386 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a03a6-536c-487d-8e8e-eff62ba2f59b admin admin] PATH_INFO: `/v3/users/38e1373fe899446381329753f4af9853` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:17.785571 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a03a6-536c-487d-8e8e-eff62ba2f59b admin admin] RBAC: Authorizing `identity:delete_user(user_id=38e1373fe899446381329753f4af9853)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:17.825752 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a03a6-536c-487d-8e8e-eff62ba2f59b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:17.942803 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-047a03a6-536c-487d-8e8e-eff62ba2f59b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38e1373fe899446381329753f4af9853'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:17.959461 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-047a03a6-536c-487d-8e8e-eff62ba2f59b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38e1373fe899446381329753f4af9853'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:17.960168 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-047a03a6-536c-487d-8e8e-eff62ba2f59b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38e1373fe899446381329753f4af9853'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:17.968582 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-047a03a6-536c-487d-8e8e-eff62ba2f59b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38e1373fe899446381329753f4af9853'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:17.983238 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-047a03a6-536c-487d-8e8e-eff62ba2f59b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38e1373fe899446381329753f4af9853'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:17.998401 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 819/1635] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:52:17 2021] DELETE /identity/v3/users/38e1373fe899446381329753f4af9853 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:18.003908 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b61c23-b234-4f40-a329-6cc1ddad6d64 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:18.004385 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b61c23-b234-4f40-a329-6cc1ddad6d64 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:18.004505 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b61c23-b234-4f40-a329-6cc1ddad6d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:18.044851 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-c0b61c23-b234-4f40-a329-6cc1ddad6d64 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:18.048841 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-c0b61c23-b234-4f40-a329-6cc1ddad6d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:18.178863 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 817/1636] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:52:18.189811 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a03a6-536c-487d-8e8e-eff62ba2f59b admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:18.191208 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-047a03a6-536c-487d-8e8e-eff62ba2f59b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:18.358299 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e658457-048f-4bb5-8f5b-9a225ad28a4b None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:18.359049 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e658457-048f-4bb5-8f5b-9a225ad28a4b None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:18.359566 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e658457-048f-4bb5-8f5b-9a225ad28a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:18.432013 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-6e658457-048f-4bb5-8f5b-9a225ad28a4b None None] MFA Rules not processed for user `571a3b9c133a4831b3e2f97b588db5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:18.435416 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-6e658457-048f-4bb5-8f5b-9a225ad28a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:18.451102 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a03a6-536c-487d-8e8e-eff62ba2f59b admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:18.460949 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425933e-55f9-4b18-9515-6917d3586501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:18.461879 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425933e-55f9-4b18-9515-6917d3586501 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:18.462354 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425933e-55f9-4b18-9515-6917d3586501 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:18.462879 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425933e-55f9-4b18-9515-6917d3586501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:18.501719 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425933e-55f9-4b18-9515-6917d3586501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:18.566820 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425933e-55f9-4b18-9515-6917d3586501 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:18.595673 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 820/1637] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:18.630716 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 818/1638] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:18 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:19.587205 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425933e-55f9-4b18-9515-6917d3586501 service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:19.589335 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-0425933e-55f9-4b18-9515-6917d3586501 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:19.612718 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425933e-55f9-4b18-9515-6917d3586501 service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:19.626645 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4039d9-1f88-43a7-a24d-30446c683ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:19.627597 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4039d9-1f88-43a7-a24d-30446c683ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:19.627965 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4039d9-1f88-43a7-a24d-30446c683ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:19.628319 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4039d9-1f88-43a7-a24d-30446c683ffd admin admin] PATH_INFO: `/v3/projects/eeaa822d892a4524b5bc6c70d4aaf94c` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:19.629562 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4039d9-1f88-43a7-a24d-30446c683ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeaa822d892a4524b5bc6c70d4aaf94c)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:19.669383 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4039d9-1f88-43a7-a24d-30446c683ffd admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:19.774455 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-7f4039d9-1f88-43a7-a24d-30446c683ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeaa822d892a4524b5bc6c70d4aaf94c', 'request_id': 'req-7f4039d9-1f88-43a7-a24d-30446c683ffd'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:19.788889 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-7f4039d9-1f88-43a7-a24d-30446c683ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeaa822d892a4524b5bc6c70d4aaf94c', 'request_id': 'req-7f4039d9-1f88-43a7-a24d-30446c683ffd'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:19.818941 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-7f4039d9-1f88-43a7-a24d-30446c683ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeaa822d892a4524b5bc6c70d4aaf94c', 'request_id': 'req-7f4039d9-1f88-43a7-a24d-30446c683ffd'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:19.850549 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-7f4039d9-1f88-43a7-a24d-30446c683ffd admin admin] The token cache is being invalidate because project eeaa822d892a4524b5bc6c70d4aaf94c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:52:19.850880 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-7f4039d9-1f88-43a7-a24d-30446c683ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:19.851707 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-7f4039d9-1f88-43a7-a24d-30446c683ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:19.853195 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 821/1639] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:52:19 2021] DELETE /identity/v3/projects/eeaa822d892a4524b5bc6c70d4aaf94c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:19.858863 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63876e34-4ebf-4dd1-84dd-8bd305958042 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:19.859277 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63876e34-4ebf-4dd1-84dd-8bd305958042 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:19.859384 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63876e34-4ebf-4dd1-84dd-8bd305958042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:19.921671 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-63876e34-4ebf-4dd1-84dd-8bd305958042 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:19.931993 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-63876e34-4ebf-4dd1-84dd-8bd305958042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:20.095409 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 819/1640] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:20.110789 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b270c-0da1-4f71-a4d5-098fb2b3ba2a None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:20.110789 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b270c-0da1-4f71-a4d5-098fb2b3ba2a None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:20.110789 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b270c-0da1-4f71-a4d5-098fb2b3ba2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:20.138550 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-1e6b270c-0da1-4f71-a4d5-098fb2b3ba2a None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:20.139728 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-1e6b270c-0da1-4f71-a4d5-098fb2b3ba2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:20.163655 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63876e34-4ebf-4dd1-84dd-8bd305958042 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:20.164332 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 822/1641] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:20.174880 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63876e34-4ebf-4dd1-84dd-8bd305958042 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:20.191703 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c44c96-f541-4282-92eb-5ce2153a1383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:20.192777 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c44c96-f541-4282-92eb-5ce2153a1383 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:20.193246 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c44c96-f541-4282-92eb-5ce2153a1383 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:20.195206 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c44c96-f541-4282-92eb-5ce2153a1383 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:20.196143 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c44c96-f541-4282-92eb-5ce2153a1383 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:52:20.199752 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c44c96-f541-4282-92eb-5ce2153a1383 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:20.242570 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c44c96-f541-4282-92eb-5ce2153a1383 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:20.292189 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b270c-0da1-4f71-a4d5-098fb2b3ba2a None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:20.297780 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 820/1642] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:52:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:52:20.301677 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b270c-0da1-4f71-a4d5-098fb2b3ba2a None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:20.314692 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a00c11-c244-4c50-88c5-8eb27ccbce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:20.315524 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a00c11-c244-4c50-88c5-8eb27ccbce87 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:20.315813 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a00c11-c244-4c50-88c5-8eb27ccbce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:20.316092 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a00c11-c244-4c50-88c5-8eb27ccbce87 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:20.316931 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a00c11-c244-4c50-88c5-8eb27ccbce87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:20.378058 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a00c11-c244-4c50-88c5-8eb27ccbce87 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:20.458945 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c44c96-f541-4282-92eb-5ce2153a1383 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:20.470556 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c44c96-f541-4282-92eb-5ce2153a1383 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:20.470859 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 823/1643] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:20 2021] POST /identity/v3/projects => generated 365 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:52:20.548537 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0b97b-ddc0-4841-80de-693342a25757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:20.549395 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0b97b-ddc0-4841-80de-693342a25757 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:20.549848 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0b97b-ddc0-4841-80de-693342a25757 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:20.550278 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0b97b-ddc0-4841-80de-693342a25757 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:20.551112 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0b97b-ddc0-4841-80de-693342a25757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:20.584748 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0b97b-ddc0-4841-80de-693342a25757 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:20.631284 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a00c11-c244-4c50-88c5-8eb27ccbce87 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:20.639441 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 821/1644] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:20 2021] POST /identity/v3/users => generated 283 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:20.643779 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a00c11-c244-4c50-88c5-8eb27ccbce87 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:20.690199 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17edd6-40a3-4df8-9c03-cea46ec7f22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:20.691005 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17edd6-40a3-4df8-9c03-cea46ec7f22a admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:20.691391 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17edd6-40a3-4df8-9c03-cea46ec7f22a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:20.691771 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17edd6-40a3-4df8-9c03-cea46ec7f22a admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:20.692611 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17edd6-40a3-4df8-9c03-cea46ec7f22a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:20.788189 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17edd6-40a3-4df8-9c03-cea46ec7f22a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:20.815458 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 824/1645] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:20 2021] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:20.819491 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0b97b-ddc0-4841-80de-693342a25757 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:20.832050 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0b97b-ddc0-4841-80de-693342a25757 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:20.849090 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98de4d-e2ac-467f-9dab-7dac1de99533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:20.852172 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98de4d-e2ac-467f-9dab-7dac1de99533 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:20.857407 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98de4d-e2ac-467f-9dab-7dac1de99533 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:20.857961 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98de4d-e2ac-467f-9dab-7dac1de99533 admin admin] PATH_INFO: `/v3/projects/d1136483572d4751b1e5b5716a542939/users/e78fc5dd2bfc42c2afca9586e9e026bf/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:20.917131 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98de4d-e2ac-467f-9dab-7dac1de99533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1136483572d4751b1e5b5716a542939, user_id=e78fc5dd2bfc42c2afca9586e9e026bf, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:20.960336 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98de4d-e2ac-467f-9dab-7dac1de99533 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:20.984898 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 822/1646] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:20 2021] PUT /identity/v3/projects/d1136483572d4751b1e5b5716a542939/users/e78fc5dd2bfc42c2afca9586e9e026bf/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:52:21.002420 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6e2d2-4bb7-4aee-8956-7bdece39d3a7 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:21.002534 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6e2d2-4bb7-4aee-8956-7bdece39d3a7 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:21.002842 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6e2d2-4bb7-4aee-8956-7bdece39d3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:21.079901 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-98d6e2d2-4bb7-4aee-8956-7bdece39d3a7 None None] MFA Rules not processed for user `e78fc5dd2bfc42c2afca9586e9e026bf`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:21.082245 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-98d6e2d2-4bb7-4aee-8956-7bdece39d3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:21.177520 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 825/1647] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:20 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:21.181869 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98de4d-e2ac-467f-9dab-7dac1de99533 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:21.196962 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d632d1c-e3de-4fa2-9aa3-91e33c4e6ce9 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:21.197259 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d632d1c-e3de-4fa2-9aa3-91e33c4e6ce9 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:21.197546 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d632d1c-e3de-4fa2-9aa3-91e33c4e6ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:21.237303 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-1d632d1c-e3de-4fa2-9aa3-91e33c4e6ce9 None None] MFA Rules not processed for user `26b2db123c664c398307c4fdf26c2406`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:21.238561 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-1d632d1c-e3de-4fa2-9aa3-91e33c4e6ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:21.289001 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98de4d-e2ac-467f-9dab-7dac1de99533 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:21.293510 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de472c5-abbb-46c2-b595-74e3d2b864e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:21.294096 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de472c5-abbb-46c2-b595-74e3d2b864e3 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:21.294384 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de472c5-abbb-46c2-b595-74e3d2b864e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:21.294692 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de472c5-abbb-46c2-b595-74e3d2b864e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:21.295324 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de472c5-abbb-46c2-b595-74e3d2b864e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:21.327969 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 826/1648] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:21 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:52:21.340450 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de472c5-abbb-46c2-b595-74e3d2b864e3 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:21.341315 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d632d1c-e3de-4fa2-9aa3-91e33c4e6ce9 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:21.343097 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-1d632d1c-e3de-4fa2-9aa3-91e33c4e6ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:21.383673 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 823/1649] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:21 2021] POST /identity/v3/projects => generated 365 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:21.387726 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de472c5-abbb-46c2-b595-74e3d2b864e3 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:21.503849 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d632d1c-e3de-4fa2-9aa3-91e33c4e6ce9 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:21.515740 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de472c5-abbb-46c2-b595-74e3d2b864e3 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:21.525783 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cca294-7e5e-4a99-8cdb-269c80347e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:21.526624 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cca294-7e5e-4a99-8cdb-269c80347e16 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:21.526963 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cca294-7e5e-4a99-8cdb-269c80347e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:21.527284 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cca294-7e5e-4a99-8cdb-269c80347e16 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:21.533524 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cca294-7e5e-4a99-8cdb-269c80347e16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:21.613710 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cca294-7e5e-4a99-8cdb-269c80347e16 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:21.658256 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 824/1650] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:21 2021] POST /identity/v3/users => generated 289 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:52:21.662931 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cca294-7e5e-4a99-8cdb-269c80347e16 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:21.663778 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23474ccc-87ef-4665-a648-e8fbd6038ddd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:21.664562 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23474ccc-87ef-4665-a648-e8fbd6038ddd service nova] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:21.664854 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23474ccc-87ef-4665-a648-e8fbd6038ddd service nova] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:21.665134 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23474ccc-87ef-4665-a648-e8fbd6038ddd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:21.680333 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cca294-7e5e-4a99-8cdb-269c80347e16 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:21.685747 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d253dfc-a3d0-4ab4-89d1-87b362df969c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:21.702763 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d253dfc-a3d0-4ab4-89d1-87b362df969c admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:21.709490 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d253dfc-a3d0-4ab4-89d1-87b362df969c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:21.709773 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d253dfc-a3d0-4ab4-89d1-87b362df969c admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:21.710854 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d253dfc-a3d0-4ab4-89d1-87b362df969c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:21.749802 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d253dfc-a3d0-4ab4-89d1-87b362df969c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:21.767476 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 825/1651] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:21 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:52:21.770773 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d253dfc-a3d0-4ab4-89d1-87b362df969c admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:21.781967 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d253dfc-a3d0-4ab4-89d1-87b362df969c admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:21.787647 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dedaa-5325-4cc6-a478-8451eeb9a01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:21.791595 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dedaa-5325-4cc6-a478-8451eeb9a01d admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:21.792141 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dedaa-5325-4cc6-a478-8451eeb9a01d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:21.792606 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dedaa-5325-4cc6-a478-8451eeb9a01d admin admin] PATH_INFO: `/v3/projects/bae137591107409085588f8b351ce66c/users/a393bac3d0284091bf1fdd15e33fa9a5/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:21.802455 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23474ccc-87ef-4665-a648-e8fbd6038ddd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:21.818417 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100dedaa-5325-4cc6-a478-8451eeb9a01d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bae137591107409085588f8b351ce66c, user_id=a393bac3d0284091bf1fdd15e33fa9a5, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:21.867125 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23474ccc-87ef-4665-a648-e8fbd6038ddd service nova] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:21.885157 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100dedaa-5325-4cc6-a478-8451eeb9a01d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:21.911818 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 826/1652] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:21 2021] PUT /identity/v3/projects/bae137591107409085588f8b351ce66c/users/a393bac3d0284091bf1fdd15e33fa9a5/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:21.915568 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dedaa-5325-4cc6-a478-8451eeb9a01d admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:21.920021 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 827/1653] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:21 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:22.029531 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dedaa-5325-4cc6-a478-8451eeb9a01d admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:22.043941 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57ad0c-c86c-44f9-9328-9d8a30617287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:22.044581 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57ad0c-c86c-44f9-9328-9d8a30617287 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:22.044873 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57ad0c-c86c-44f9-9328-9d8a30617287 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:22.045156 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57ad0c-c86c-44f9-9328-9d8a30617287 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:22.045873 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57ad0c-c86c-44f9-9328-9d8a30617287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:22.088818 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57ad0c-c86c-44f9-9328-9d8a30617287 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:22.101587 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 827/1654] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:21 2021] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:52:22.105895 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23474ccc-87ef-4665-a648-e8fbd6038ddd service nova] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:22.132749 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23474ccc-87ef-4665-a648-e8fbd6038ddd service nova] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:22.159441 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f741b91-f84c-4d2a-82d6-9d4e17fc5e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:22.160294 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f741b91-f84c-4d2a-82d6-9d4e17fc5e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:22.160585 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f741b91-f84c-4d2a-82d6-9d4e17fc5e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:22.160871 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f741b91-f84c-4d2a-82d6-9d4e17fc5e3f admin admin] PATH_INFO: `/v3/projects/bae137591107409085588f8b351ce66c/users/a393bac3d0284091bf1fdd15e33fa9a5/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:22.167550 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f741b91-f84c-4d2a-82d6-9d4e17fc5e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bae137591107409085588f8b351ce66c, user_id=a393bac3d0284091bf1fdd15e33fa9a5, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:22.232326 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f741b91-f84c-4d2a-82d6-9d4e17fc5e3f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:22.254093 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 828/1655] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:22 2021] PUT /identity/v3/projects/bae137591107409085588f8b351ce66c/users/a393bac3d0284091bf1fdd15e33fa9a5/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:52:22.257915 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57ad0c-c86c-44f9-9328-9d8a30617287 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:22.274326 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57ad0c-c86c-44f9-9328-9d8a30617287 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:22.432592 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100adc5-f20e-4224-b9e3-9d75c43bb199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:22.433300 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100adc5-f20e-4224-b9e3-9d75c43bb199 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:22.433676 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100adc5-f20e-4224-b9e3-9d75c43bb199 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:22.434031 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100adc5-f20e-4224-b9e3-9d75c43bb199 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:22.435633 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100adc5-f20e-4224-b9e3-9d75c43bb199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:22.478008 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100adc5-f20e-4224-b9e3-9d75c43bb199 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:22.497329 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 828/1656] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:22 2021] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:52:22.498549 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f741b91-f84c-4d2a-82d6-9d4e17fc5e3f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:22.515796 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f741b91-f84c-4d2a-82d6-9d4e17fc5e3f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:22.520762 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e9a27-26c1-4d43-add7-7b4f5f5d8382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:22.521590 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e9a27-26c1-4d43-add7-7b4f5f5d8382 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:22.521885 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e9a27-26c1-4d43-add7-7b4f5f5d8382 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:22.522164 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e9a27-26c1-4d43-add7-7b4f5f5d8382 admin admin] PATH_INFO: `/v3/projects/bae137591107409085588f8b351ce66c/users/a393bac3d0284091bf1fdd15e33fa9a5/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:22.523989 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e9a27-26c1-4d43-add7-7b4f5f5d8382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bae137591107409085588f8b351ce66c, user_id=a393bac3d0284091bf1fdd15e33fa9a5, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:22.558024 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e9a27-26c1-4d43-add7-7b4f5f5d8382 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:22.590535 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 829/1657] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:22 2021] PUT /identity/v3/projects/bae137591107409085588f8b351ce66c/users/a393bac3d0284091bf1fdd15e33fa9a5/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:22.592269 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a393445-d394-42a1-842a-bc33e12c7922 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:22.592569 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a393445-d394-42a1-842a-bc33e12c7922 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:22.592859 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a393445-d394-42a1-842a-bc33e12c7922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:22.634796 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-3a393445-d394-42a1-842a-bc33e12c7922 None None] MFA Rules not processed for user `a393bac3d0284091bf1fdd15e33fa9a5`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:22.635981 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-3a393445-d394-42a1-842a-bc33e12c7922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:22.724203 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 829/1658] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:22 2021] POST /identity/v3/auth/tokens => generated 3739 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:22.734617 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e9a27-26c1-4d43-add7-7b4f5f5d8382 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:22.738457 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-a37e9a27-26c1-4d43-add7-7b4f5f5d8382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:22.813476 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e9a27-26c1-4d43-add7-7b4f5f5d8382 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:22.817318 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd021a3-0d24-41b4-8aa3-5d33abb383f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:22.817919 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd021a3-0d24-41b4-8aa3-5d33abb383f8 service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:22.818209 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd021a3-0d24-41b4-8aa3-5d33abb383f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:22.818499 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd021a3-0d24-41b4-8aa3-5d33abb383f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:22.830128 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd021a3-0d24-41b4-8aa3-5d33abb383f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:22.856588 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd021a3-0d24-41b4-8aa3-5d33abb383f8 service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:22.879060 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 830/1659] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:22 2021] GET /identity/v3/auth/tokens => generated 3739 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:22.988676 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a393445-d394-42a1-842a-bc33e12c7922 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:22.999122 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a393445-d394-42a1-842a-bc33e12c7922 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:23.003827 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812a93b-25f4-42bf-ab8b-e50e9c521bad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:23.004381 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812a93b-25f4-42bf-ab8b-e50e9c521bad service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:23.004698 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812a93b-25f4-42bf-ab8b-e50e9c521bad service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:23.004993 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812a93b-25f4-42bf-ab8b-e50e9c521bad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:23.087275 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812a93b-25f4-42bf-ab8b-e50e9c521bad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:23.112943 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812a93b-25f4-42bf-ab8b-e50e9c521bad service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:23.122446 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 830/1660] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:22 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:52:24.328302 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffc2b8-ab38-4a92-8f8f-25a1fb2d2cdf None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:24.328880 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffc2b8-ab38-4a92-8f8f-25a1fb2d2cdf None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:24.331533 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffc2b8-ab38-4a92-8f8f-25a1fb2d2cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:24.371367 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-c4ffc2b8-ab38-4a92-8f8f-25a1fb2d2cdf None None] MFA Rules not processed for user `26b2db123c664c398307c4fdf26c2406`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:24.372970 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c4ffc2b8-ab38-4a92-8f8f-25a1fb2d2cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:24.573671 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 831/1661] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:24 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:52:24.664536 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbd27e-7d95-49c5-a35b-d64ce8b2ee73 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:24.665031 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbd27e-7d95-49c5-a35b-d64ce8b2ee73 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:24.665127 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbd27e-7d95-49c5-a35b-d64ce8b2ee73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:24.731309 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-acfbd27e-7d95-49c5-a35b-d64ce8b2ee73 None None] MFA Rules not processed for user `1959af22edbf47cd8afca70831d476c0`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:24.732732 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-acfbd27e-7d95-49c5-a35b-d64ce8b2ee73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:24.857720 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 831/1662] 10.222.0.37 () {58 vars in 1014 bytes} [Wed Dec 29 20:52:24 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:25.021346 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffc2b8-ab38-4a92-8f8f-25a1fb2d2cdf None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:25.023003 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c4ffc2b8-ab38-4a92-8f8f-25a1fb2d2cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:25.108981 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffc2b8-ab38-4a92-8f8f-25a1fb2d2cdf None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:25.116412 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43734b3e-a6ad-44f6-9f82-0f8f98f6f65d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd2861e377640c9b76d0dfb08cf088e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:25.117205 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43734b3e-a6ad-44f6-9f82-0f8f98f6f65d service swift] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:25.117595 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43734b3e-a6ad-44f6-9f82-0f8f98f6f65d service swift] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:25.118030 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43734b3e-a6ad-44f6-9f82-0f8f98f6f65d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:25.128610 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43734b3e-a6ad-44f6-9f82-0f8f98f6f65d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:25.155757 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43734b3e-a6ad-44f6-9f82-0f8f98f6f65d service swift] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:25.165868 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 832/1663] 10.222.0.37 () {60 vars in 1384 bytes} [Wed Dec 29 20:52:25 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 29 20:52:28.102910 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbd27e-7d95-49c5-a35b-d64ce8b2ee73 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:28.361627 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbd27e-7d95-49c5-a35b-d64ce8b2ee73 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:28.371085 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb55781-a22b-416b-b18a-75dfe5257cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:28.373725 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb55781-a22b-416b-b18a-75dfe5257cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:28.374025 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb55781-a22b-416b-b18a-75dfe5257cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:28.374326 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb55781-a22b-416b-b18a-75dfe5257cc6 admin admin] PATH_INFO: `/v3/users/e78fc5dd2bfc42c2afca9586e9e026bf` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:28.376701 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb55781-a22b-416b-b18a-75dfe5257cc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e78fc5dd2bfc42c2afca9586e9e026bf)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:28.448257 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb55781-a22b-416b-b18a-75dfe5257cc6 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:28.552441 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4bb55781-a22b-416b-b18a-75dfe5257cc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e78fc5dd2bfc42c2afca9586e9e026bf'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:28.553233 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4bb55781-a22b-416b-b18a-75dfe5257cc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e78fc5dd2bfc42c2afca9586e9e026bf'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:28.576494 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4bb55781-a22b-416b-b18a-75dfe5257cc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e78fc5dd2bfc42c2afca9586e9e026bf'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:28.602080 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4bb55781-a22b-416b-b18a-75dfe5257cc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e78fc5dd2bfc42c2afca9586e9e026bf'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:28.616730 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4bb55781-a22b-416b-b18a-75dfe5257cc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e78fc5dd2bfc42c2afca9586e9e026bf'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:28.627686 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 832/1664] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:52:28 2021] DELETE /identity/v3/users/e78fc5dd2bfc42c2afca9586e9e026bf => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:28.632336 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e6653-5482-4530-a0ac-ec64a424c091 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:28.633219 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e6653-5482-4530-a0ac-ec64a424c091 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:28.634981 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e6653-5482-4530-a0ac-ec64a424c091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:28.659606 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb55781-a22b-416b-b18a-75dfe5257cc6 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:28.662787 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-4bb55781-a22b-416b-b18a-75dfe5257cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:28.700052 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-bd0e6653-5482-4530-a0ac-ec64a424c091 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:28.704532 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-bd0e6653-5482-4530-a0ac-ec64a424c091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:28.911214 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 833/1665] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:28.950520 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb55781-a22b-416b-b18a-75dfe5257cc6 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:28.980047 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f9025-1a24-4ca8-9cd9-c96afa86eae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:28.980901 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9025-1a24-4ca8-9cd9-c96afa86eae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:28.981191 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9025-1a24-4ca8-9cd9-c96afa86eae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:28.981642 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9025-1a24-4ca8-9cd9-c96afa86eae9 admin admin] PATH_INFO: `/v3/users/c1a07ded28af4bd9ad945650dca10c5e` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:28.983161 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f9025-1a24-4ca8-9cd9-c96afa86eae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1a07ded28af4bd9ad945650dca10c5e)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:29.013122 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e6653-5482-4530-a0ac-ec64a424c091 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:29.015833 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-bd0e6653-5482-4530-a0ac-ec64a424c091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:29.079516 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f9025-1a24-4ca8-9cd9-c96afa86eae9 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:29.218521 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e6653-5482-4530-a0ac-ec64a424c091 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:29.225078 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-5d6f9025-1a24-4ca8-9cd9-c96afa86eae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1a07ded28af4bd9ad945650dca10c5e'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:29.226009 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-5d6f9025-1a24-4ca8-9cd9-c96afa86eae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1a07ded28af4bd9ad945650dca10c5e'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:29.231068 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7ed00-5bf8-4d6d-93b3-766ad74d4c69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:29.231681 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7ed00-5bf8-4d6d-93b3-766ad74d4c69 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:29.231972 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7ed00-5bf8-4d6d-93b3-766ad74d4c69 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:29.232241 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7ed00-5bf8-4d6d-93b3-766ad74d4c69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:29.254930 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-5d6f9025-1a24-4ca8-9cd9-c96afa86eae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1a07ded28af4bd9ad945650dca10c5e'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:29.275727 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7ed00-5bf8-4d6d-93b3-766ad74d4c69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:29.296563 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-5d6f9025-1a24-4ca8-9cd9-c96afa86eae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1a07ded28af4bd9ad945650dca10c5e'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:29.316285 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-5d6f9025-1a24-4ca8-9cd9-c96afa86eae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1a07ded28af4bd9ad945650dca10c5e'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:29.332526 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 833/1666] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:52:28 2021] DELETE /identity/v3/users/c1a07ded28af4bd9ad945650dca10c5e => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:29.333905 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807122d-d945-4733-93e7-0310f1849a90 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:29.334428 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807122d-d945-4733-93e7-0310f1849a90 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:29.334497 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807122d-d945-4733-93e7-0310f1849a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:29.349797 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7ed00-5bf8-4d6d-93b3-766ad74d4c69 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:29.372078 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 834/1667] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:29 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:29.373313 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a6955-23c8-463d-bf78-f1c4391608f5 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:29.373614 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a6955-23c8-463d-bf78-f1c4391608f5 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:29.373898 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a6955-23c8-463d-bf78-f1c4391608f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:29.390769 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-b807122d-d945-4733-93e7-0310f1849a90 None None] MFA Rules not processed for user `55d700adb7db4848a97bab6cf4105481`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:29.392512 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-b807122d-d945-4733-93e7-0310f1849a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:29.428315 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-0f1a6955-23c8-463d-bf78-f1c4391608f5 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:29.428315 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-0f1a6955-23c8-463d-bf78-f1c4391608f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:29.550134 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 834/1668] 10.222.0.46 () {58 vars in 1015 bytes} [Wed Dec 29 20:52:29 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:29.582674 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 835/1669] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:29.599247 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807122d-d945-4733-93e7-0310f1849a90 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:29.601362 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-b807122d-d945-4733-93e7-0310f1849a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:29.619776 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807122d-d945-4733-93e7-0310f1849a90 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:29.624326 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc360b59-da39-4c2e-a5cc-d23bc7114976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:29.625147 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc360b59-da39-4c2e-a5cc-d23bc7114976 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:29.625835 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc360b59-da39-4c2e-a5cc-d23bc7114976 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:29.626580 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc360b59-da39-4c2e-a5cc-d23bc7114976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:29.637241 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a6955-23c8-463d-bf78-f1c4391608f5 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:29.652139 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc360b59-da39-4c2e-a5cc-d23bc7114976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:29.656049 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a6955-23c8-463d-bf78-f1c4391608f5 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:29.673755 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db3c24-31c8-4ae8-bdd9-744a05f17bf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:29.674622 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db3c24-31c8-4ae8-bdd9-744a05f17bf6 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:29.675463 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db3c24-31c8-4ae8-bdd9-744a05f17bf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:29.675915 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db3c24-31c8-4ae8-bdd9-744a05f17bf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:29.695925 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db3c24-31c8-4ae8-bdd9-744a05f17bf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:29.740355 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc360b59-da39-4c2e-a5cc-d23bc7114976 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:29.762986 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 835/1670] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:29 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:29.764103 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc360b59-da39-4c2e-a5cc-d23bc7114976 service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:29.772306 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db3c24-31c8-4ae8-bdd9-744a05f17bf6 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:29.785199 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc360b59-da39-4c2e-a5cc-d23bc7114976 service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:29.798865 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148b891-66db-45ae-aac8-7a8873e6429a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:29.802235 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148b891-66db-45ae-aac8-7a8873e6429a service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:29.802769 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148b891-66db-45ae-aac8-7a8873e6429a service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:29.803198 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148b891-66db-45ae-aac8-7a8873e6429a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:29.806540 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 836/1671] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:29 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:29.807773 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db3c24-31c8-4ae8-bdd9-744a05f17bf6 service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:29.812510 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-f8db3c24-31c8-4ae8-bdd9-744a05f17bf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:29.820951 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148b891-66db-45ae-aac8-7a8873e6429a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:29.842790 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db3c24-31c8-4ae8-bdd9-744a05f17bf6 service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:29.859820 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4746f5f-90b8-4277-8caf-ee3ce0badb25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:29.860647 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4746f5f-90b8-4277-8caf-ee3ce0badb25 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:29.861033 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4746f5f-90b8-4277-8caf-ee3ce0badb25 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:29.861832 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4746f5f-90b8-4277-8caf-ee3ce0badb25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:29.902122 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4746f5f-90b8-4277-8caf-ee3ce0badb25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:29.917046 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148b891-66db-45ae-aac8-7a8873e6429a service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:29.944680 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 836/1672] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:29 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:30.051678 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4746f5f-90b8-4277-8caf-ee3ce0badb25 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:30.075762 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 837/1673] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:29 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:30.120591 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148b891-66db-45ae-aac8-7a8873e6429a service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:30.122095 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-a148b891-66db-45ae-aac8-7a8873e6429a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:30.167616 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148b891-66db-45ae-aac8-7a8873e6429a service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:30.181977 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4566be-7e51-42d9-a1b3-522ec502b5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:30.184934 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4566be-7e51-42d9-a1b3-522ec502b5d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:30.185413 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4566be-7e51-42d9-a1b3-522ec502b5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:30.185810 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4566be-7e51-42d9-a1b3-522ec502b5d2 admin admin] PATH_INFO: `/v3/users/20cdfac198da45b49624a2da3410fa3f` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:30.190096 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4566be-7e51-42d9-a1b3-522ec502b5d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20cdfac198da45b49624a2da3410fa3f)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:30.259643 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4566be-7e51-42d9-a1b3-522ec502b5d2 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:30.382607 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6f4566be-7e51-42d9-a1b3-522ec502b5d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20cdfac198da45b49624a2da3410fa3f'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:30.396917 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6f4566be-7e51-42d9-a1b3-522ec502b5d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20cdfac198da45b49624a2da3410fa3f'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:30.433188 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6f4566be-7e51-42d9-a1b3-522ec502b5d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20cdfac198da45b49624a2da3410fa3f'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:30.458930 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6f4566be-7e51-42d9-a1b3-522ec502b5d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20cdfac198da45b49624a2da3410fa3f'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:30.470861 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6f4566be-7e51-42d9-a1b3-522ec502b5d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20cdfac198da45b49624a2da3410fa3f'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:30.480143 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 837/1674] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:52:30 2021] DELETE /identity/v3/users/20cdfac198da45b49624a2da3410fa3f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:30.485552 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc134c06-93ba-4a23-a718-3a4255a154b6 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:30.486328 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc134c06-93ba-4a23-a718-3a4255a154b6 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:30.486784 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc134c06-93ba-4a23-a718-3a4255a154b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:30.523759 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-cc134c06-93ba-4a23-a718-3a4255a154b6 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:30.527434 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-cc134c06-93ba-4a23-a718-3a4255a154b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:30.635474 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 838/1675] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:30.671270 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4566be-7e51-42d9-a1b3-522ec502b5d2 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:30.674210 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-6f4566be-7e51-42d9-a1b3-522ec502b5d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:30.841334 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4566be-7e51-42d9-a1b3-522ec502b5d2 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:30.845264 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2bf62-392b-4ebb-a6e9-9268937ccf30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:30.846047 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2bf62-392b-4ebb-a6e9-9268937ccf30 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:30.846336 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2bf62-392b-4ebb-a6e9-9268937ccf30 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:30.846624 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2bf62-392b-4ebb-a6e9-9268937ccf30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:30.870986 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2bf62-392b-4ebb-a6e9-9268937ccf30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:30.910569 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2bf62-392b-4ebb-a6e9-9268937ccf30 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:30.924688 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 838/1676] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:30 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:31.660405 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc134c06-93ba-4a23-a718-3a4255a154b6 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:31.662453 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-cc134c06-93ba-4a23-a718-3a4255a154b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:31.676915 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc134c06-93ba-4a23-a718-3a4255a154b6 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:31.683211 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc94ece-4539-4258-bb0e-d3cda9564573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:31.684611 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc94ece-4539-4258-bb0e-d3cda9564573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:31.685463 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc94ece-4539-4258-bb0e-d3cda9564573 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:31.685950 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc94ece-4539-4258-bb0e-d3cda9564573 admin admin] PATH_INFO: `/v3/users/2ad70cc01e8b4e1bada059df068375b1` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:31.687382 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc94ece-4539-4258-bb0e-d3cda9564573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad70cc01e8b4e1bada059df068375b1)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:31.719180 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc94ece-4539-4258-bb0e-d3cda9564573 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:31.774860 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2bf62-392b-4ebb-a6e9-9268937ccf30 service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:31.777504 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-e3e2bf62-392b-4ebb-a6e9-9268937ccf30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:31.800589 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2bf62-392b-4ebb-a6e9-9268937ccf30 service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:31.801287 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-6dc94ece-4539-4258-bb0e-d3cda9564573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad70cc01e8b4e1bada059df068375b1'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:31.815275 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa856df0-c80a-4a11-8576-3fe3ae943ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:31.816086 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa856df0-c80a-4a11-8576-3fe3ae943ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:31.816379 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa856df0-c80a-4a11-8576-3fe3ae943ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:31.816683 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa856df0-c80a-4a11-8576-3fe3ae943ab7 admin admin] PATH_INFO: `/v3/projects/d1136483572d4751b1e5b5716a542939` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:31.817867 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa856df0-c80a-4a11-8576-3fe3ae943ab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1136483572d4751b1e5b5716a542939)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:31.820664 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-6dc94ece-4539-4258-bb0e-d3cda9564573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad70cc01e8b4e1bada059df068375b1'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:31.821825 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-6dc94ece-4539-4258-bb0e-d3cda9564573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad70cc01e8b4e1bada059df068375b1'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:31.832488 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-6dc94ece-4539-4258-bb0e-d3cda9564573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad70cc01e8b4e1bada059df068375b1'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:31.841165 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-6dc94ece-4539-4258-bb0e-d3cda9564573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad70cc01e8b4e1bada059df068375b1'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:31.851009 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 839/1677] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:52:31 2021] DELETE /identity/v3/users/2ad70cc01e8b4e1bada059df068375b1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:31.855197 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb7fbb-d329-4679-b7b9-960fe9401233 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:31.855675 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb7fbb-d329-4679-b7b9-960fe9401233 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:31.856161 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb7fbb-d329-4679-b7b9-960fe9401233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:31.882912 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-99bb7fbb-d329-4679-b7b9-960fe9401233 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:31.895734 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-99bb7fbb-d329-4679-b7b9-960fe9401233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:31.927501 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: WARNING py.warnings [None req-fa856df0-c80a-4a11-8576-3fe3ae943ab7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 29 20:52:31.927501 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: warnings.warn(msg) Dec 29 20:52:31.927501 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: Dec 29 20:52:31.929210 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa856df0-c80a-4a11-8576-3fe3ae943ab7 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:31.985080 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 840/1678] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:32.054629 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb7fbb-d329-4679-b7b9-960fe9401233 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:32.057042 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-fa856df0-c80a-4a11-8576-3fe3ae943ab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1136483572d4751b1e5b5716a542939', 'request_id': 'req-fa856df0-c80a-4a11-8576-3fe3ae943ab7'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:32.057929 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-99bb7fbb-d329-4679-b7b9-960fe9401233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:32.069504 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-fa856df0-c80a-4a11-8576-3fe3ae943ab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1136483572d4751b1e5b5716a542939', 'request_id': 'req-fa856df0-c80a-4a11-8576-3fe3ae943ab7'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:32.084920 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-fa856df0-c80a-4a11-8576-3fe3ae943ab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1136483572d4751b1e5b5716a542939', 'request_id': 'req-fa856df0-c80a-4a11-8576-3fe3ae943ab7'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:32.114817 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-fa856df0-c80a-4a11-8576-3fe3ae943ab7 admin admin] The token cache is being invalidate because project d1136483572d4751b1e5b5716a542939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:52:32.115413 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-fa856df0-c80a-4a11-8576-3fe3ae943ab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:32.116098 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-fa856df0-c80a-4a11-8576-3fe3ae943ab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:32.120745 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 839/1679] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:52:31 2021] DELETE /identity/v3/projects/d1136483572d4751b1e5b5716a542939 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:32.130872 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa856df0-c80a-4a11-8576-3fe3ae943ab7 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:32.137007 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-fa856df0-c80a-4a11-8576-3fe3ae943ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:32.234154 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb7fbb-d329-4679-b7b9-960fe9401233 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:32.331524 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa856df0-c80a-4a11-8576-3fe3ae943ab7 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:32.357858 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a4173-f0be-486c-94d5-d01ab56d2b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:32.360568 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a4173-f0be-486c-94d5-d01ab56d2b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:32.362204 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a4173-f0be-486c-94d5-d01ab56d2b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:32.362639 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a4173-f0be-486c-94d5-d01ab56d2b06 admin admin] PATH_INFO: `/v3/users/a393bac3d0284091bf1fdd15e33fa9a5` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:32.367227 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a4173-f0be-486c-94d5-d01ab56d2b06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a393bac3d0284091bf1fdd15e33fa9a5)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:32.374555 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940bef0-8d4e-4242-98d5-dbee714665e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:32.376939 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940bef0-8d4e-4242-98d5-dbee714665e2 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:32.377242 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940bef0-8d4e-4242-98d5-dbee714665e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:32.377583 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940bef0-8d4e-4242-98d5-dbee714665e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:32.383671 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-b940bef0-8d4e-4242-98d5-dbee714665e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:32.410492 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940bef0-8d4e-4242-98d5-dbee714665e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:32.444636 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a4173-f0be-486c-94d5-d01ab56d2b06 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:32.455688 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940bef0-8d4e-4242-98d5-dbee714665e2 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:32.485869 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 841/1680] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:32 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:52:32.488530 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96df153-145d-4c64-ac97-c302075d8299 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:32.490057 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96df153-145d-4c64-ac97-c302075d8299 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:32.490541 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96df153-145d-4c64-ac97-c302075d8299 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:32.492994 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 842/1681] 10.222.0.37 () {54 vars in 921 bytes} [Wed Dec 29 20:52:32 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:52:32.517350 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711abcc-421b-4860-add0-53b42f7b2420 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:32.518182 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711abcc-421b-4860-add0-53b42f7b2420 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:32.518878 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711abcc-421b-4860-add0-53b42f7b2420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:32.544682 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d03a4173-f0be-486c-94d5-d01ab56d2b06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a393bac3d0284091bf1fdd15e33fa9a5'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:32.545499 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d03a4173-f0be-486c-94d5-d01ab56d2b06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a393bac3d0284091bf1fdd15e33fa9a5'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:32.565016 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d03a4173-f0be-486c-94d5-d01ab56d2b06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a393bac3d0284091bf1fdd15e33fa9a5'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:32.580931 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d03a4173-f0be-486c-94d5-d01ab56d2b06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a393bac3d0284091bf1fdd15e33fa9a5'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:32.585916 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-f711abcc-421b-4860-add0-53b42f7b2420 None None] MFA Rules not processed for user `51ef7e54d97a4320bda0c1926d190d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:32.590357 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d03a4173-f0be-486c-94d5-d01ab56d2b06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a393bac3d0284091bf1fdd15e33fa9a5'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:32.591740 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-f711abcc-421b-4860-add0-53b42f7b2420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:32.608450 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 840/1682] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:52:32 2021] DELETE /identity/v3/users/a393bac3d0284091bf1fdd15e33fa9a5 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:32.700138 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 843/1683] 10.222.0.37 () {58 vars in 1018 bytes} [Wed Dec 29 20:52:32 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:32.893917 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a4173-f0be-486c-94d5-d01ab56d2b06 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:32.895603 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-d03a4173-f0be-486c-94d5-d01ab56d2b06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:33.113576 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a4173-f0be-486c-94d5-d01ab56d2b06 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:33.120664 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9186a8-41dd-4eb9-a190-869d364f5b0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:33.121828 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9186a8-41dd-4eb9-a190-869d364f5b0f service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:33.121828 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9186a8-41dd-4eb9-a190-869d364f5b0f service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:33.122963 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9186a8-41dd-4eb9-a190-869d364f5b0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:33.134165 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9186a8-41dd-4eb9-a190-869d364f5b0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:33.165384 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9186a8-41dd-4eb9-a190-869d364f5b0f service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:33.179833 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 841/1684] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:32 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:33.203221 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d217b-a1ea-43d3-8241-fdb80dbee4f2 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:33.204454 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d217b-a1ea-43d3-8241-fdb80dbee4f2 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:33.204842 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d217b-a1ea-43d3-8241-fdb80dbee4f2 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:33.207814 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 844/1685] 10.222.0.37 () {54 vars in 921 bytes} [Wed Dec 29 20:52:33 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 20:52:33.214987 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9186a8-41dd-4eb9-a190-869d364f5b0f service nova] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:33.217244 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-fe9186a8-41dd-4eb9-a190-869d364f5b0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:33.299227 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d217b-a1ea-43d3-8241-fdb80dbee4f2 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:33.300987 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-237d217b-a1ea-43d3-8241-fdb80dbee4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:33.451789 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9186a8-41dd-4eb9-a190-869d364f5b0f service nova] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:33.463053 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc2a6f-82b8-4cab-be91-d69b1bf23feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:33.464339 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc2a6f-82b8-4cab-be91-d69b1bf23feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:33.465027 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc2a6f-82b8-4cab-be91-d69b1bf23feb admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:33.465624 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc2a6f-82b8-4cab-be91-d69b1bf23feb admin admin] PATH_INFO: `/v3/projects/bd13041da7d149e39ab0525b1e164c04` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:33.468421 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc2a6f-82b8-4cab-be91-d69b1bf23feb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd13041da7d149e39ab0525b1e164c04)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:33.512412 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d217b-a1ea-43d3-8241-fdb80dbee4f2 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:33.526505 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54244d-e9c2-4db2-b733-948611249dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:33.527338 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54244d-e9c2-4db2-b733-948611249dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:33.527625 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54244d-e9c2-4db2-b733-948611249dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:33.527904 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54244d-e9c2-4db2-b733-948611249dc9 admin admin] PATH_INFO: `/v3/projects/34af0c88029542c8be4a5686fafd259f` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:33.530797 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54244d-e9c2-4db2-b733-948611249dc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34af0c88029542c8be4a5686fafd259f)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:33.541462 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc2a6f-82b8-4cab-be91-d69b1bf23feb admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:33.602783 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54244d-e9c2-4db2-b733-948611249dc9 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:33.681559 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-70bc2a6f-82b8-4cab-be91-d69b1bf23feb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd13041da7d149e39ab0525b1e164c04', 'request_id': 'req-70bc2a6f-82b8-4cab-be91-d69b1bf23feb'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:33.701079 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-70bc2a6f-82b8-4cab-be91-d69b1bf23feb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd13041da7d149e39ab0525b1e164c04', 'request_id': 'req-70bc2a6f-82b8-4cab-be91-d69b1bf23feb'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:33.720391 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-70bc2a6f-82b8-4cab-be91-d69b1bf23feb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd13041da7d149e39ab0525b1e164c04', 'request_id': 'req-70bc2a6f-82b8-4cab-be91-d69b1bf23feb'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:33.786232 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-70bc2a6f-82b8-4cab-be91-d69b1bf23feb admin admin] The token cache is being invalidate because project bd13041da7d149e39ab0525b1e164c04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:52:33.787443 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-70bc2a6f-82b8-4cab-be91-d69b1bf23feb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:33.791518 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-70bc2a6f-82b8-4cab-be91-d69b1bf23feb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:33.798591 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 842/1686] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:52:33 2021] DELETE /identity/v3/projects/bd13041da7d149e39ab0525b1e164c04 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:33.822277 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc95fda-8f6c-4a69-b183-34bd95a5dc98 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:33.823889 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc95fda-8f6c-4a69-b183-34bd95a5dc98 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:33.826201 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc95fda-8f6c-4a69-b183-34bd95a5dc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:33.826962 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-1e54244d-e9c2-4db2-b733-948611249dc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34af0c88029542c8be4a5686fafd259f', 'request_id': 'req-1e54244d-e9c2-4db2-b733-948611249dc9'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:33.849137 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-1e54244d-e9c2-4db2-b733-948611249dc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34af0c88029542c8be4a5686fafd259f', 'request_id': 'req-1e54244d-e9c2-4db2-b733-948611249dc9'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:33.908564 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-1e54244d-e9c2-4db2-b733-948611249dc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34af0c88029542c8be4a5686fafd259f', 'request_id': 'req-1e54244d-e9c2-4db2-b733-948611249dc9'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:33.947156 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-bbc95fda-8f6c-4a69-b183-34bd95a5dc98 None None] MFA Rules not processed for user `51ef7e54d97a4320bda0c1926d190d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:33.954042 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-bbc95fda-8f6c-4a69-b183-34bd95a5dc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:33.957996 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-1e54244d-e9c2-4db2-b733-948611249dc9 admin admin] The token cache is being invalidate because project 34af0c88029542c8be4a5686fafd259f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:52:33.961319 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-1e54244d-e9c2-4db2-b733-948611249dc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:33.965122 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-1e54244d-e9c2-4db2-b733-948611249dc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:33.983951 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 845/1687] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:52:33 2021] DELETE /identity/v3/projects/34af0c88029542c8be4a5686fafd259f => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:33.985678 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54244d-e9c2-4db2-b733-948611249dc9 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:33.987189 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-1e54244d-e9c2-4db2-b733-948611249dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:34.084811 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 843/1688] 10.222.0.37 () {58 vars in 1018 bytes} [Wed Dec 29 20:52:33 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:34.090844 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826ba2a-c552-4090-b080-a64cd1ab1252 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:34.091328 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826ba2a-c552-4090-b080-a64cd1ab1252 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:34.091925 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826ba2a-c552-4090-b080-a64cd1ab1252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:34.123921 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-e826ba2a-c552-4090-b080-a64cd1ab1252 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:34.125382 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-e826ba2a-c552-4090-b080-a64cd1ab1252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:34.173406 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54244d-e9c2-4db2-b733-948611249dc9 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:34.177765 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f51e3-85df-4a55-92a3-3905c49b61da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:34.178805 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f51e3-85df-4a55-92a3-3905c49b61da admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:34.179252 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f51e3-85df-4a55-92a3-3905c49b61da admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:34.179656 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f51e3-85df-4a55-92a3-3905c49b61da admin admin] PATH_INFO: `/v3/users/c09c5b814b224563a75350a6f77c8976` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:34.181334 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f51e3-85df-4a55-92a3-3905c49b61da admin admin] RBAC: Authorizing `identity:delete_user(user_id=c09c5b814b224563a75350a6f77c8976)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:34.222903 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f51e3-85df-4a55-92a3-3905c49b61da admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:34.257884 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 844/1689] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:34.266666 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd949f-ecfb-449a-982b-84fbc048dcdb None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:34.267134 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd949f-ecfb-449a-982b-84fbc048dcdb None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:34.267562 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd949f-ecfb-449a-982b-84fbc048dcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:34.335364 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-5a4f51e3-85df-4a55-92a3-3905c49b61da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c09c5b814b224563a75350a6f77c8976'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:34.354370 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-10bd949f-ecfb-449a-982b-84fbc048dcdb None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:34.356008 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-10bd949f-ecfb-449a-982b-84fbc048dcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:34.360615 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-5a4f51e3-85df-4a55-92a3-3905c49b61da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c09c5b814b224563a75350a6f77c8976'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:34.363204 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-5a4f51e3-85df-4a55-92a3-3905c49b61da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c09c5b814b224563a75350a6f77c8976'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:34.374092 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-5a4f51e3-85df-4a55-92a3-3905c49b61da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c09c5b814b224563a75350a6f77c8976'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:34.394683 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-5a4f51e3-85df-4a55-92a3-3905c49b61da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c09c5b814b224563a75350a6f77c8976'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:34.396992 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 845/1690] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:52:34.402845 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd949f-ecfb-449a-982b-84fbc048dcdb None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:34.408510 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 846/1691] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:52:33 2021] DELETE /identity/v3/users/c09c5b814b224563a75350a6f77c8976 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:34.423577 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd949f-ecfb-449a-982b-84fbc048dcdb None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:34.506514 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffded165-4c9e-4c84-99b4-accfe3d90b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:34.507585 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffded165-4c9e-4c84-99b4-accfe3d90b7b admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:34.508258 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffded165-4c9e-4c84-99b4-accfe3d90b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:34.508705 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffded165-4c9e-4c84-99b4-accfe3d90b7b admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:34.509611 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffded165-4c9e-4c84-99b4-accfe3d90b7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:52:34.510076 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffded165-4c9e-4c84-99b4-accfe3d90b7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:34.541437 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffded165-4c9e-4c84-99b4-accfe3d90b7b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:34.562306 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 846/1692] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:52:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:52:34.564649 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f51e3-85df-4a55-92a3-3905c49b61da admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:34.566308 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-5a4f51e3-85df-4a55-92a3-3905c49b61da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:34.590760 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f51e3-85df-4a55-92a3-3905c49b61da admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:34.597977 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de78c62-b8e3-4501-8906-ec76703bb1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:34.599176 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de78c62-b8e3-4501-8906-ec76703bb1da admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:34.600175 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de78c62-b8e3-4501-8906-ec76703bb1da admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:34.601325 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de78c62-b8e3-4501-8906-ec76703bb1da admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:34.602779 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de78c62-b8e3-4501-8906-ec76703bb1da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:34.650198 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de78c62-b8e3-4501-8906-ec76703bb1da admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:34.703725 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 847/1693] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:34 2021] POST /identity/v3/projects => generated 407 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:34.708315 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffded165-4c9e-4c84-99b4-accfe3d90b7b admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:34.721751 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffded165-4c9e-4c84-99b4-accfe3d90b7b admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:35.010742 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2620f25-2d86-451d-9933-ab254e32f40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:35.011764 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2620f25-2d86-451d-9933-ab254e32f40c admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:35.012263 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2620f25-2d86-451d-9933-ab254e32f40c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:35.012739 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2620f25-2d86-451d-9933-ab254e32f40c admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:35.020487 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2620f25-2d86-451d-9933-ab254e32f40c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:35.134342 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2620f25-2d86-451d-9933-ab254e32f40c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:35.205526 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 847/1694] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:34 2021] POST /identity/v3/users => generated 304 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:52:35.211030 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de78c62-b8e3-4501-8906-ec76703bb1da admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:35.236638 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de78c62-b8e3-4501-8906-ec76703bb1da admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:35.249346 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b857b-551e-4c84-b048-cd788e53dda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:35.251292 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b857b-551e-4c84-b048-cd788e53dda9 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:35.251879 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b857b-551e-4c84-b048-cd788e53dda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:35.252409 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b857b-551e-4c84-b048-cd788e53dda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:35.253657 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b857b-551e-4c84-b048-cd788e53dda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:35.311920 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b857b-551e-4c84-b048-cd788e53dda9 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:35.340845 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 848/1695] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:35 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:35.345415 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2620f25-2d86-451d-9933-ab254e32f40c admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:35.362132 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2620f25-2d86-451d-9933-ab254e32f40c admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:35.373213 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28e25e-ead3-4735-a3ff-67fecf6769c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:35.378398 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28e25e-ead3-4735-a3ff-67fecf6769c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:35.378920 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28e25e-ead3-4735-a3ff-67fecf6769c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:35.379429 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28e25e-ead3-4735-a3ff-67fecf6769c9 admin admin] PATH_INFO: `/v3/projects/ed0af1d4a5e14a0480db61407b90ffd1/users/9ed1b58a29f34065a13cb62bb196a145/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:35.440332 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b857b-551e-4c84-b048-cd788e53dda9 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:35.444771 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-e29b857b-551e-4c84-b048-cd788e53dda9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:35.459078 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28e25e-ead3-4735-a3ff-67fecf6769c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed0af1d4a5e14a0480db61407b90ffd1, user_id=9ed1b58a29f34065a13cb62bb196a145, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:35.580686 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28e25e-ead3-4735-a3ff-67fecf6769c9 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:35.609490 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 848/1696] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:35 2021] PUT /identity/v3/projects/ed0af1d4a5e14a0480db61407b90ffd1/users/9ed1b58a29f34065a13cb62bb196a145/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:35.611676 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28e25e-ead3-4735-a3ff-67fecf6769c9 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:35.614216 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-4d28e25e-ead3-4735-a3ff-67fecf6769c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:35.663453 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b857b-551e-4c84-b048-cd788e53dda9 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:35.750746 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28e25e-ead3-4735-a3ff-67fecf6769c9 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:35.758770 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461f727-9912-4307-9a81-ba7c19ef1cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:35.759674 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461f727-9912-4307-9a81-ba7c19ef1cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:35.760831 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461f727-9912-4307-9a81-ba7c19ef1cef admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:35.761130 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461f727-9912-4307-9a81-ba7c19ef1cef admin admin] PATH_INFO: `/v3/projects/bae137591107409085588f8b351ce66c` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:35.762983 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461f727-9912-4307-9a81-ba7c19ef1cef admin admin] RBAC: Authorizing `identity:delete_project(project_id=bae137591107409085588f8b351ce66c)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:35.782790 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4d702-c3e5-4028-9c45-6d856219db3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:35.784235 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4d702-c3e5-4028-9c45-6d856219db3b service nova] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:35.784830 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4d702-c3e5-4028-9c45-6d856219db3b service nova] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:35.785197 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4d702-c3e5-4028-9c45-6d856219db3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:35.789372 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-48d4d702-c3e5-4028-9c45-6d856219db3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:35.798482 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461f727-9912-4307-9a81-ba7c19ef1cef admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:35.807941 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4d702-c3e5-4028-9c45-6d856219db3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:35.838996 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4d702-c3e5-4028-9c45-6d856219db3b service nova] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:35.857949 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 849/1697] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:35 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:35.860263 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402f941-70fe-4535-8358-23ad1a2228df None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:35.860782 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402f941-70fe-4535-8358-23ad1a2228df None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:35.861387 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402f941-70fe-4535-8358-23ad1a2228df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:35.926708 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-8461f727-9912-4307-9a81-ba7c19ef1cef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bae137591107409085588f8b351ce66c', 'request_id': 'req-8461f727-9912-4307-9a81-ba7c19ef1cef'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:35.944086 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-3402f941-70fe-4535-8358-23ad1a2228df None None] MFA Rules not processed for user `9ed1b58a29f34065a13cb62bb196a145`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:35.947183 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-3402f941-70fe-4535-8358-23ad1a2228df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:35.949246 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-8461f727-9912-4307-9a81-ba7c19ef1cef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bae137591107409085588f8b351ce66c', 'request_id': 'req-8461f727-9912-4307-9a81-ba7c19ef1cef'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:35.964156 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-8461f727-9912-4307-9a81-ba7c19ef1cef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bae137591107409085588f8b351ce66c', 'request_id': 'req-8461f727-9912-4307-9a81-ba7c19ef1cef'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:36.022269 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-8461f727-9912-4307-9a81-ba7c19ef1cef admin admin] The token cache is being invalidate because project bae137591107409085588f8b351ce66c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:52:36.023904 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-8461f727-9912-4307-9a81-ba7c19ef1cef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:36.026032 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-8461f727-9912-4307-9a81-ba7c19ef1cef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:36.033452 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 849/1698] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:52:35 2021] DELETE /identity/v3/projects/bae137591107409085588f8b351ce66c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:36.043226 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e272d9-77d0-409e-a573-d14f74a9f0f2 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:36.044201 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e272d9-77d0-409e-a573-d14f74a9f0f2 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:36.045090 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e272d9-77d0-409e-a573-d14f74a9f0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:36.087800 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-e0e272d9-77d0-409e-a573-d14f74a9f0f2 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:36.089636 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-e0e272d9-77d0-409e-a573-d14f74a9f0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:36.114756 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 850/1699] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:35 2021] POST /identity/v3/auth/tokens => generated 3714 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:36.118827 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402f941-70fe-4535-8358-23ad1a2228df None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:36.122869 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-3402f941-70fe-4535-8358-23ad1a2228df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:36.261423 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 850/1700] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:36.271390 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59716bea-df0b-4f9d-81a4-a25264454ce6 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:36.272229 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59716bea-df0b-4f9d-81a4-a25264454ce6 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:36.273071 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59716bea-df0b-4f9d-81a4-a25264454ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:36.292358 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402f941-70fe-4535-8358-23ad1a2228df None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:36.299309 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d48178-84ba-4613-a8af-6cb4e8958a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:36.300025 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d48178-84ba-4613-a8af-6cb4e8958a6b admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:36.300247 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d48178-84ba-4613-a8af-6cb4e8958a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:36.300537 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d48178-84ba-4613-a8af-6cb4e8958a6b admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:36.301291 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d48178-84ba-4613-a8af-6cb4e8958a6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:36.305246 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-59716bea-df0b-4f9d-81a4-a25264454ce6 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:36.307116 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-59716bea-df0b-4f9d-81a4-a25264454ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:36.316963 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 851/1701] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:36.322568 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59716bea-df0b-4f9d-81a4-a25264454ce6 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:36.339985 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59716bea-df0b-4f9d-81a4-a25264454ce6 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:36.345122 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d48178-84ba-4613-a8af-6cb4e8958a6b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:36.346059 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ae5e3-20ec-405b-b03f-dded53406ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:36.347270 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ae5e3-20ec-405b-b03f-dded53406ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:36.347898 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ae5e3-20ec-405b-b03f-dded53406ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:36.348433 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ae5e3-20ec-405b-b03f-dded53406ea0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:36.349516 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ae5e3-20ec-405b-b03f-dded53406ea0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:52:36.350092 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ae5e3-20ec-405b-b03f-dded53406ea0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:36.406937 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 851/1702] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:36 2021] POST /identity/v3/projects => generated 403 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:52:36.410177 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d48178-84ba-4613-a8af-6cb4e8958a6b admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:36.418949 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ae5e3-20ec-405b-b03f-dded53406ea0 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:36.444874 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 852/1703] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:52:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:52:36.449287 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ae5e3-20ec-405b-b03f-dded53406ea0 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:36.465942 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ae5e3-20ec-405b-b03f-dded53406ea0 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:36.553595 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d48178-84ba-4613-a8af-6cb4e8958a6b admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:36.560195 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8d72d-26fb-492e-b263-4c4a63d23709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:36.561125 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8d72d-26fb-492e-b263-4c4a63d23709 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:36.561705 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8d72d-26fb-492e-b263-4c4a63d23709 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:36.562169 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8d72d-26fb-492e-b263-4c4a63d23709 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:36.563699 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8d72d-26fb-492e-b263-4c4a63d23709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:36.597057 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8d72d-26fb-492e-b263-4c4a63d23709 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:36.631445 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 852/1704] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:36 2021] POST /identity/v3/users => generated 308 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:52:36.635145 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8d72d-26fb-492e-b263-4c4a63d23709 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:36.652705 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8d72d-26fb-492e-b263-4c4a63d23709 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:36.654647 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201135fe-d71a-40a5-8830-e00ae03ea88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:36.655301 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201135fe-d71a-40a5-8830-e00ae03ea88f admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:36.655593 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201135fe-d71a-40a5-8830-e00ae03ea88f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:36.655879 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201135fe-d71a-40a5-8830-e00ae03ea88f admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:36.656653 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201135fe-d71a-40a5-8830-e00ae03ea88f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:36.658822 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d6232-cd0d-412e-8ea9-0b2bc5f97fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:36.659640 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d6232-cd0d-412e-8ea9-0b2bc5f97fca admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:36.660023 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d6232-cd0d-412e-8ea9-0b2bc5f97fca admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:36.660406 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d6232-cd0d-412e-8ea9-0b2bc5f97fca admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:36.661436 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d6232-cd0d-412e-8ea9-0b2bc5f97fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:36.691136 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201135fe-d71a-40a5-8830-e00ae03ea88f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:36.720464 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d6232-cd0d-412e-8ea9-0b2bc5f97fca admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:36.738004 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 853/1705] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:36 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:36.742278 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d6232-cd0d-412e-8ea9-0b2bc5f97fca admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:36.760568 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d6232-cd0d-412e-8ea9-0b2bc5f97fca admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:36.771471 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f301f-232a-44b5-a025-04dea7294b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:36.772491 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f301f-232a-44b5-a025-04dea7294b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:36.772890 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f301f-232a-44b5-a025-04dea7294b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:36.773377 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f301f-232a-44b5-a025-04dea7294b64 admin admin] PATH_INFO: `/v3/projects/ed880b2883b24f85878625acbcd9fb58/users/1267fb96f82247b7b908918d1edd40e9/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:36.786019 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 853/1706] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:36 2021] POST /identity/v3/projects => generated 377 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:36.799843 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201135fe-d71a-40a5-8830-e00ae03ea88f admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:36.849600 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f301f-232a-44b5-a025-04dea7294b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed880b2883b24f85878625acbcd9fb58, user_id=1267fb96f82247b7b908918d1edd40e9, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:36.994940 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f301f-232a-44b5-a025-04dea7294b64 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:37.106295 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 854/1707] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:36 2021] PUT /identity/v3/projects/ed880b2883b24f85878625acbcd9fb58/users/1267fb96f82247b7b908918d1edd40e9/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:37.113502 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201135fe-d71a-40a5-8830-e00ae03ea88f admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:37.133262 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f301f-232a-44b5-a025-04dea7294b64 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:37.304963 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec2c96-7dfe-4527-a444-ae77953306a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:37.305683 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec2c96-7dfe-4527-a444-ae77953306a6 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:37.306171 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec2c96-7dfe-4527-a444-ae77953306a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:37.306461 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec2c96-7dfe-4527-a444-ae77953306a6 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:37.307244 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec2c96-7dfe-4527-a444-ae77953306a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:37.330272 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f301f-232a-44b5-a025-04dea7294b64 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:37.337520 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec2c96-7dfe-4527-a444-ae77953306a6 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:37.337819 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77991538-3209-43bb-bc11-194a69f1bc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:37.338869 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77991538-3209-43bb-bc11-194a69f1bc0a admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:37.339315 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77991538-3209-43bb-bc11-194a69f1bc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:37.339748 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77991538-3209-43bb-bc11-194a69f1bc0a admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:37.340592 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77991538-3209-43bb-bc11-194a69f1bc0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:37.369334 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 854/1708] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:36 2021] POST /identity/v3/users => generated 289 bytes in 570 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:37.370270 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec2c96-7dfe-4527-a444-ae77953306a6 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:37.375012 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-efec2c96-7dfe-4527-a444-ae77953306a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:37.392783 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec2c96-7dfe-4527-a444-ae77953306a6 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:37.395132 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77991538-3209-43bb-bc11-194a69f1bc0a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:37.398519 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5ac8f-a97e-4b14-886b-152b42badac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:37.399790 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5ac8f-a97e-4b14-886b-152b42badac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:37.400081 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5ac8f-a97e-4b14-886b-152b42badac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:37.400363 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5ac8f-a97e-4b14-886b-152b42badac8 admin admin] PATH_INFO: `/v3/projects/a1c5870ed7d54bdb89c75497ad7a05e8` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:37.401484 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5ac8f-a97e-4b14-886b-152b42badac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1c5870ed7d54bdb89c75497ad7a05e8)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:37.411671 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 855/1709] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:37 2021] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:37.411671 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77991538-3209-43bb-bc11-194a69f1bc0a admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:37.424720 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77991538-3209-43bb-bc11-194a69f1bc0a admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:37.430794 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a76e4-4e2f-4422-a23d-1d1566095b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:37.431607 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a76e4-4e2f-4422-a23d-1d1566095b7c admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:37.432004 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a76e4-4e2f-4422-a23d-1d1566095b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:37.432293 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a76e4-4e2f-4422-a23d-1d1566095b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:37.433280 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a76e4-4e2f-4422-a23d-1d1566095b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:37.437183 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5ac8f-a97e-4b14-886b-152b42badac8 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:37.464076 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a76e4-4e2f-4422-a23d-1d1566095b7c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:37.480911 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 856/1710] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:37 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:37.480911 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a76e4-4e2f-4422-a23d-1d1566095b7c admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:37.493304 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a76e4-4e2f-4422-a23d-1d1566095b7c admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:37.497428 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-bde5ac8f-a97e-4b14-886b-152b42badac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1c5870ed7d54bdb89c75497ad7a05e8', 'request_id': 'req-bde5ac8f-a97e-4b14-886b-152b42badac8'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:37.507812 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-bde5ac8f-a97e-4b14-886b-152b42badac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1c5870ed7d54bdb89c75497ad7a05e8', 'request_id': 'req-bde5ac8f-a97e-4b14-886b-152b42badac8'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:37.517329 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-bde5ac8f-a97e-4b14-886b-152b42badac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1c5870ed7d54bdb89c75497ad7a05e8', 'request_id': 'req-bde5ac8f-a97e-4b14-886b-152b42badac8'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:37.534471 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-bde5ac8f-a97e-4b14-886b-152b42badac8 admin admin] The token cache is being invalidate because project a1c5870ed7d54bdb89c75497ad7a05e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:52:37.534907 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-bde5ac8f-a97e-4b14-886b-152b42badac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:37.535570 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-bde5ac8f-a97e-4b14-886b-152b42badac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:37.537351 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 855/1711] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:52:37 2021] DELETE /identity/v3/projects/a1c5870ed7d54bdb89c75497ad7a05e8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:37.538292 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5ac8f-a97e-4b14-886b-152b42badac8 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:37.540376 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-bde5ac8f-a97e-4b14-886b-152b42badac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:37.582567 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0deb646-3c0e-41d5-ad39-1dcf82ee4995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:37.583447 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0deb646-3c0e-41d5-ad39-1dcf82ee4995 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:37.583740 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0deb646-3c0e-41d5-ad39-1dcf82ee4995 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:37.584019 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0deb646-3c0e-41d5-ad39-1dcf82ee4995 admin admin] PATH_INFO: `/v3/projects/ed880b2883b24f85878625acbcd9fb58/users/1267fb96f82247b7b908918d1edd40e9/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:37.586138 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0deb646-3c0e-41d5-ad39-1dcf82ee4995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed880b2883b24f85878625acbcd9fb58, user_id=1267fb96f82247b7b908918d1edd40e9, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:37.614198 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0deb646-3c0e-41d5-ad39-1dcf82ee4995 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:37.625834 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 857/1712] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:37 2021] PUT /identity/v3/projects/ed880b2883b24f85878625acbcd9fb58/users/1267fb96f82247b7b908918d1edd40e9/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:37.629210 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5ac8f-a97e-4b14-886b-152b42badac8 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:37.629589 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0deb646-3c0e-41d5-ad39-1dcf82ee4995 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:37.631381 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-f0deb646-3c0e-41d5-ad39-1dcf82ee4995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:37.721728 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c9692-0ea5-4249-9d8c-1df23c183a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:37.722699 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c9692-0ea5-4249-9d8c-1df23c183a01 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:37.723023 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c9692-0ea5-4249-9d8c-1df23c183a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:37.723249 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c9692-0ea5-4249-9d8c-1df23c183a01 admin admin] PATH_INFO: `/v3/projects/b7446ae14b9c4067b5b2e49b5fdb8825/users/ef0e68fc30ba42f1a78961795f075444/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:37.732323 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0deb646-3c0e-41d5-ad39-1dcf82ee4995 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:37.737553 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2186b-3b64-46a3-b2eb-eb56fdc3176a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:37.738495 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2186b-3b64-46a3-b2eb-eb56fdc3176a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:37.738840 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2186b-3b64-46a3-b2eb-eb56fdc3176a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:37.739126 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2186b-3b64-46a3-b2eb-eb56fdc3176a admin admin] PATH_INFO: `/v3/users/c30d0167a71545e9a4064a5042a8a388` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:37.740462 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2186b-3b64-46a3-b2eb-eb56fdc3176a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c30d0167a71545e9a4064a5042a8a388)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:37.745931 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c9692-0ea5-4249-9d8c-1df23c183a01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7446ae14b9c4067b5b2e49b5fdb8825, user_id=ef0e68fc30ba42f1a78961795f075444, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:37.774411 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2186b-3b64-46a3-b2eb-eb56fdc3176a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:37.786990 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c9692-0ea5-4249-9d8c-1df23c183a01 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:37.811054 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 856/1713] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:37 2021] PUT /identity/v3/projects/b7446ae14b9c4067b5b2e49b5fdb8825/users/ef0e68fc30ba42f1a78961795f075444/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:37.812609 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c9692-0ea5-4249-9d8c-1df23c183a01 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:37.815592 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-893c9692-0ea5-4249-9d8c-1df23c183a01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:37.859186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4dc2186b-3b64-46a3-b2eb-eb56fdc3176a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c30d0167a71545e9a4064a5042a8a388'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:37.883620 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4dc2186b-3b64-46a3-b2eb-eb56fdc3176a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c30d0167a71545e9a4064a5042a8a388'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:37.884780 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4dc2186b-3b64-46a3-b2eb-eb56fdc3176a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c30d0167a71545e9a4064a5042a8a388'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:37.898426 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4dc2186b-3b64-46a3-b2eb-eb56fdc3176a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c30d0167a71545e9a4064a5042a8a388'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:37.908483 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4dc2186b-3b64-46a3-b2eb-eb56fdc3176a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c30d0167a71545e9a4064a5042a8a388'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:37.916521 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 858/1714] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:52:37 2021] DELETE /identity/v3/users/c30d0167a71545e9a4064a5042a8a388 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:37.920447 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2186b-3b64-46a3-b2eb-eb56fdc3176a admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:37.923154 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-4dc2186b-3b64-46a3-b2eb-eb56fdc3176a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:37.941233 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c9692-0ea5-4249-9d8c-1df23c183a01 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:38.005954 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2186b-3b64-46a3-b2eb-eb56fdc3176a admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:38.010928 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d752f-bfdb-44af-88cc-49bbeef1cd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:38.011719 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d752f-bfdb-44af-88cc-49bbeef1cd6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:38.012002 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d752f-bfdb-44af-88cc-49bbeef1cd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:38.012526 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d752f-bfdb-44af-88cc-49bbeef1cd6f admin admin] PATH_INFO: `/v3/projects/c0508d87074a453995712bbb2a816a9d` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:38.013626 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d752f-bfdb-44af-88cc-49bbeef1cd6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0508d87074a453995712bbb2a816a9d)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:38.015218 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec268ec-5b4e-4b88-8336-b909d198948f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:38.017072 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec268ec-5b4e-4b88-8336-b909d198948f admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:38.017289 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec268ec-5b4e-4b88-8336-b909d198948f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:38.017540 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec268ec-5b4e-4b88-8336-b909d198948f admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:38.026921 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec268ec-5b4e-4b88-8336-b909d198948f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:38.043423 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d752f-bfdb-44af-88cc-49bbeef1cd6f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:38.050490 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec268ec-5b4e-4b88-8336-b909d198948f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:38.069217 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 857/1715] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:37 2021] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:38.074321 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4668a-2040-4eba-8282-de866ad24d43 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:38.074749 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4668a-2040-4eba-8282-de866ad24d43 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:38.075043 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4668a-2040-4eba-8282-de866ad24d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:38.124530 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-e5b4668a-2040-4eba-8282-de866ad24d43 None None] MFA Rules not processed for user `ef0e68fc30ba42f1a78961795f075444`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:38.125762 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-992d752f-bfdb-44af-88cc-49bbeef1cd6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0508d87074a453995712bbb2a816a9d', 'request_id': 'req-992d752f-bfdb-44af-88cc-49bbeef1cd6f'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:38.126295 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-e5b4668a-2040-4eba-8282-de866ad24d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:38.135306 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-992d752f-bfdb-44af-88cc-49bbeef1cd6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0508d87074a453995712bbb2a816a9d', 'request_id': 'req-992d752f-bfdb-44af-88cc-49bbeef1cd6f'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:38.149743 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-992d752f-bfdb-44af-88cc-49bbeef1cd6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0508d87074a453995712bbb2a816a9d', 'request_id': 'req-992d752f-bfdb-44af-88cc-49bbeef1cd6f'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:38.163203 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-992d752f-bfdb-44af-88cc-49bbeef1cd6f admin admin] The token cache is being invalidate because project c0508d87074a453995712bbb2a816a9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:52:38.163640 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-992d752f-bfdb-44af-88cc-49bbeef1cd6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:38.164416 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-992d752f-bfdb-44af-88cc-49bbeef1cd6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:38.166693 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 859/1716] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:52:37 2021] DELETE /identity/v3/projects/c0508d87074a453995712bbb2a816a9d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:38.167879 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d752f-bfdb-44af-88cc-49bbeef1cd6f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:38.169625 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-992d752f-bfdb-44af-88cc-49bbeef1cd6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:38.235834 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 858/1717] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:38 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:38.237495 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6995f-ef9f-4ff3-96cb-fa9e631d9eff None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:38.238090 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6995f-ef9f-4ff3-96cb-fa9e631d9eff None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:38.238522 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6995f-ef9f-4ff3-96cb-fa9e631d9eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:38.282842 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-ccc6995f-ef9f-4ff3-96cb-fa9e631d9eff None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:38.284544 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-ccc6995f-ef9f-4ff3-96cb-fa9e631d9eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:38.326630 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d752f-bfdb-44af-88cc-49bbeef1cd6f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:38.342043 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969f793-cefb-4eaf-8cf3-1707050ba36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:38.344297 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969f793-cefb-4eaf-8cf3-1707050ba36c admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:38.344661 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969f793-cefb-4eaf-8cf3-1707050ba36c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:38.345018 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969f793-cefb-4eaf-8cf3-1707050ba36c admin admin] PATH_INFO: `/v3/projects/ed880b2883b24f85878625acbcd9fb58/users/1267fb96f82247b7b908918d1edd40e9/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:38.346965 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969f793-cefb-4eaf-8cf3-1707050ba36c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed880b2883b24f85878625acbcd9fb58, user_id=1267fb96f82247b7b908918d1edd40e9, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:38.376965 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969f793-cefb-4eaf-8cf3-1707050ba36c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:38.383279 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 859/1718] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:38.384336 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6995f-ef9f-4ff3-96cb-fa9e631d9eff None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:38.392032 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-ccc6995f-ef9f-4ff3-96cb-fa9e631d9eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:38.399095 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 860/1719] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:38 2021] PUT /identity/v3/projects/ed880b2883b24f85878625acbcd9fb58/users/1267fb96f82247b7b908918d1edd40e9/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:38.400653 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21122f8-59aa-48ac-b1d3-d62bc786be0c None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:38.400942 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21122f8-59aa-48ac-b1d3-d62bc786be0c None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:38.401229 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21122f8-59aa-48ac-b1d3-d62bc786be0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:38.428444 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-e21122f8-59aa-48ac-b1d3-d62bc786be0c None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:38.430561 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-e21122f8-59aa-48ac-b1d3-d62bc786be0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:38.477928 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6995f-ef9f-4ff3-96cb-fa9e631d9eff None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:38.509802 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 861/1720] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:38.511170 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281e37c-e4b7-4f2b-8714-62feba46a7e6 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:38.511677 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281e37c-e4b7-4f2b-8714-62feba46a7e6 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:38.512004 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281e37c-e4b7-4f2b-8714-62feba46a7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:38.546695 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30266e83-7d6f-49f7-8b27-8190098efd1e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1976a528ee24585bcaccc83e308fec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:38.547809 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30266e83-7d6f-49f7-8b27-8190098efd1e service glance] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:38.548102 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30266e83-7d6f-49f7-8b27-8190098efd1e service glance] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:38.548383 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30266e83-7d6f-49f7-8b27-8190098efd1e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:38.554480 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-9281e37c-e4b7-4f2b-8714-62feba46a7e6 None None] MFA Rules not processed for user `1267fb96f82247b7b908918d1edd40e9`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:38.556148 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-9281e37c-e4b7-4f2b-8714-62feba46a7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:38.627527 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30266e83-7d6f-49f7-8b27-8190098efd1e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:38.655738 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30266e83-7d6f-49f7-8b27-8190098efd1e service glance] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:38.677107 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 860/1721] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:38 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:38.678119 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30266e83-7d6f-49f7-8b27-8190098efd1e service glance] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:38.704678 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 862/1722] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:38 2021] POST /identity/v3/auth/tokens => generated 3777 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:38.711544 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30266e83-7d6f-49f7-8b27-8190098efd1e service glance] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:38.712488 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281e37c-e4b7-4f2b-8714-62feba46a7e6 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:38.713846 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-9281e37c-e4b7-4f2b-8714-62feba46a7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:38.724829 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66433a-074b-4eec-aca3-1ba3fdadd2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:38.725498 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66433a-074b-4eec-aca3-1ba3fdadd2ab admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:38.725808 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66433a-074b-4eec-aca3-1ba3fdadd2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:38.726088 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66433a-074b-4eec-aca3-1ba3fdadd2ab admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:38.726863 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66433a-074b-4eec-aca3-1ba3fdadd2ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:52:38.727167 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66433a-074b-4eec-aca3-1ba3fdadd2ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:38.758737 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66433a-074b-4eec-aca3-1ba3fdadd2ab admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:38.789013 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 861/1723] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:52:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:52:38.790329 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66433a-074b-4eec-aca3-1ba3fdadd2ab admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:38.807584 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66433a-074b-4eec-aca3-1ba3fdadd2ab admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:38.813542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c37c07-b7ba-467c-abf4-85e1965c1704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:38.814255 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c37c07-b7ba-467c-abf4-85e1965c1704 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:38.814626 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c37c07-b7ba-467c-abf4-85e1965c1704 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:38.815089 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c37c07-b7ba-467c-abf4-85e1965c1704 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:38.816205 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c37c07-b7ba-467c-abf4-85e1965c1704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:38.823440 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281e37c-e4b7-4f2b-8714-62feba46a7e6 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:38.832515 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275de74-7bf7-4a17-9e45-9f317bf0d7c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:38.833170 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275de74-7bf7-4a17-9e45-9f317bf0d7c6 service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:38.833464 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275de74-7bf7-4a17-9e45-9f317bf0d7c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:38.833744 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275de74-7bf7-4a17-9e45-9f317bf0d7c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:38.855612 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275de74-7bf7-4a17-9e45-9f317bf0d7c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:38.866393 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c37c07-b7ba-467c-abf4-85e1965c1704 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:38.952332 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 862/1724] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:38 2021] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:38.954284 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c37c07-b7ba-467c-abf4-85e1965c1704 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:38.957505 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275de74-7bf7-4a17-9e45-9f317bf0d7c6 service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:38.973716 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 863/1725] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:38 2021] GET /identity/v3/auth/tokens => generated 3777 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:52:39.045127 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c37c07-b7ba-467c-abf4-85e1965c1704 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:39.050339 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf332f8-e2aa-41e3-b869-9ca4a6491493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:39.050988 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf332f8-e2aa-41e3-b869-9ca4a6491493 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:39.051281 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf332f8-e2aa-41e3-b869-9ca4a6491493 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:39.051743 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf332f8-e2aa-41e3-b869-9ca4a6491493 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:39.052574 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf332f8-e2aa-41e3-b869-9ca4a6491493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:39.085847 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf332f8-e2aa-41e3-b869-9ca4a6491493 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:39.111465 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 863/1726] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:38 2021] POST /identity/v3/users => generated 294 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:39.116123 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275de74-7bf7-4a17-9e45-9f317bf0d7c6 service cinder] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:39.132418 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275de74-7bf7-4a17-9e45-9f317bf0d7c6 service cinder] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:39.143973 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da682b-ca53-48a3-bc6c-220d6b25ee5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:39.144603 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da682b-ca53-48a3-bc6c-220d6b25ee5c admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:39.144896 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da682b-ca53-48a3-bc6c-220d6b25ee5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:39.146326 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da682b-ca53-48a3-bc6c-220d6b25ee5c admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:39.149533 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da682b-ca53-48a3-bc6c-220d6b25ee5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:39.195607 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da682b-ca53-48a3-bc6c-220d6b25ee5c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:39.228855 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 864/1727] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:39 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:39.230329 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf332f8-e2aa-41e3-b869-9ca4a6491493 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:39.248315 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf332f8-e2aa-41e3-b869-9ca4a6491493 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:39.260087 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1437f8-1c5c-435f-87e2-1aac1dbb0484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:39.262390 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1437f8-1c5c-435f-87e2-1aac1dbb0484 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:39.262739 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1437f8-1c5c-435f-87e2-1aac1dbb0484 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:39.263908 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1437f8-1c5c-435f-87e2-1aac1dbb0484 admin admin] PATH_INFO: `/v3/projects/d0f23e70d935473c8257f7a53a414ef9/users/dfc606c76c884a45864b96b55f06e305/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:39.331608 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da682b-ca53-48a3-bc6c-220d6b25ee5c admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:39.487772 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da682b-ca53-48a3-bc6c-220d6b25ee5c admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:39.496212 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea3929-a34f-4c5d-b43b-0677c702043e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:39.496822 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea3929-a34f-4c5d-b43b-0677c702043e service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:39.497115 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea3929-a34f-4c5d-b43b-0677c702043e service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:39.497533 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea3929-a34f-4c5d-b43b-0677c702043e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:39.502391 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-3fea3929-a34f-4c5d-b43b-0677c702043e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:39.517870 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1437f8-1c5c-435f-87e2-1aac1dbb0484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0f23e70d935473c8257f7a53a414ef9, user_id=dfc606c76c884a45864b96b55f06e305, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:39.553763 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1437f8-1c5c-435f-87e2-1aac1dbb0484 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:39.575468 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 864/1728] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:39 2021] PUT /identity/v3/projects/d0f23e70d935473c8257f7a53a414ef9/users/dfc606c76c884a45864b96b55f06e305/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:39.577174 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1437f8-1c5c-435f-87e2-1aac1dbb0484 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:39.580032 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-dc1437f8-1c5c-435f-87e2-1aac1dbb0484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:39.667898 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea3929-a34f-4c5d-b43b-0677c702043e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:39.697326 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1437f8-1c5c-435f-87e2-1aac1dbb0484 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:39.702038 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a7179-7e20-4e1c-9f1f-b6c0acbe0dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:39.702926 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a7179-7e20-4e1c-9f1f-b6c0acbe0dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:39.703279 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a7179-7e20-4e1c-9f1f-b6c0acbe0dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:39.703584 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a7179-7e20-4e1c-9f1f-b6c0acbe0dd2 admin admin] PATH_INFO: `/v3/projects/1fea4c5a70434ff7905f5d0f9e3a58bb` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:39.706619 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a7179-7e20-4e1c-9f1f-b6c0acbe0dd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fea4c5a70434ff7905f5d0f9e3a58bb)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:39.726535 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea3929-a34f-4c5d-b43b-0677c702043e service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:39.743881 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 865/1729] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:39 2021] GET /identity/v3/auth/tokens => generated 3714 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:39.746604 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a47d8-e625-4a7b-af03-926651da5e43 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:39.746928 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a47d8-e625-4a7b-af03-926651da5e43 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:39.747218 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a47d8-e625-4a7b-af03-926651da5e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:39.754897 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a7179-7e20-4e1c-9f1f-b6c0acbe0dd2 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:39.801020 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-190a47d8-e625-4a7b-af03-926651da5e43 None None] MFA Rules not processed for user `dfc606c76c884a45864b96b55f06e305`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:39.803173 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-190a47d8-e625-4a7b-af03-926651da5e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:39.842870 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-308a7179-7e20-4e1c-9f1f-b6c0acbe0dd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fea4c5a70434ff7905f5d0f9e3a58bb', 'request_id': 'req-308a7179-7e20-4e1c-9f1f-b6c0acbe0dd2'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:39.853798 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-308a7179-7e20-4e1c-9f1f-b6c0acbe0dd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fea4c5a70434ff7905f5d0f9e3a58bb', 'request_id': 'req-308a7179-7e20-4e1c-9f1f-b6c0acbe0dd2'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:39.862542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-308a7179-7e20-4e1c-9f1f-b6c0acbe0dd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fea4c5a70434ff7905f5d0f9e3a58bb', 'request_id': 'req-308a7179-7e20-4e1c-9f1f-b6c0acbe0dd2'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:39.904857 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-308a7179-7e20-4e1c-9f1f-b6c0acbe0dd2 admin admin] The token cache is being invalidate because project 1fea4c5a70434ff7905f5d0f9e3a58bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:52:39.905145 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-308a7179-7e20-4e1c-9f1f-b6c0acbe0dd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:39.909133 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-308a7179-7e20-4e1c-9f1f-b6c0acbe0dd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:39.912137 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 865/1730] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:52:39 2021] DELETE /identity/v3/projects/1fea4c5a70434ff7905f5d0f9e3a58bb => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:39.917850 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ba45f-235a-4326-8854-94e982570a07 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:39.919115 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ba45f-235a-4326-8854-94e982570a07 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:39.919115 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ba45f-235a-4326-8854-94e982570a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:39.979616 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-8b6ba45f-235a-4326-8854-94e982570a07 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:39.980800 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-8b6ba45f-235a-4326-8854-94e982570a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:40.042474 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 866/1731] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:39 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:40.043549 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a47d8-e625-4a7b-af03-926651da5e43 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:40.045036 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-190a47d8-e625-4a7b-af03-926651da5e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:40.068095 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a47d8-e625-4a7b-af03-926651da5e43 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:40.155130 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 866/1732] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:40.164142 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7cb4f-9d10-42e6-9383-729c05dae3c5 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:40.164488 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7cb4f-9d10-42e6-9383-729c05dae3c5 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:40.164782 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7cb4f-9d10-42e6-9383-729c05dae3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:40.220868 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3802d-1efa-43d7-ac3c-c5c7250add81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:40.221479 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3802d-1efa-43d7-ac3c-c5c7250add81 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:40.221771 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3802d-1efa-43d7-ac3c-c5c7250add81 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:40.222056 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3802d-1efa-43d7-ac3c-c5c7250add81 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:40.222727 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3802d-1efa-43d7-ac3c-c5c7250add81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:40.233859 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-53a7cb4f-9d10-42e6-9383-729c05dae3c5 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:40.235381 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-53a7cb4f-9d10-42e6-9383-729c05dae3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:40.255493 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 867/1733] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:52:40.259931 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7cb4f-9d10-42e6-9383-729c05dae3c5 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:40.268035 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3802d-1efa-43d7-ac3c-c5c7250add81 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:40.278414 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7cb4f-9d10-42e6-9383-729c05dae3c5 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:40.288527 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdef0f6-7b4c-489d-91dd-e6dc1870388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:40.289053 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdef0f6-7b4c-489d-91dd-e6dc1870388a admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:40.289371 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdef0f6-7b4c-489d-91dd-e6dc1870388a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:40.289654 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdef0f6-7b4c-489d-91dd-e6dc1870388a admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:40.290512 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdef0f6-7b4c-489d-91dd-e6dc1870388a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:52:40.290819 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdef0f6-7b4c-489d-91dd-e6dc1870388a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:40.331053 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdef0f6-7b4c-489d-91dd-e6dc1870388a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:40.339242 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 867/1734] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:40 2021] POST /identity/v3/projects => generated 387 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:40.343253 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3802d-1efa-43d7-ac3c-c5c7250add81 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:40.350717 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 868/1735] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:52:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:52:40.353727 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdef0f6-7b4c-489d-91dd-e6dc1870388a admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:40.369199 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdef0f6-7b4c-489d-91dd-e6dc1870388a admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:40.504419 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61618ae4-3d86-4510-a6a5-2935bf2362b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:40.505133 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61618ae4-3d86-4510-a6a5-2935bf2362b1 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:40.505316 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61618ae4-3d86-4510-a6a5-2935bf2362b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:40.505597 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61618ae4-3d86-4510-a6a5-2935bf2362b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:40.506545 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61618ae4-3d86-4510-a6a5-2935bf2362b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:40.516681 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3802d-1efa-43d7-ac3c-c5c7250add81 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:40.529323 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5806845-e3cd-4ded-92f7-9bfc0afc7f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:40.530334 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5806845-e3cd-4ded-92f7-9bfc0afc7f2b admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:40.531638 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5806845-e3cd-4ded-92f7-9bfc0afc7f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:40.533012 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5806845-e3cd-4ded-92f7-9bfc0afc7f2b admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:40.534024 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5806845-e3cd-4ded-92f7-9bfc0afc7f2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:40.569860 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61618ae4-3d86-4510-a6a5-2935bf2362b1 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:40.587629 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5806845-e3cd-4ded-92f7-9bfc0afc7f2b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:40.623305 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 868/1736] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:40 2021] POST /identity/v3/users => generated 300 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:52:40.624286 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5806845-e3cd-4ded-92f7-9bfc0afc7f2b admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:40.624640 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 869/1737] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:40 2021] POST /identity/v3/projects => generated 369 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:40.632218 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61618ae4-3d86-4510-a6a5-2935bf2362b1 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:40.644582 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5806845-e3cd-4ded-92f7-9bfc0afc7f2b admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:40.728824 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61618ae4-3d86-4510-a6a5-2935bf2362b1 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:40.733971 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ed670-0ab0-4c86-93e1-d4202356700e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:40.735671 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ed670-0ab0-4c86-93e1-d4202356700e admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:40.736030 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ed670-0ab0-4c86-93e1-d4202356700e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:40.736374 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ed670-0ab0-4c86-93e1-d4202356700e admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:40.737084 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99ed670-0ab0-4c86-93e1-d4202356700e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:40.769718 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99ed670-0ab0-4c86-93e1-d4202356700e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:40.811784 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a51e0e-b5fd-4456-920d-5414e76a7e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:40.813146 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a51e0e-b5fd-4456-920d-5414e76a7e6d admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:40.813400 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a51e0e-b5fd-4456-920d-5414e76a7e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:40.813753 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a51e0e-b5fd-4456-920d-5414e76a7e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:40.814488 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a51e0e-b5fd-4456-920d-5414e76a7e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:40.822698 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 870/1738] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:40 2021] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:40.824092 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ed670-0ab0-4c86-93e1-d4202356700e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:40.838617 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ed670-0ab0-4c86-93e1-d4202356700e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:40.848212 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a51e0e-b5fd-4456-920d-5414e76a7e6d admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:40.858339 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45acf29-4251-4331-8ddb-0fcf18b1991b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:40.859009 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45acf29-4251-4331-8ddb-0fcf18b1991b admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:40.859327 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45acf29-4251-4331-8ddb-0fcf18b1991b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:40.859613 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45acf29-4251-4331-8ddb-0fcf18b1991b admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:40.860320 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45acf29-4251-4331-8ddb-0fcf18b1991b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:40.876383 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 869/1739] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:40 2021] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:40.877344 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a51e0e-b5fd-4456-920d-5414e76a7e6d admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:40.891353 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45acf29-4251-4331-8ddb-0fcf18b1991b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:40.892581 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a51e0e-b5fd-4456-920d-5414e76a7e6d admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:40.898014 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8795b20-a33f-4b93-b71a-9f631ba873c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:40.898899 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8795b20-a33f-4b93-b71a-9f631ba873c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:40.899191 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8795b20-a33f-4b93-b71a-9f631ba873c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:40.899554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8795b20-a33f-4b93-b71a-9f631ba873c8 admin admin] PATH_INFO: `/v3/projects/1614e0e8ba134027914e8455afb08fb0/users/c4735454c2ae4b968847cede2c1797a4/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:40.907370 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 871/1740] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:40 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:40.909043 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45acf29-4251-4331-8ddb-0fcf18b1991b admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:40.919220 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45acf29-4251-4331-8ddb-0fcf18b1991b admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:40.924222 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8e291-e768-4eb1-8eda-218c5fd5520b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:40.925064 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8e291-e768-4eb1-8eda-218c5fd5520b admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:40.925347 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8e291-e768-4eb1-8eda-218c5fd5520b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:40.925626 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8e291-e768-4eb1-8eda-218c5fd5520b admin admin] PATH_INFO: `/v3/projects/9a42019590fa49ef8ab50f654bd5b041/users/6ce279a16ef14d178eb58995078ec475/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:40.946967 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8e291-e768-4eb1-8eda-218c5fd5520b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a42019590fa49ef8ab50f654bd5b041, user_id=6ce279a16ef14d178eb58995078ec475, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:40.975704 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8795b20-a33f-4b93-b71a-9f631ba873c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1614e0e8ba134027914e8455afb08fb0, user_id=c4735454c2ae4b968847cede2c1797a4, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:40.981663 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8e291-e768-4eb1-8eda-218c5fd5520b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:41.014106 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 872/1741] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:40 2021] PUT /identity/v3/projects/9a42019590fa49ef8ab50f654bd5b041/users/6ce279a16ef14d178eb58995078ec475/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:41.016527 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f071e0-f1aa-49aa-9719-003c5b533d4e None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:41.016828 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f071e0-f1aa-49aa-9719-003c5b533d4e None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:41.017110 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f071e0-f1aa-49aa-9719-003c5b533d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:41.025811 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8795b20-a33f-4b93-b71a-9f631ba873c8 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:41.049306 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 870/1742] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:40 2021] PUT /identity/v3/projects/1614e0e8ba134027914e8455afb08fb0/users/c4735454c2ae4b968847cede2c1797a4/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:41.051219 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8795b20-a33f-4b93-b71a-9f631ba873c8 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:41.064069 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-e1f071e0-f1aa-49aa-9719-003c5b533d4e None None] MFA Rules not processed for user `6ce279a16ef14d178eb58995078ec475`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:41.065254 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-e1f071e0-f1aa-49aa-9719-003c5b533d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:41.153395 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 873/1743] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:41 2021] POST /identity/v3/auth/tokens => generated 3676 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:41.158430 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f071e0-f1aa-49aa-9719-003c5b533d4e None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:41.161404 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8795b20-a33f-4b93-b71a-9f631ba873c8 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:41.166810 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdccc669-ccc5-43f2-9de8-65cc15239374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:41.167471 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccc669-ccc5-43f2-9de8-65cc15239374 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:41.167911 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccc669-ccc5-43f2-9de8-65cc15239374 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:41.168215 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccc669-ccc5-43f2-9de8-65cc15239374 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:41.169044 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdccc669-ccc5-43f2-9de8-65cc15239374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:41.171043 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f071e0-f1aa-49aa-9719-003c5b533d4e None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:41.176618 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b02276-f297-4e00-8190-e272eb6c8da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:41.177589 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b02276-f297-4e00-8190-e272eb6c8da8 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:41.178077 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b02276-f297-4e00-8190-e272eb6c8da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:41.178540 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b02276-f297-4e00-8190-e272eb6c8da8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:41.179401 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b02276-f297-4e00-8190-e272eb6c8da8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:41.201211 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdccc669-ccc5-43f2-9de8-65cc15239374 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:41.211615 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b02276-f297-4e00-8190-e272eb6c8da8 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:41.222574 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 871/1744] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:41 2021] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:41.223958 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdccc669-ccc5-43f2-9de8-65cc15239374 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:41.236418 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdccc669-ccc5-43f2-9de8-65cc15239374 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:41.241257 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab8231-4989-44b0-abdb-263ecc80b466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:41.242362 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab8231-4989-44b0-abdb-263ecc80b466 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:41.242675 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab8231-4989-44b0-abdb-263ecc80b466 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:41.243418 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab8231-4989-44b0-abdb-263ecc80b466 admin admin] PATH_INFO: `/v3/projects/1614e0e8ba134027914e8455afb08fb0/users/c4735454c2ae4b968847cede2c1797a4/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:41.244752 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab8231-4989-44b0-abdb-263ecc80b466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1614e0e8ba134027914e8455afb08fb0, user_id=c4735454c2ae4b968847cede2c1797a4, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:41.249215 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 874/1745] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:41 2021] POST /identity/v3/projects => generated 369 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:52:41.254727 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b02276-f297-4e00-8190-e272eb6c8da8 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:41.274954 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab8231-4989-44b0-abdb-263ecc80b466 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:41.288228 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 872/1746] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:41 2021] PUT /identity/v3/projects/1614e0e8ba134027914e8455afb08fb0/users/c4735454c2ae4b968847cede2c1797a4/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:41.292010 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab8231-4989-44b0-abdb-263ecc80b466 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:41.346199 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b02276-f297-4e00-8190-e272eb6c8da8 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:41.379412 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab8231-4989-44b0-abdb-263ecc80b466 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:41.384372 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea3a33-d7cd-487a-8bfd-8fcd47a9d600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:41.385168 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea3a33-d7cd-487a-8bfd-8fcd47a9d600 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:41.385464 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea3a33-d7cd-487a-8bfd-8fcd47a9d600 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:41.386062 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea3a33-d7cd-487a-8bfd-8fcd47a9d600 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:41.386605 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea3a33-d7cd-487a-8bfd-8fcd47a9d600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:41.413296 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea3a33-d7cd-487a-8bfd-8fcd47a9d600 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:41.424919 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9cf7c-8dae-44c9-b641-5e5b11fc568c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:41.425387 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9cf7c-8dae-44c9-b641-5e5b11fc568c admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:41.425680 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9cf7c-8dae-44c9-b641-5e5b11fc568c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:41.426178 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 873/1747] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:41 2021] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:52:41.426807 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9cf7c-8dae-44c9-b641-5e5b11fc568c admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:41.427547 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9cf7c-8dae-44c9-b641-5e5b11fc568c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:41.429895 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea3a33-d7cd-487a-8bfd-8fcd47a9d600 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:41.447676 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea3a33-d7cd-487a-8bfd-8fcd47a9d600 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:41.454608 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9cf7c-8dae-44c9-b641-5e5b11fc568c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:41.457637 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089b64e-b3ce-4f4f-8798-cfb02e3c4837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:41.458535 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089b64e-b3ce-4f4f-8798-cfb02e3c4837 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:41.458856 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089b64e-b3ce-4f4f-8798-cfb02e3c4837 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:41.459139 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089b64e-b3ce-4f4f-8798-cfb02e3c4837 admin admin] PATH_INFO: `/v3/projects/1614e0e8ba134027914e8455afb08fb0/users/c4735454c2ae4b968847cede2c1797a4/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:41.460972 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089b64e-b3ce-4f4f-8798-cfb02e3c4837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1614e0e8ba134027914e8455afb08fb0, user_id=c4735454c2ae4b968847cede2c1797a4, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:41.480876 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 875/1748] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:41 2021] POST /identity/v3/users => generated 291 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:41.482278 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9cf7c-8dae-44c9-b641-5e5b11fc568c admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:41.490017 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089b64e-b3ce-4f4f-8798-cfb02e3c4837 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:41.497926 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9cf7c-8dae-44c9-b641-5e5b11fc568c admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:41.507086 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 874/1749] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:41 2021] PUT /identity/v3/projects/1614e0e8ba134027914e8455afb08fb0/users/c4735454c2ae4b968847cede2c1797a4/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:52:41.516235 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bb4dc-4837-4f55-98fe-67bc3eb7f9d1 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:41.516670 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bb4dc-4837-4f55-98fe-67bc3eb7f9d1 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:41.516992 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bb4dc-4837-4f55-98fe-67bc3eb7f9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:41.564570 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-958bb4dc-4837-4f55-98fe-67bc3eb7f9d1 None None] MFA Rules not processed for user `c4735454c2ae4b968847cede2c1797a4`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:41.566289 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-958bb4dc-4837-4f55-98fe-67bc3eb7f9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:41.598768 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2f705-9a0f-4ab2-a5ed-338f3c2256cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:41.599802 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2f705-9a0f-4ab2-a5ed-338f3c2256cb admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:41.599802 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2f705-9a0f-4ab2-a5ed-338f3c2256cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:41.600337 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2f705-9a0f-4ab2-a5ed-338f3c2256cb admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:41.601173 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2f705-9a0f-4ab2-a5ed-338f3c2256cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:41.639953 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2f705-9a0f-4ab2-a5ed-338f3c2256cb admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:41.651077 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 876/1750] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:41 2021] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:41.655565 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2f705-9a0f-4ab2-a5ed-338f3c2256cb admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:41.669173 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2f705-9a0f-4ab2-a5ed-338f3c2256cb admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:41.675236 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97fb3e-5146-476e-89d7-510ec64e9d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:41.676192 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97fb3e-5146-476e-89d7-510ec64e9d1c admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:41.676585 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97fb3e-5146-476e-89d7-510ec64e9d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:41.677013 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97fb3e-5146-476e-89d7-510ec64e9d1c admin admin] PATH_INFO: `/v3/projects/2e70711020f84d8d8304273faab6dc9f/users/e24cff97044a4782bf705fb5fb85900c/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:41.695924 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 875/1751] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:41 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:41.707901 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bb4dc-4837-4f55-98fe-67bc3eb7f9d1 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:41.708457 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97fb3e-5146-476e-89d7-510ec64e9d1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e70711020f84d8d8304273faab6dc9f, user_id=e24cff97044a4782bf705fb5fb85900c, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:41.711118 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-958bb4dc-4837-4f55-98fe-67bc3eb7f9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:41.762532 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97fb3e-5146-476e-89d7-510ec64e9d1c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:41.783550 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 877/1752] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:41 2021] PUT /identity/v3/projects/2e70711020f84d8d8304273faab6dc9f/users/e24cff97044a4782bf705fb5fb85900c/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:41.784503 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97fb3e-5146-476e-89d7-510ec64e9d1c admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:41.815828 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bb4dc-4837-4f55-98fe-67bc3eb7f9d1 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:41.891983 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97fb3e-5146-476e-89d7-510ec64e9d1c admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:41.897460 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe45d4-6734-4200-9b89-c12c0f8c9712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:41.898079 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe45d4-6734-4200-9b89-c12c0f8c9712 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:41.898644 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe45d4-6734-4200-9b89-c12c0f8c9712 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:41.898978 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe45d4-6734-4200-9b89-c12c0f8c9712 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:41.899689 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe45d4-6734-4200-9b89-c12c0f8c9712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:41.928170 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe45d4-6734-4200-9b89-c12c0f8c9712 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:41.943227 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 878/1753] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:41 2021] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:41.948824 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe45d4-6734-4200-9b89-c12c0f8c9712 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:41.964497 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe45d4-6734-4200-9b89-c12c0f8c9712 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:41.965636 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce859d85-669b-4aff-a015-216ec3fe2996 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:41.966924 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce859d85-669b-4aff-a015-216ec3fe2996 service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:41.966924 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce859d85-669b-4aff-a015-216ec3fe2996 service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:41.967100 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce859d85-669b-4aff-a015-216ec3fe2996 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:41.978722 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41d099-583c-45c3-91c5-e1d0f70a4fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:41.979605 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41d099-583c-45c3-91c5-e1d0f70a4fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:41.979886 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41d099-583c-45c3-91c5-e1d0f70a4fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:41.980576 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41d099-583c-45c3-91c5-e1d0f70a4fcd admin admin] PATH_INFO: `/v3/projects/2e70711020f84d8d8304273faab6dc9f/users/e24cff97044a4782bf705fb5fb85900c/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:41.984313 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41d099-583c-45c3-91c5-e1d0f70a4fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e70711020f84d8d8304273faab6dc9f, user_id=e24cff97044a4782bf705fb5fb85900c, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:42.048721 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41d099-583c-45c3-91c5-e1d0f70a4fcd admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:42.063349 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 879/1754] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:41 2021] PUT /identity/v3/projects/2e70711020f84d8d8304273faab6dc9f/users/e24cff97044a4782bf705fb5fb85900c/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:42.069082 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41d099-583c-45c3-91c5-e1d0f70a4fcd admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:42.079060 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce859d85-669b-4aff-a015-216ec3fe2996 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:42.121523 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce859d85-669b-4aff-a015-216ec3fe2996 service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:42.139773 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 876/1755] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:41 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:52:42.166877 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41d099-583c-45c3-91c5-e1d0f70a4fcd admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:42.173942 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0871624-61b6-45df-b954-e0f0acc00ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:42.174583 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0871624-61b6-45df-b954-e0f0acc00ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:42.174923 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0871624-61b6-45df-b954-e0f0acc00ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:42.175209 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0871624-61b6-45df-b954-e0f0acc00ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:42.175927 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0871624-61b6-45df-b954-e0f0acc00ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:42.228662 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0871624-61b6-45df-b954-e0f0acc00ba9 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:42.239796 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 880/1756] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:42 2021] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:42.244543 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce859d85-669b-4aff-a015-216ec3fe2996 service cinder] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:42.255579 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce859d85-669b-4aff-a015-216ec3fe2996 service cinder] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:42.259971 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb65c49-459b-4fae-a48c-5e9d11f7c79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:42.260951 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb65c49-459b-4fae-a48c-5e9d11f7c79c admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:42.261247 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb65c49-459b-4fae-a48c-5e9d11f7c79c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:42.261533 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb65c49-459b-4fae-a48c-5e9d11f7c79c admin admin] PATH_INFO: `/v3/projects/2e70711020f84d8d8304273faab6dc9f/users/e24cff97044a4782bf705fb5fb85900c/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:42.263372 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb65c49-459b-4fae-a48c-5e9d11f7c79c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e70711020f84d8d8304273faab6dc9f, user_id=e24cff97044a4782bf705fb5fb85900c, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:42.292898 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb65c49-459b-4fae-a48c-5e9d11f7c79c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:42.329707 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 877/1757] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:42 2021] PUT /identity/v3/projects/2e70711020f84d8d8304273faab6dc9f/users/e24cff97044a4782bf705fb5fb85900c/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:42.331514 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e182c-6051-4a19-a499-3022f50918d6 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:42.331983 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e182c-6051-4a19-a499-3022f50918d6 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:42.332069 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e182c-6051-4a19-a499-3022f50918d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:42.345902 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb65c49-459b-4fae-a48c-5e9d11f7c79c admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:42.438995 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-e92e182c-6051-4a19-a499-3022f50918d6 None None] MFA Rules not processed for user `e24cff97044a4782bf705fb5fb85900c`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:42.440365 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-e92e182c-6051-4a19-a499-3022f50918d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:42.470483 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb65c49-459b-4fae-a48c-5e9d11f7c79c admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:42.475906 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57905807-ae53-4146-ab89-5460be031a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:42.476722 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57905807-ae53-4146-ab89-5460be031a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:42.476996 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57905807-ae53-4146-ab89-5460be031a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:42.477377 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57905807-ae53-4146-ab89-5460be031a50 admin admin] PATH_INFO: `/v3/users/dfc606c76c884a45864b96b55f06e305` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:42.478393 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57905807-ae53-4146-ab89-5460be031a50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfc606c76c884a45864b96b55f06e305)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:42.505233 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57905807-ae53-4146-ab89-5460be031a50 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:42.572233 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 881/1758] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:42 2021] POST /identity/v3/auth/tokens => generated 3743 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:42.583986 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e182c-6051-4a19-a499-3022f50918d6 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:42.592901 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-57905807-ae53-4146-ab89-5460be031a50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfc606c76c884a45864b96b55f06e305'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:42.618682 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-57905807-ae53-4146-ab89-5460be031a50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfc606c76c884a45864b96b55f06e305'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:42.629264 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-57905807-ae53-4146-ab89-5460be031a50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfc606c76c884a45864b96b55f06e305'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:42.647776 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-57905807-ae53-4146-ab89-5460be031a50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfc606c76c884a45864b96b55f06e305'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:42.659812 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-57905807-ae53-4146-ab89-5460be031a50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfc606c76c884a45864b96b55f06e305'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:42.668097 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 878/1759] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:52:42 2021] DELETE /identity/v3/users/dfc606c76c884a45864b96b55f06e305 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:42.672115 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a27930-e597-44f8-9bff-579ab2f47808 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:42.672115 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a27930-e597-44f8-9bff-579ab2f47808 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:42.672724 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a27930-e597-44f8-9bff-579ab2f47808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:42.708974 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e182c-6051-4a19-a499-3022f50918d6 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:42.709228 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-c2a27930-e597-44f8-9bff-579ab2f47808 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:42.710408 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c2a27930-e597-44f8-9bff-579ab2f47808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:42.789773 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 879/1760] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:42.802227 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a27930-e597-44f8-9bff-579ab2f47808 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:42.803702 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c2a27930-e597-44f8-9bff-579ab2f47808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:42.809151 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a811d-7340-4919-bb61-191b66f27e46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:42.810180 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a811d-7340-4919-bb61-191b66f27e46 service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:42.810928 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a811d-7340-4919-bb61-191b66f27e46 service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:42.810928 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a811d-7340-4919-bb61-191b66f27e46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:42.812631 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-8d1a811d-7340-4919-bb61-191b66f27e46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:42.872716 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a27930-e597-44f8-9bff-579ab2f47808 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:42.876861 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c866f-47e0-4885-a7a4-658388fac1bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:42.877874 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c866f-47e0-4885-a7a4-658388fac1bc service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:42.878581 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c866f-47e0-4885-a7a4-658388fac1bc service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:42.879079 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c866f-47e0-4885-a7a4-658388fac1bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:42.888893 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a811d-7340-4919-bb61-191b66f27e46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:42.890259 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c866f-47e0-4885-a7a4-658388fac1bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:42.917527 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a811d-7340-4919-bb61-191b66f27e46 service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:42.928730 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c866f-47e0-4885-a7a4-658388fac1bc service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:42.929379 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 882/1761] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:42 2021] GET /identity/v3/auth/tokens => generated 3743 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:52:42.940065 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 880/1762] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:42 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:52:42.996405 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a811d-7340-4919-bb61-191b66f27e46 service cinder] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:42.997822 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-8d1a811d-7340-4919-bb61-191b66f27e46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:43.009461 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a811d-7340-4919-bb61-191b66f27e46 service cinder] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:43.015189 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4055e92-23cc-4556-8af4-a76fa499d63d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:43.017350 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4055e92-23cc-4556-8af4-a76fa499d63d service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:43.017736 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4055e92-23cc-4556-8af4-a76fa499d63d service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:43.018684 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4055e92-23cc-4556-8af4-a76fa499d63d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:43.021207 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-e4055e92-23cc-4556-8af4-a76fa499d63d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:43.128200 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4055e92-23cc-4556-8af4-a76fa499d63d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:43.159406 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4055e92-23cc-4556-8af4-a76fa499d63d service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:43.170729 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 883/1763] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:42 2021] GET /identity/v3/auth/tokens => generated 3676 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:43.468840 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c866f-47e0-4885-a7a4-658388fac1bc service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:43.471614 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-cd4c866f-47e0-4885-a7a4-658388fac1bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:43.490454 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c866f-47e0-4885-a7a4-658388fac1bc service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:43.503746 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6b110-2ba1-40ea-898e-29afef34fcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:43.504986 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6b110-2ba1-40ea-898e-29afef34fcec admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:43.505282 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6b110-2ba1-40ea-898e-29afef34fcec admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:43.505666 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6b110-2ba1-40ea-898e-29afef34fcec admin admin] PATH_INFO: `/v3/projects/d0f23e70d935473c8257f7a53a414ef9` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:43.510459 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6b110-2ba1-40ea-898e-29afef34fcec admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0f23e70d935473c8257f7a53a414ef9)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:43.564122 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6b110-2ba1-40ea-898e-29afef34fcec admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:43.682974 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-0cf6b110-2ba1-40ea-898e-29afef34fcec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0f23e70d935473c8257f7a53a414ef9', 'request_id': 'req-0cf6b110-2ba1-40ea-898e-29afef34fcec'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:43.707991 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-0cf6b110-2ba1-40ea-898e-29afef34fcec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0f23e70d935473c8257f7a53a414ef9', 'request_id': 'req-0cf6b110-2ba1-40ea-898e-29afef34fcec'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:43.726636 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-0cf6b110-2ba1-40ea-898e-29afef34fcec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0f23e70d935473c8257f7a53a414ef9', 'request_id': 'req-0cf6b110-2ba1-40ea-898e-29afef34fcec'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:43.747569 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-0cf6b110-2ba1-40ea-898e-29afef34fcec admin admin] The token cache is being invalidate because project d0f23e70d935473c8257f7a53a414ef9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:52:43.748202 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-0cf6b110-2ba1-40ea-898e-29afef34fcec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:43.749413 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-0cf6b110-2ba1-40ea-898e-29afef34fcec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:43.755241 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 881/1764] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:52:43 2021] DELETE /identity/v3/projects/d0f23e70d935473c8257f7a53a414ef9 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:43.756264 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4055e92-23cc-4556-8af4-a76fa499d63d service cinder] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:43.773099 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4055e92-23cc-4556-8af4-a76fa499d63d service cinder] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:43.877179 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676912b2-5450-4bca-b9a1-b3b5b3308db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:43.877986 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676912b2-5450-4bca-b9a1-b3b5b3308db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:43.878330 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676912b2-5450-4bca-b9a1-b3b5b3308db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:43.878621 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676912b2-5450-4bca-b9a1-b3b5b3308db9 admin admin] PATH_INFO: `/v3/users/c4735454c2ae4b968847cede2c1797a4` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:43.880403 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676912b2-5450-4bca-b9a1-b3b5b3308db9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4735454c2ae4b968847cede2c1797a4)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:43.917124 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676912b2-5450-4bca-b9a1-b3b5b3308db9 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:43.982556 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-676912b2-5450-4bca-b9a1-b3b5b3308db9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4735454c2ae4b968847cede2c1797a4'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:43.983311 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-676912b2-5450-4bca-b9a1-b3b5b3308db9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4735454c2ae4b968847cede2c1797a4'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:43.992868 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-676912b2-5450-4bca-b9a1-b3b5b3308db9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4735454c2ae4b968847cede2c1797a4'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:44.005478 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-676912b2-5450-4bca-b9a1-b3b5b3308db9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4735454c2ae4b968847cede2c1797a4'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:44.017353 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-676912b2-5450-4bca-b9a1-b3b5b3308db9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4735454c2ae4b968847cede2c1797a4'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:44.023523 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 884/1765] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:52:43 2021] DELETE /identity/v3/users/c4735454c2ae4b968847cede2c1797a4 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:44.454251 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6b110-2ba1-40ea-898e-29afef34fcec admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:44.454251 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-0cf6b110-2ba1-40ea-898e-29afef34fcec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:44.464024 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6b110-2ba1-40ea-898e-29afef34fcec admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:44.529554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00eef0e-a8f7-4b70-a169-a95206fbc93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:44.530314 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eef0e-a8f7-4b70-a169-a95206fbc93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:44.530606 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eef0e-a8f7-4b70-a169-a95206fbc93d admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:44.530971 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eef0e-a8f7-4b70-a169-a95206fbc93d admin admin] PATH_INFO: `/v3/projects/1614e0e8ba134027914e8455afb08fb0` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:44.532106 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00eef0e-a8f7-4b70-a169-a95206fbc93d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1614e0e8ba134027914e8455afb08fb0)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:44.560064 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00eef0e-a8f7-4b70-a169-a95206fbc93d admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:44.617097 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-e00eef0e-a8f7-4b70-a169-a95206fbc93d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1614e0e8ba134027914e8455afb08fb0', 'request_id': 'req-e00eef0e-a8f7-4b70-a169-a95206fbc93d'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:44.624353 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-e00eef0e-a8f7-4b70-a169-a95206fbc93d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1614e0e8ba134027914e8455afb08fb0', 'request_id': 'req-e00eef0e-a8f7-4b70-a169-a95206fbc93d'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:44.636693 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-e00eef0e-a8f7-4b70-a169-a95206fbc93d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1614e0e8ba134027914e8455afb08fb0', 'request_id': 'req-e00eef0e-a8f7-4b70-a169-a95206fbc93d'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:44.646744 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-e00eef0e-a8f7-4b70-a169-a95206fbc93d admin admin] The token cache is being invalidate because project 1614e0e8ba134027914e8455afb08fb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:52:44.647128 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-e00eef0e-a8f7-4b70-a169-a95206fbc93d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:44.647709 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-e00eef0e-a8f7-4b70-a169-a95206fbc93d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:44.649421 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 882/1766] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:52:44 2021] DELETE /identity/v3/projects/1614e0e8ba134027914e8455afb08fb0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:44.655178 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798ab68-abf7-4369-b162-9ad8c87191e8 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:44.655478 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798ab68-abf7-4369-b162-9ad8c87191e8 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:44.655874 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798ab68-abf7-4369-b162-9ad8c87191e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:44.682564 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-c798ab68-abf7-4369-b162-9ad8c87191e8 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:44.683610 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-c798ab68-abf7-4369-b162-9ad8c87191e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:44.791235 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed1bad-fb42-4d1d-9ce8-ed133183248f None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:44.793361 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed1bad-fb42-4d1d-9ce8-ed133183248f None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:44.794776 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed1bad-fb42-4d1d-9ce8-ed133183248f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:44.799002 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 885/1767] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:44.862192 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-5fed1bad-fb42-4d1d-9ce8-ed133183248f None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:44.864100 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-5fed1bad-fb42-4d1d-9ce8-ed133183248f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:44.872087 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 883/1768] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:44.876617 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798ab68-abf7-4369-b162-9ad8c87191e8 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:44.887425 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798ab68-abf7-4369-b162-9ad8c87191e8 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:44.903357 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047d864-9171-4406-986c-a547107e9527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:44.903973 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047d864-9171-4406-986c-a547107e9527 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:44.904269 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047d864-9171-4406-986c-a547107e9527 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:44.904554 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047d864-9171-4406-986c-a547107e9527 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:44.905254 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047d864-9171-4406-986c-a547107e9527 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:52:44.905554 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047d864-9171-4406-986c-a547107e9527 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:44.953688 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047d864-9171-4406-986c-a547107e9527 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:44.970547 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 886/1769] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:52:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:52:44.974903 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed1bad-fb42-4d1d-9ce8-ed133183248f None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:44.986135 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed1bad-fb42-4d1d-9ce8-ed133183248f None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:45.006697 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014a9c2-a2d8-4099-af82-df1eb357b548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:45.008645 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014a9c2-a2d8-4099-af82-df1eb357b548 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:45.008979 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014a9c2-a2d8-4099-af82-df1eb357b548 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:45.009266 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014a9c2-a2d8-4099-af82-df1eb357b548 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:45.012815 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014a9c2-a2d8-4099-af82-df1eb357b548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:45.092444 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014a9c2-a2d8-4099-af82-df1eb357b548 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:45.150825 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 884/1770] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:44 2021] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:45.151622 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047d864-9171-4406-986c-a547107e9527 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:45.169556 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047d864-9171-4406-986c-a547107e9527 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:45.337561 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b4d6c-13c9-4f11-8677-3cb44ea96633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:45.338173 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b4d6c-13c9-4f11-8677-3cb44ea96633 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:45.338466 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b4d6c-13c9-4f11-8677-3cb44ea96633 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:45.338776 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b4d6c-13c9-4f11-8677-3cb44ea96633 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:45.339423 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b4d6c-13c9-4f11-8677-3cb44ea96633 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:45.371548 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b4d6c-13c9-4f11-8677-3cb44ea96633 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:45.388055 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 887/1771] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:45 2021] POST /identity/v3/users => generated 290 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:45.392259 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014a9c2-a2d8-4099-af82-df1eb357b548 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:45.403551 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014a9c2-a2d8-4099-af82-df1eb357b548 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:45.408422 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04d567-61b0-4857-bb2f-f5e7b6da9559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:45.409037 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04d567-61b0-4857-bb2f-f5e7b6da9559 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:45.409330 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04d567-61b0-4857-bb2f-f5e7b6da9559 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:45.409611 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04d567-61b0-4857-bb2f-f5e7b6da9559 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:45.410341 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04d567-61b0-4857-bb2f-f5e7b6da9559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:45.436215 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04d567-61b0-4857-bb2f-f5e7b6da9559 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:45.447518 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 885/1772] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:45 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:45.451744 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b4d6c-13c9-4f11-8677-3cb44ea96633 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:45.462357 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b4d6c-13c9-4f11-8677-3cb44ea96633 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:45.467135 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf536d-bf09-4398-b630-57f71790a68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:45.468029 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf536d-bf09-4398-b630-57f71790a68e admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:45.468570 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf536d-bf09-4398-b630-57f71790a68e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:45.469042 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf536d-bf09-4398-b630-57f71790a68e admin admin] PATH_INFO: `/v3/projects/f28f2dae69df4365810210dad3f2aa09/users/19c30109ae884e03886088d5f34fbb19/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:45.479351 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04d567-61b0-4857-bb2f-f5e7b6da9559 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:45.481053 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-ef04d567-61b0-4857-bb2f-f5e7b6da9559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:45.490970 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf536d-bf09-4398-b630-57f71790a68e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f28f2dae69df4365810210dad3f2aa09, user_id=19c30109ae884e03886088d5f34fbb19, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:45.493720 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04d567-61b0-4857-bb2f-f5e7b6da9559 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:45.498041 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a220c28-4e58-41ab-b7f1-a4c2dca28432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:45.498903 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a220c28-4e58-41ab-b7f1-a4c2dca28432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:45.499197 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a220c28-4e58-41ab-b7f1-a4c2dca28432 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:45.499502 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a220c28-4e58-41ab-b7f1-a4c2dca28432 admin admin] PATH_INFO: `/v3/users/6ce279a16ef14d178eb58995078ec475` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:45.500617 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a220c28-4e58-41ab-b7f1-a4c2dca28432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ce279a16ef14d178eb58995078ec475)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:45.518323 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf536d-bf09-4398-b630-57f71790a68e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:45.526844 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a220c28-4e58-41ab-b7f1-a4c2dca28432 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:45.532690 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 888/1773] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:45 2021] PUT /identity/v3/projects/f28f2dae69df4365810210dad3f2aa09/users/19c30109ae884e03886088d5f34fbb19/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:52:45.544364 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b919032-3f3c-4b8f-a64c-5ad94992c89c None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:45.544938 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b919032-3f3c-4b8f-a64c-5ad94992c89c None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:45.545571 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b919032-3f3c-4b8f-a64c-5ad94992c89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:45.595046 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-7a220c28-4e58-41ab-b7f1-a4c2dca28432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ce279a16ef14d178eb58995078ec475'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:45.614607 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-7a220c28-4e58-41ab-b7f1-a4c2dca28432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ce279a16ef14d178eb58995078ec475'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:45.615997 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-7a220c28-4e58-41ab-b7f1-a4c2dca28432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ce279a16ef14d178eb58995078ec475'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:45.625953 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-0b919032-3f3c-4b8f-a64c-5ad94992c89c None None] MFA Rules not processed for user `19c30109ae884e03886088d5f34fbb19`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:45.627386 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-0b919032-3f3c-4b8f-a64c-5ad94992c89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:45.634706 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-7a220c28-4e58-41ab-b7f1-a4c2dca28432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ce279a16ef14d178eb58995078ec475'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:45.653941 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-7a220c28-4e58-41ab-b7f1-a4c2dca28432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ce279a16ef14d178eb58995078ec475'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:45.670303 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 886/1774] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:52:45 2021] DELETE /identity/v3/users/6ce279a16ef14d178eb58995078ec475 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:52:45.673507 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d7660-d088-4d40-a07f-913c1978de41 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:45.674392 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d7660-d088-4d40-a07f-913c1978de41 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:45.674789 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d7660-d088-4d40-a07f-913c1978de41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:45.725203 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-903d7660-d088-4d40-a07f-913c1978de41 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:45.726424 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-903d7660-d088-4d40-a07f-913c1978de41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:45.748033 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 889/1775] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:45 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:52:45.753694 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b919032-3f3c-4b8f-a64c-5ad94992c89c None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:45.756419 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-0b919032-3f3c-4b8f-a64c-5ad94992c89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:45.819262 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 887/1776] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:52:45.829656 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d7660-d088-4d40-a07f-913c1978de41 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:45.831153 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-903d7660-d088-4d40-a07f-913c1978de41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:45.886377 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b919032-3f3c-4b8f-a64c-5ad94992c89c None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:45.892043 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf523f5-f408-4a87-beb6-3d1282d367b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:45.893350 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf523f5-f408-4a87-beb6-3d1282d367b5 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:45.893828 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf523f5-f408-4a87-beb6-3d1282d367b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:45.894285 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf523f5-f408-4a87-beb6-3d1282d367b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:45.896359 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf523f5-f408-4a87-beb6-3d1282d367b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:45.928225 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf523f5-f408-4a87-beb6-3d1282d367b5 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:45.929972 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d7660-d088-4d40-a07f-913c1978de41 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:45.933722 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c4474-97de-4e26-9bec-19291ccd78c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:45.934378 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c4474-97de-4e26-9bec-19291ccd78c5 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:45.934953 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c4474-97de-4e26-9bec-19291ccd78c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:45.935329 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c4474-97de-4e26-9bec-19291ccd78c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:45.945229 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c4474-97de-4e26-9bec-19291ccd78c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:45.962958 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 890/1777] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:45 2021] POST /identity/v3/projects => generated 381 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:45.963789 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf523f5-f408-4a87-beb6-3d1282d367b5 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:45.973053 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c4474-97de-4e26-9bec-19291ccd78c5 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:45.982939 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 888/1778] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:45 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:52:46.048321 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf523f5-f408-4a87-beb6-3d1282d367b5 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:46.055393 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41e39a-43d8-4d63-9d27-8ee0aee816cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:46.056749 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41e39a-43d8-4d63-9d27-8ee0aee816cd admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:46.057271 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41e39a-43d8-4d63-9d27-8ee0aee816cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:46.057714 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41e39a-43d8-4d63-9d27-8ee0aee816cd admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:46.058905 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41e39a-43d8-4d63-9d27-8ee0aee816cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:46.126509 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41e39a-43d8-4d63-9d27-8ee0aee816cd admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:46.159736 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 891/1779] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:45 2021] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:46.160405 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c4474-97de-4e26-9bec-19291ccd78c5 service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:46.170954 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c4474-97de-4e26-9bec-19291ccd78c5 service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:46.177520 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7308f-fe9c-4ae4-b16e-f0c1f043444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:46.178813 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7308f-fe9c-4ae4-b16e-f0c1f043444d admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:46.179552 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7308f-fe9c-4ae4-b16e-f0c1f043444d admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:46.179959 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7308f-fe9c-4ae4-b16e-f0c1f043444d admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:46.182519 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7308f-fe9c-4ae4-b16e-f0c1f043444d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:46.217259 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7308f-fe9c-4ae4-b16e-f0c1f043444d admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:46.235661 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 889/1780] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:46 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:52:46.237736 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41e39a-43d8-4d63-9d27-8ee0aee816cd admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:46.250796 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41e39a-43d8-4d63-9d27-8ee0aee816cd admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:46.256727 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd0f30-e391-4ebf-9cd7-5acd66262bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:46.258130 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd0f30-e391-4ebf-9cd7-5acd66262bb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:46.258595 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd0f30-e391-4ebf-9cd7-5acd66262bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:46.259148 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd0f30-e391-4ebf-9cd7-5acd66262bb0 admin admin] PATH_INFO: `/v3/projects/67fccb61500a4272b7dae169a33594ac/users/a356ee9946854384955d4650d732848b/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:46.304945 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd0f30-e391-4ebf-9cd7-5acd66262bb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67fccb61500a4272b7dae169a33594ac, user_id=a356ee9946854384955d4650d732848b, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:46.335906 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd0f30-e391-4ebf-9cd7-5acd66262bb0 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:46.383347 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 892/1781] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:46 2021] PUT /identity/v3/projects/67fccb61500a4272b7dae169a33594ac/users/a356ee9946854384955d4650d732848b/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:46.384710 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7308f-fe9c-4ae4-b16e-f0c1f043444d admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:46.408905 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7308f-fe9c-4ae4-b16e-f0c1f043444d admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:46.561025 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2dc07-61d7-4cee-8864-c561dce58389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:46.561693 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2dc07-61d7-4cee-8864-c561dce58389 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:46.567972 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2dc07-61d7-4cee-8864-c561dce58389 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:46.568374 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2dc07-61d7-4cee-8864-c561dce58389 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:46.569326 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2dc07-61d7-4cee-8864-c561dce58389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:46.610833 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd0f30-e391-4ebf-9cd7-5acd66262bb0 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:46.612769 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-e4bd0f30-e391-4ebf-9cd7-5acd66262bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:46.655315 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd0f30-e391-4ebf-9cd7-5acd66262bb0 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:46.677166 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2dc07-61d7-4cee-8864-c561dce58389 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:46.682600 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed430dd-6585-4430-8237-c0f4e55574a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:46.684445 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed430dd-6585-4430-8237-c0f4e55574a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:46.686080 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed430dd-6585-4430-8237-c0f4e55574a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:46.686521 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed430dd-6585-4430-8237-c0f4e55574a2 admin admin] PATH_INFO: `/v3/projects/9a42019590fa49ef8ab50f654bd5b041` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:46.692992 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed430dd-6585-4430-8237-c0f4e55574a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a42019590fa49ef8ab50f654bd5b041)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:46.709063 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 890/1782] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:46 2021] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:52:46.713056 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2dc07-61d7-4cee-8864-c561dce58389 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:46.744848 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2dc07-61d7-4cee-8864-c561dce58389 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:46.759426 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd190f90-fc82-4f81-bc26-dbb9bd0d14be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:46.760732 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd190f90-fc82-4f81-bc26-dbb9bd0d14be admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:46.760732 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd190f90-fc82-4f81-bc26-dbb9bd0d14be admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:46.760945 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd190f90-fc82-4f81-bc26-dbb9bd0d14be admin admin] PATH_INFO: `/v3/projects/67fccb61500a4272b7dae169a33594ac/users/a356ee9946854384955d4650d732848b/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:46.762804 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd190f90-fc82-4f81-bc26-dbb9bd0d14be admin admin] RBAC: Authorizing `identity:create_grant(project_id=67fccb61500a4272b7dae169a33594ac, user_id=a356ee9946854384955d4650d732848b, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:46.783176 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed430dd-6585-4430-8237-c0f4e55574a2 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:46.831054 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd190f90-fc82-4f81-bc26-dbb9bd0d14be admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:46.865668 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 891/1783] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:46 2021] PUT /identity/v3/projects/67fccb61500a4272b7dae169a33594ac/users/a356ee9946854384955d4650d732848b/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:52:46.871011 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd190f90-fc82-4f81-bc26-dbb9bd0d14be admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:46.903964 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4ed430dd-6585-4430-8237-c0f4e55574a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a42019590fa49ef8ab50f654bd5b041', 'request_id': 'req-4ed430dd-6585-4430-8237-c0f4e55574a2'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:46.919663 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4ed430dd-6585-4430-8237-c0f4e55574a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a42019590fa49ef8ab50f654bd5b041', 'request_id': 'req-4ed430dd-6585-4430-8237-c0f4e55574a2'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:46.948011 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4ed430dd-6585-4430-8237-c0f4e55574a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a42019590fa49ef8ab50f654bd5b041', 'request_id': 'req-4ed430dd-6585-4430-8237-c0f4e55574a2'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:46.989026 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4ed430dd-6585-4430-8237-c0f4e55574a2 admin admin] The token cache is being invalidate because project 9a42019590fa49ef8ab50f654bd5b041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:52:46.990942 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4ed430dd-6585-4430-8237-c0f4e55574a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:46.993134 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4ed430dd-6585-4430-8237-c0f4e55574a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:46.995545 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 893/1784] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:52:46 2021] DELETE /identity/v3/projects/9a42019590fa49ef8ab50f654bd5b041 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:52:47.001188 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed430dd-6585-4430-8237-c0f4e55574a2 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:47.010204 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-4ed430dd-6585-4430-8237-c0f4e55574a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:47.022505 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd190f90-fc82-4f81-bc26-dbb9bd0d14be admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:47.104450 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2bc7c-c7cf-4816-acd7-ee9d7cdedf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:47.105122 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2bc7c-c7cf-4816-acd7-ee9d7cdedf71 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:47.105519 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2bc7c-c7cf-4816-acd7-ee9d7cdedf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:47.105905 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2bc7c-c7cf-4816-acd7-ee9d7cdedf71 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:47.107150 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b2bc7c-c7cf-4816-acd7-ee9d7cdedf71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:47.111903 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed430dd-6585-4430-8237-c0f4e55574a2 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:47.117575 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697eeb2-a5b7-4871-8bb9-1b1af2c42399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:47.118376 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697eeb2-a5b7-4871-8bb9-1b1af2c42399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:47.118678 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697eeb2-a5b7-4871-8bb9-1b1af2c42399 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:47.118989 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697eeb2-a5b7-4871-8bb9-1b1af2c42399 admin admin] PATH_INFO: `/v3/users/e24cff97044a4782bf705fb5fb85900c` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:47.120102 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697eeb2-a5b7-4871-8bb9-1b1af2c42399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e24cff97044a4782bf705fb5fb85900c)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:47.146116 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b2bc7c-c7cf-4816-acd7-ee9d7cdedf71 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:47.159044 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697eeb2-a5b7-4871-8bb9-1b1af2c42399 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:47.160284 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 892/1785] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:46 2021] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:47.166046 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2bc7c-c7cf-4816-acd7-ee9d7cdedf71 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:47.172059 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-96b2bc7c-c7cf-4816-acd7-ee9d7cdedf71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:47.195498 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2bc7c-c7cf-4816-acd7-ee9d7cdedf71 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:47.203380 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe9bc0-372e-479e-b30b-9b260a62e536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:47.204600 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe9bc0-372e-479e-b30b-9b260a62e536 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:47.204900 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe9bc0-372e-479e-b30b-9b260a62e536 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:47.205172 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe9bc0-372e-479e-b30b-9b260a62e536 admin admin] PATH_INFO: `/v3/projects/67fccb61500a4272b7dae169a33594ac/users/a356ee9946854384955d4650d732848b/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:47.210362 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe9bc0-372e-479e-b30b-9b260a62e536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67fccb61500a4272b7dae169a33594ac, user_id=a356ee9946854384955d4650d732848b, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:47.253567 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-3697eeb2-a5b7-4871-8bb9-1b1af2c42399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e24cff97044a4782bf705fb5fb85900c'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:47.254209 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-3697eeb2-a5b7-4871-8bb9-1b1af2c42399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e24cff97044a4782bf705fb5fb85900c'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:47.266809 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe9bc0-372e-479e-b30b-9b260a62e536 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:47.269596 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-3697eeb2-a5b7-4871-8bb9-1b1af2c42399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e24cff97044a4782bf705fb5fb85900c'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:47.294067 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 893/1786] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:47 2021] PUT /identity/v3/projects/67fccb61500a4272b7dae169a33594ac/users/a356ee9946854384955d4650d732848b/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:47.297605 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-3697eeb2-a5b7-4871-8bb9-1b1af2c42399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e24cff97044a4782bf705fb5fb85900c'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:47.305474 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2aa12-65b0-4c3c-b55e-9ce061c5f88d None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:47.305681 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2aa12-65b0-4c3c-b55e-9ce061c5f88d None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:47.306097 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2aa12-65b0-4c3c-b55e-9ce061c5f88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:47.316076 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-3697eeb2-a5b7-4871-8bb9-1b1af2c42399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e24cff97044a4782bf705fb5fb85900c'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:47.326228 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 894/1787] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:52:47 2021] DELETE /identity/v3/users/e24cff97044a4782bf705fb5fb85900c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:47.367562 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-7bb2aa12-65b0-4c3c-b55e-9ce061c5f88d None None] MFA Rules not processed for user `a356ee9946854384955d4650d732848b`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:47.368685 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-7bb2aa12-65b0-4c3c-b55e-9ce061c5f88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:47.484516 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 894/1788] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:47 2021] POST /identity/v3/auth/tokens => generated 3755 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:52:47.496755 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697eeb2-a5b7-4871-8bb9-1b1af2c42399 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:47.498287 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-3697eeb2-a5b7-4871-8bb9-1b1af2c42399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:47.623072 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697eeb2-a5b7-4871-8bb9-1b1af2c42399 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:47.627844 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073e263-9eb7-4244-91b1-ec939d53e56d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:47.628627 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073e263-9eb7-4244-91b1-ec939d53e56d service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:47.629173 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073e263-9eb7-4244-91b1-ec939d53e56d service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:47.629734 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073e263-9eb7-4244-91b1-ec939d53e56d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:47.641569 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073e263-9eb7-4244-91b1-ec939d53e56d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:47.666901 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073e263-9eb7-4244-91b1-ec939d53e56d service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:47.677480 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 895/1789] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:47 2021] GET /identity/v3/auth/tokens => generated 3755 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:47.866407 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2aa12-65b0-4c3c-b55e-9ce061c5f88d None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:47.867873 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-7bb2aa12-65b0-4c3c-b55e-9ce061c5f88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:48.059005 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2aa12-65b0-4c3c-b55e-9ce061c5f88d None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:48.075463 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05163d83-eb47-4f36-8fd6-ed4ee2b2ef4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:48.079555 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05163d83-eb47-4f36-8fd6-ed4ee2b2ef4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:48.080034 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05163d83-eb47-4f36-8fd6-ed4ee2b2ef4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:48.081115 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05163d83-eb47-4f36-8fd6-ed4ee2b2ef4a admin admin] PATH_INFO: `/v3/projects/2e70711020f84d8d8304273faab6dc9f` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:48.086296 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05163d83-eb47-4f36-8fd6-ed4ee2b2ef4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e70711020f84d8d8304273faab6dc9f)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:48.144268 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05163d83-eb47-4f36-8fd6-ed4ee2b2ef4a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:48.242034 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-05163d83-eb47-4f36-8fd6-ed4ee2b2ef4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e70711020f84d8d8304273faab6dc9f', 'request_id': 'req-05163d83-eb47-4f36-8fd6-ed4ee2b2ef4a'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:48.256455 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-05163d83-eb47-4f36-8fd6-ed4ee2b2ef4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e70711020f84d8d8304273faab6dc9f', 'request_id': 'req-05163d83-eb47-4f36-8fd6-ed4ee2b2ef4a'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:48.272756 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-05163d83-eb47-4f36-8fd6-ed4ee2b2ef4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e70711020f84d8d8304273faab6dc9f', 'request_id': 'req-05163d83-eb47-4f36-8fd6-ed4ee2b2ef4a'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:48.283814 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-05163d83-eb47-4f36-8fd6-ed4ee2b2ef4a admin admin] The token cache is being invalidate because project 2e70711020f84d8d8304273faab6dc9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:52:48.284367 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-05163d83-eb47-4f36-8fd6-ed4ee2b2ef4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:48.285163 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-05163d83-eb47-4f36-8fd6-ed4ee2b2ef4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:48.288475 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 895/1790] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:52:47 2021] DELETE /identity/v3/projects/2e70711020f84d8d8304273faab6dc9f => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:48.294607 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53cffa-5e75-473d-832b-89b31ab8cfe2 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:48.295375 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53cffa-5e75-473d-832b-89b31ab8cfe2 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:48.295375 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53cffa-5e75-473d-832b-89b31ab8cfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:48.337481 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-9f53cffa-5e75-473d-832b-89b31ab8cfe2 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:48.338530 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05163d83-eb47-4f36-8fd6-ed4ee2b2ef4a admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:48.338710 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-9f53cffa-5e75-473d-832b-89b31ab8cfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:48.343101 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-05163d83-eb47-4f36-8fd6-ed4ee2b2ef4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:48.452561 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05163d83-eb47-4f36-8fd6-ed4ee2b2ef4a admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:48.455644 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 896/1791] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:48.463826 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cef9e4-421e-4a27-bb4e-33adea39be84 tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a356ee9946854384955d4650d732848b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67fccb61500a4272b7dae169a33594ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:48.464585 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cef9e4-421e-4a27-bb4e-33adea39be84 tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:48.464953 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cef9e4-421e-4a27-bb4e-33adea39be84 tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:48.465312 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cef9e4-421e-4a27-bb4e-33adea39be84 tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:48.466124 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cef9e4-421e-4a27-bb4e-33adea39be84 tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:52:48.466503 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cef9e4-421e-4a27-bb4e-33adea39be84 tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:48.469659 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cac12a-1fc6-4fff-a1a5-32c31cc9c484 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:48.469957 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cac12a-1fc6-4fff-a1a5-32c31cc9c484 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:48.470251 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cac12a-1fc6-4fff-a1a5-32c31cc9c484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:48.503144 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-08cac12a-1fc6-4fff-a1a5-32c31cc9c484 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:48.504549 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-08cac12a-1fc6-4fff-a1a5-32c31cc9c484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:48.517293 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 897/1792] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:48.518237 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cac12a-1fc6-4fff-a1a5-32c31cc9c484 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:48.525049 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cef9e4-421e-4a27-bb4e-33adea39be84 tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:48.528250 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cac12a-1fc6-4fff-a1a5-32c31cc9c484 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:48.540135 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224be0f9-bf48-43cf-8c43-616d65fdfc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:48.540743 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224be0f9-bf48-43cf-8c43-616d65fdfc2d admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:48.541027 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224be0f9-bf48-43cf-8c43-616d65fdfc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:48.541300 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224be0f9-bf48-43cf-8c43-616d65fdfc2d admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:48.541526 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 896/1793] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:52:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:52:48.542005 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224be0f9-bf48-43cf-8c43-616d65fdfc2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:52:48.542308 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224be0f9-bf48-43cf-8c43-616d65fdfc2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:48.545486 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cef9e4-421e-4a27-bb4e-33adea39be84 tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:48.559105 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cef9e4-421e-4a27-bb4e-33adea39be84 tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:48.564704 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beee440-0a48-4cff-8e67-e147f92493ed tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a356ee9946854384955d4650d732848b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67fccb61500a4272b7dae169a33594ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:48.565368 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beee440-0a48-4cff-8e67-e147f92493ed tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:48.565767 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beee440-0a48-4cff-8e67-e147f92493ed tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:48.566115 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beee440-0a48-4cff-8e67-e147f92493ed tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:48.566853 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beee440-0a48-4cff-8e67-e147f92493ed tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:48.572810 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224be0f9-bf48-43cf-8c43-616d65fdfc2d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:48.588915 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 898/1794] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:52:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:52:48.597230 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224be0f9-bf48-43cf-8c43-616d65fdfc2d admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:48.601416 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beee440-0a48-4cff-8e67-e147f92493ed tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:48.611223 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224be0f9-bf48-43cf-8c43-616d65fdfc2d admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:48.615731 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0ceef-209d-4611-a96a-ee243d314bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:48.616979 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0ceef-209d-4611-a96a-ee243d314bbc admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:48.617277 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0ceef-209d-4611-a96a-ee243d314bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:48.617556 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0ceef-209d-4611-a96a-ee243d314bbc admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:48.618764 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0ceef-209d-4611-a96a-ee243d314bbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:48.650905 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0ceef-209d-4611-a96a-ee243d314bbc admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:48.705675 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 899/1795] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:48 2021] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:48.710287 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0ceef-209d-4611-a96a-ee243d314bbc admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:48.799212 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 897/1796] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:48 2021] POST /identity/v3/projects => generated 355 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:52:48.803560 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beee440-0a48-4cff-8e67-e147f92493ed tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:48.872993 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0ceef-209d-4611-a96a-ee243d314bbc admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:48.982974 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291537f1-fa03-4013-8840-19c3becfdb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:48.984199 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291537f1-fa03-4013-8840-19c3becfdb76 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:48.984594 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291537f1-fa03-4013-8840-19c3becfdb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:48.984945 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291537f1-fa03-4013-8840-19c3becfdb76 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:48.985830 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291537f1-fa03-4013-8840-19c3becfdb76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:48.991406 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beee440-0a48-4cff-8e67-e147f92493ed tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:49.011896 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50bb89-1e09-44ae-86de-aa31f2c69d62 tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a356ee9946854384955d4650d732848b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67fccb61500a4272b7dae169a33594ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:49.013575 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50bb89-1e09-44ae-86de-aa31f2c69d62 tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:49.014321 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50bb89-1e09-44ae-86de-aa31f2c69d62 tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:49.015460 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291537f1-fa03-4013-8840-19c3becfdb76 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:49.015971 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50bb89-1e09-44ae-86de-aa31f2c69d62 tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:49.017014 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50bb89-1e09-44ae-86de-aa31f2c69d62 tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:52:49.017721 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50bb89-1e09-44ae-86de-aa31f2c69d62 tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:49.040110 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 900/1797] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:48 2021] POST /identity/v3/users => generated 289 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:49.055701 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291537f1-fa03-4013-8840-19c3becfdb76 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:49.087668 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291537f1-fa03-4013-8840-19c3becfdb76 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:49.095357 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326df06-6f0c-47bd-b5d4-1c2616ef8637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:49.096135 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326df06-6f0c-47bd-b5d4-1c2616ef8637 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:49.096532 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326df06-6f0c-47bd-b5d4-1c2616ef8637 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:49.096918 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326df06-6f0c-47bd-b5d4-1c2616ef8637 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:49.097724 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326df06-6f0c-47bd-b5d4-1c2616ef8637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:49.098777 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50bb89-1e09-44ae-86de-aa31f2c69d62 tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:49.115962 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 898/1798] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:52:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:52:49.131982 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326df06-6f0c-47bd-b5d4-1c2616ef8637 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:49.164947 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50bb89-1e09-44ae-86de-aa31f2c69d62 tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:49.173889 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 901/1799] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:49 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:49.178791 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50bb89-1e09-44ae-86de-aa31f2c69d62 tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:49.192119 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab3b77-8754-4c9d-8574-bece012401ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:49.193229 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab3b77-8754-4c9d-8574-bece012401ca admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:49.193519 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab3b77-8754-4c9d-8574-bece012401ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:49.193931 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab3b77-8754-4c9d-8574-bece012401ca admin admin] PATH_INFO: `/v3/projects/246a98522b8347b5bf8fcd3968800446/users/ceb27b699af14cf2bc7dd00bcd3757da/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:49.215143 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326df06-6f0c-47bd-b5d4-1c2616ef8637 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:49.237643 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326df06-6f0c-47bd-b5d4-1c2616ef8637 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:49.260020 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758d2fb-1290-4d34-9756-16cbf2716d4e tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a356ee9946854384955d4650d732848b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67fccb61500a4272b7dae169a33594ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:49.260923 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758d2fb-1290-4d34-9756-16cbf2716d4e tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:49.261128 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758d2fb-1290-4d34-9756-16cbf2716d4e tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:49.261408 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758d2fb-1290-4d34-9756-16cbf2716d4e tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] PATH_INFO: `/v3/projects/cbe731acd6874a29a36c20994d291f83` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:49.263543 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758d2fb-1290-4d34-9756-16cbf2716d4e tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cbe731acd6874a29a36c20994d291f83)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:49.273410 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab3b77-8754-4c9d-8574-bece012401ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=246a98522b8347b5bf8fcd3968800446, user_id=ceb27b699af14cf2bc7dd00bcd3757da, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:49.385607 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758d2fb-1290-4d34-9756-16cbf2716d4e tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:49.403437 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab3b77-8754-4c9d-8574-bece012401ca admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:49.470633 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 899/1800] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:49 2021] PUT /identity/v3/projects/246a98522b8347b5bf8fcd3968800446/users/ceb27b699af14cf2bc7dd00bcd3757da/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:49.472458 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199209b4-58d8-4997-a998-b4f5f1bdeca2 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:49.473048 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199209b4-58d8-4997-a998-b4f5f1bdeca2 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:49.473376 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199209b4-58d8-4997-a998-b4f5f1bdeca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:49.563579 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-8758d2fb-1290-4d34-9756-16cbf2716d4e tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbe731acd6874a29a36c20994d291f83', 'request_id': 'req-8758d2fb-1290-4d34-9756-16cbf2716d4e'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:49.564051 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-199209b4-58d8-4997-a998-b4f5f1bdeca2 None None] MFA Rules not processed for user `ceb27b699af14cf2bc7dd00bcd3757da`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:49.565222 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-199209b4-58d8-4997-a998-b4f5f1bdeca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:49.574406 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-8758d2fb-1290-4d34-9756-16cbf2716d4e tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbe731acd6874a29a36c20994d291f83', 'request_id': 'req-8758d2fb-1290-4d34-9756-16cbf2716d4e'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:49.586547 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-8758d2fb-1290-4d34-9756-16cbf2716d4e tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbe731acd6874a29a36c20994d291f83', 'request_id': 'req-8758d2fb-1290-4d34-9756-16cbf2716d4e'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:49.626922 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-8758d2fb-1290-4d34-9756-16cbf2716d4e tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] The token cache is being invalidate because project cbe731acd6874a29a36c20994d291f83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:52:49.628288 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-8758d2fb-1290-4d34-9756-16cbf2716d4e tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:49.630604 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-8758d2fb-1290-4d34-9756-16cbf2716d4e tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:49.632714 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 902/1801] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:52:49 2021] DELETE /identity/v3/projects/cbe731acd6874a29a36c20994d291f83 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:52:49.717715 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 900/1802] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:49 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:49.718281 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758d2fb-1290-4d34-9756-16cbf2716d4e tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:49.720539 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-8758d2fb-1290-4d34-9756-16cbf2716d4e tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:49.899694 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758d2fb-1290-4d34-9756-16cbf2716d4e tempest-VolumeQuotaClassesTest-1088308685 tempest-VolumeQuotaClassesTest-1088308685-project-admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:49.912003 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78649860-da76-4701-89d8-b22e78186359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:49.913094 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78649860-da76-4701-89d8-b22e78186359 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:49.913584 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78649860-da76-4701-89d8-b22e78186359 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:49.914058 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78649860-da76-4701-89d8-b22e78186359 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:49.915018 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78649860-da76-4701-89d8-b22e78186359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:49.978347 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78649860-da76-4701-89d8-b22e78186359 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:50.032229 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199209b4-58d8-4997-a998-b4f5f1bdeca2 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:50.043132 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 903/1803] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:49 2021] POST /identity/v3/projects => generated 379 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:52:50.056880 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199209b4-58d8-4997-a998-b4f5f1bdeca2 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:50.149733 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78649860-da76-4701-89d8-b22e78186359 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:50.152318 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-78649860-da76-4701-89d8-b22e78186359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:50.200192 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3200c-96ba-43fa-bcde-3ed2808b7a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:50.201358 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3200c-96ba-43fa-bcde-3ed2808b7a8e admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:50.201871 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3200c-96ba-43fa-bcde-3ed2808b7a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:50.202498 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3200c-96ba-43fa-bcde-3ed2808b7a8e admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:50.203503 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3200c-96ba-43fa-bcde-3ed2808b7a8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:50.250769 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3200c-96ba-43fa-bcde-3ed2808b7a8e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:50.291548 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 901/1804] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:50 2021] POST /identity/v3/users => generated 290 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:50.294833 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3200c-96ba-43fa-bcde-3ed2808b7a8e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:50.313720 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3200c-96ba-43fa-bcde-3ed2808b7a8e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:50.320782 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013d92c-88b5-43ff-a19f-1037c89c53cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:50.323380 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013d92c-88b5-43ff-a19f-1037c89c53cc admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:50.323815 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013d92c-88b5-43ff-a19f-1037c89c53cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:50.324463 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013d92c-88b5-43ff-a19f-1037c89c53cc admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:50.325931 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013d92c-88b5-43ff-a19f-1037c89c53cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:50.392843 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78649860-da76-4701-89d8-b22e78186359 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:50.401359 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013d92c-88b5-43ff-a19f-1037c89c53cc admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:50.426109 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2513c-0d35-4185-bb63-f918a0e2833c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:50.427465 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2513c-0d35-4185-bb63-f918a0e2833c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:50.427465 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2513c-0d35-4185-bb63-f918a0e2833c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:50.427769 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2513c-0d35-4185-bb63-f918a0e2833c admin admin] PATH_INFO: `/v3/users/19c30109ae884e03886088d5f34fbb19` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:50.429049 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2513c-0d35-4185-bb63-f918a0e2833c admin admin] RBAC: Authorizing `identity:delete_user(user_id=19c30109ae884e03886088d5f34fbb19)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:50.445300 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 902/1805] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:50 2021] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:50.446868 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013d92c-88b5-43ff-a19f-1037c89c53cc admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:50.467617 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013d92c-88b5-43ff-a19f-1037c89c53cc admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:50.484648 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6e3dc-2f39-4055-acd6-d99a0d5afeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:50.485715 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6e3dc-2f39-4055-acd6-d99a0d5afeca admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:50.486098 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6e3dc-2f39-4055-acd6-d99a0d5afeca admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:50.486452 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6e3dc-2f39-4055-acd6-d99a0d5afeca admin admin] PATH_INFO: `/v3/projects/efb51e680c9f4c1288d0534c3b503f45/users/aad0c0fbfe744941abbad909d36075ce/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:50.492064 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2513c-0d35-4185-bb63-f918a0e2833c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:50.548769 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6e3dc-2f39-4055-acd6-d99a0d5afeca admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb51e680c9f4c1288d0534c3b503f45, user_id=aad0c0fbfe744941abbad909d36075ce, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:50.602946 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6e3dc-2f39-4055-acd6-d99a0d5afeca admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:50.645615 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 903/1806] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:50 2021] PUT /identity/v3/projects/efb51e680c9f4c1288d0534c3b503f45/users/aad0c0fbfe744941abbad909d36075ce/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:50.648765 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-22a2513c-0d35-4185-bb63-f918a0e2833c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19c30109ae884e03886088d5f34fbb19'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:50.649841 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-22a2513c-0d35-4185-bb63-f918a0e2833c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19c30109ae884e03886088d5f34fbb19'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:50.656318 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264cb88-2e84-4a3d-9680-22be03d4f0c1 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:50.656614 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264cb88-2e84-4a3d-9680-22be03d4f0c1 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:50.656899 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264cb88-2e84-4a3d-9680-22be03d4f0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:50.661085 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-22a2513c-0d35-4185-bb63-f918a0e2833c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19c30109ae884e03886088d5f34fbb19'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:50.678993 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-22a2513c-0d35-4185-bb63-f918a0e2833c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19c30109ae884e03886088d5f34fbb19'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:50.691102 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-22a2513c-0d35-4185-bb63-f918a0e2833c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19c30109ae884e03886088d5f34fbb19'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:50.704917 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 904/1807] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:52:50 2021] DELETE /identity/v3/users/19c30109ae884e03886088d5f34fbb19 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:50.710182 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1f755-8f7a-40b0-94ae-970e30d0d095 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:50.712020 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-b264cb88-2e84-4a3d-9680-22be03d4f0c1 None None] MFA Rules not processed for user `aad0c0fbfe744941abbad909d36075ce`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:50.713743 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-b264cb88-2e84-4a3d-9680-22be03d4f0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:50.715589 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1f755-8f7a-40b0-94ae-970e30d0d095 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:50.716419 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1f755-8f7a-40b0-94ae-970e30d0d095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:50.772281 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-89b1f755-8f7a-40b0-94ae-970e30d0d095 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:50.777657 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-89b1f755-8f7a-40b0-94ae-970e30d0d095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:50.867719 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 904/1808] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:50 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:52:50.883324 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264cb88-2e84-4a3d-9680-22be03d4f0c1 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:50.884622 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-b264cb88-2e84-4a3d-9680-22be03d4f0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:50.916727 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 905/1809] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:50.925103 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1f755-8f7a-40b0-94ae-970e30d0d095 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:50.926453 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-89b1f755-8f7a-40b0-94ae-970e30d0d095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:50.988772 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264cb88-2e84-4a3d-9680-22be03d4f0c1 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:50.999977 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44779aea-a34d-4b4b-a159-1e86332f632a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:51.000796 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44779aea-a34d-4b4b-a159-1e86332f632a admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:51.001208 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44779aea-a34d-4b4b-a159-1e86332f632a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:51.001630 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44779aea-a34d-4b4b-a159-1e86332f632a admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:51.002453 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44779aea-a34d-4b4b-a159-1e86332f632a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:51.047112 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1f755-8f7a-40b0-94ae-970e30d0d095 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:51.048776 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44779aea-a34d-4b4b-a159-1e86332f632a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:51.052842 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df935c-0657-4844-accc-47a353909d44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:51.053719 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df935c-0657-4844-accc-47a353909d44 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:51.054020 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df935c-0657-4844-accc-47a353909d44 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:51.054367 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df935c-0657-4844-accc-47a353909d44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:51.069322 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df935c-0657-4844-accc-47a353909d44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:51.085690 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 905/1810] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:50 2021] POST /identity/v3/projects => generated 377 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:51.091703 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44779aea-a34d-4b4b-a159-1e86332f632a admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:51.105146 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df935c-0657-4844-accc-47a353909d44 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:51.117908 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 906/1811] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:50 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:52:51.222194 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44779aea-a34d-4b4b-a159-1e86332f632a admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:51.229586 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e416f9-217b-403d-aadb-4bb3b2123614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:51.230550 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e416f9-217b-403d-aadb-4bb3b2123614 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:51.231022 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e416f9-217b-403d-aadb-4bb3b2123614 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:51.231248 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e416f9-217b-403d-aadb-4bb3b2123614 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:51.231955 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e416f9-217b-403d-aadb-4bb3b2123614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:51.284793 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e416f9-217b-403d-aadb-4bb3b2123614 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:51.326712 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 906/1812] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:51 2021] POST /identity/v3/users => generated 295 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:51.329357 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df935c-0657-4844-accc-47a353909d44 service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:51.340148 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df935c-0657-4844-accc-47a353909d44 service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:51.347129 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e1e83-64fc-4639-853a-d1385bfff08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:51.347823 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e1e83-64fc-4639-853a-d1385bfff08f admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:51.348203 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e1e83-64fc-4639-853a-d1385bfff08f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:51.348847 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e1e83-64fc-4639-853a-d1385bfff08f admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:51.349854 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e1e83-64fc-4639-853a-d1385bfff08f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:51.390982 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e1e83-64fc-4639-853a-d1385bfff08f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:51.409742 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 907/1813] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:51 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:51.414683 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e416f9-217b-403d-aadb-4bb3b2123614 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:51.425428 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e416f9-217b-403d-aadb-4bb3b2123614 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:51.429704 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69148c2-9d76-4792-a011-1c781cfa2f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:51.430532 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69148c2-9d76-4792-a011-1c781cfa2f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:51.430862 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69148c2-9d76-4792-a011-1c781cfa2f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:51.431145 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69148c2-9d76-4792-a011-1c781cfa2f76 admin admin] PATH_INFO: `/v3/projects/e9c171da84fc43cf9ac53c3efc556dbe/users/b569f11666804cc9bbd2ad1bdfb8848c/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:51.452642 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69148c2-9d76-4792-a011-1c781cfa2f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c171da84fc43cf9ac53c3efc556dbe, user_id=b569f11666804cc9bbd2ad1bdfb8848c, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:51.479996 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69148c2-9d76-4792-a011-1c781cfa2f76 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:51.497870 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 907/1814] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:51 2021] PUT /identity/v3/projects/e9c171da84fc43cf9ac53c3efc556dbe/users/b569f11666804cc9bbd2ad1bdfb8848c/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:51.499263 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e1e83-64fc-4639-853a-d1385bfff08f admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:51.509586 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e1e83-64fc-4639-853a-d1385bfff08f admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:51.566987 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69148c2-9d76-4792-a011-1c781cfa2f76 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:51.570204 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-f69148c2-9d76-4792-a011-1c781cfa2f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:51.589689 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2e4a0-c075-45a0-b446-7185c6248a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:51.590386 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2e4a0-c075-45a0-b446-7185c6248a10 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:51.590808 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2e4a0-c075-45a0-b446-7185c6248a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:51.591213 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2e4a0-c075-45a0-b446-7185c6248a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:51.592332 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2e4a0-c075-45a0-b446-7185c6248a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:51.628090 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2e4a0-c075-45a0-b446-7185c6248a10 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:51.645600 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 908/1815] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:51 2021] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:51.646836 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2e4a0-c075-45a0-b446-7185c6248a10 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:51.662834 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2e4a0-c075-45a0-b446-7185c6248a10 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:51.674616 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd3bd0-a393-4478-90d1-e8f0591ab872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:51.675490 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd3bd0-a393-4478-90d1-e8f0591ab872 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:51.675781 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd3bd0-a393-4478-90d1-e8f0591ab872 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:51.676066 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd3bd0-a393-4478-90d1-e8f0591ab872 admin admin] PATH_INFO: `/v3/projects/e9c171da84fc43cf9ac53c3efc556dbe/users/b569f11666804cc9bbd2ad1bdfb8848c/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:51.679463 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd3bd0-a393-4478-90d1-e8f0591ab872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c171da84fc43cf9ac53c3efc556dbe, user_id=b569f11666804cc9bbd2ad1bdfb8848c, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:51.694181 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69148c2-9d76-4792-a011-1c781cfa2f76 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:51.705598 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca410d-afbf-4e8e-a404-ebba11397aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:51.706992 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca410d-afbf-4e8e-a404-ebba11397aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:51.707287 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca410d-afbf-4e8e-a404-ebba11397aab admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:51.707719 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca410d-afbf-4e8e-a404-ebba11397aab admin admin] PATH_INFO: `/v3/projects/f28f2dae69df4365810210dad3f2aa09` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:51.710904 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca410d-afbf-4e8e-a404-ebba11397aab admin admin] RBAC: Authorizing `identity:delete_project(project_id=f28f2dae69df4365810210dad3f2aa09)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:51.739549 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd3bd0-a393-4478-90d1-e8f0591ab872 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:51.755890 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca410d-afbf-4e8e-a404-ebba11397aab admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:51.767037 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 909/1816] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:51 2021] PUT /identity/v3/projects/e9c171da84fc43cf9ac53c3efc556dbe/users/b569f11666804cc9bbd2ad1bdfb8848c/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:51.769483 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd3bd0-a393-4478-90d1-e8f0591ab872 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:51.862411 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd3bd0-a393-4478-90d1-e8f0591ab872 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:51.867755 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4bca410d-afbf-4e8e-a404-ebba11397aab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f28f2dae69df4365810210dad3f2aa09', 'request_id': 'req-4bca410d-afbf-4e8e-a404-ebba11397aab'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:51.882756 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4bca410d-afbf-4e8e-a404-ebba11397aab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f28f2dae69df4365810210dad3f2aa09', 'request_id': 'req-4bca410d-afbf-4e8e-a404-ebba11397aab'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:51.915112 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4bca410d-afbf-4e8e-a404-ebba11397aab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f28f2dae69df4365810210dad3f2aa09', 'request_id': 'req-4bca410d-afbf-4e8e-a404-ebba11397aab'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:51.928316 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4bca410d-afbf-4e8e-a404-ebba11397aab admin admin] The token cache is being invalidate because project f28f2dae69df4365810210dad3f2aa09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:52:51.928816 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4bca410d-afbf-4e8e-a404-ebba11397aab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:51.929615 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4bca410d-afbf-4e8e-a404-ebba11397aab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:51.931749 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 908/1817] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:52:51 2021] DELETE /identity/v3/projects/f28f2dae69df4365810210dad3f2aa09 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:52:51.935233 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca410d-afbf-4e8e-a404-ebba11397aab admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:51.936527 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-4bca410d-afbf-4e8e-a404-ebba11397aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:51.986392 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207248dc-9b3d-4e3c-91bb-87d2d7bbf09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:51.986648 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207248dc-9b3d-4e3c-91bb-87d2d7bbf09c admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:51.987197 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207248dc-9b3d-4e3c-91bb-87d2d7bbf09c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:51.987540 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207248dc-9b3d-4e3c-91bb-87d2d7bbf09c admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:51.988455 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207248dc-9b3d-4e3c-91bb-87d2d7bbf09c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:52.036109 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207248dc-9b3d-4e3c-91bb-87d2d7bbf09c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:52.048899 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 910/1818] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:51 2021] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:52.053632 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207248dc-9b3d-4e3c-91bb-87d2d7bbf09c admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:52.053907 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca410d-afbf-4e8e-a404-ebba11397aab admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:52.058474 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6efde-7962-4bdc-95e3-55427e601aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:52.059022 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-207248dc-9b3d-4e3c-91bb-87d2d7bbf09c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:52.059429 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6efde-7962-4bdc-95e3-55427e601aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:52.060231 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6efde-7962-4bdc-95e3-55427e601aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:52.060231 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6efde-7962-4bdc-95e3-55427e601aaf admin admin] PATH_INFO: `/v3/users/a356ee9946854384955d4650d732848b` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:52.061294 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6efde-7962-4bdc-95e3-55427e601aaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a356ee9946854384955d4650d732848b)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:52.074562 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207248dc-9b3d-4e3c-91bb-87d2d7bbf09c admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:52.080111 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3679d31-a28c-4105-bdd7-68f7181a547a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:52.081099 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3679d31-a28c-4105-bdd7-68f7181a547a admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:52.081622 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3679d31-a28c-4105-bdd7-68f7181a547a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:52.082147 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3679d31-a28c-4105-bdd7-68f7181a547a admin admin] PATH_INFO: `/v3/projects/e9c171da84fc43cf9ac53c3efc556dbe/users/b569f11666804cc9bbd2ad1bdfb8848c/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:52.084373 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3679d31-a28c-4105-bdd7-68f7181a547a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c171da84fc43cf9ac53c3efc556dbe, user_id=b569f11666804cc9bbd2ad1bdfb8848c, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:52.093037 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6efde-7962-4bdc-95e3-55427e601aaf admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:52.113699 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3679d31-a28c-4105-bdd7-68f7181a547a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:52.129955 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 911/1819] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:52 2021] PUT /identity/v3/projects/e9c171da84fc43cf9ac53c3efc556dbe/users/b569f11666804cc9bbd2ad1bdfb8848c/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:52.144423 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46ca0c-ec1c-4978-9919-7f077e3b1ddc None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:52.145908 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46ca0c-ec1c-4978-9919-7f077e3b1ddc None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:52.154900 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46ca0c-ec1c-4978-9919-7f077e3b1ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:52.185435 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-f3f6efde-7962-4bdc-95e3-55427e601aaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a356ee9946854384955d4650d732848b'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:52.206172 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-0f46ca0c-ec1c-4978-9919-7f077e3b1ddc None None] MFA Rules not processed for user `b569f11666804cc9bbd2ad1bdfb8848c`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:52.207335 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-f3f6efde-7962-4bdc-95e3-55427e601aaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a356ee9946854384955d4650d732848b'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:52.207750 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-0f46ca0c-ec1c-4978-9919-7f077e3b1ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:52.208182 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-f3f6efde-7962-4bdc-95e3-55427e601aaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a356ee9946854384955d4650d732848b'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:52.218472 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-f3f6efde-7962-4bdc-95e3-55427e601aaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a356ee9946854384955d4650d732848b'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:52.227578 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-f3f6efde-7962-4bdc-95e3-55427e601aaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a356ee9946854384955d4650d732848b'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:52.237795 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 909/1820] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:52:51 2021] DELETE /identity/v3/users/a356ee9946854384955d4650d732848b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:52:52.316232 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 912/1821] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:52 2021] POST /identity/v3/auth/tokens => generated 3751 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:52.326689 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6efde-7962-4bdc-95e3-55427e601aaf admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:52.330080 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-f3f6efde-7962-4bdc-95e3-55427e601aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:52.511916 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6efde-7962-4bdc-95e3-55427e601aaf admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:52.523639 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e1a07-6e3d-45e2-a82a-0ffbf5fbbd92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:52.526998 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e1a07-6e3d-45e2-a82a-0ffbf5fbbd92 service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:52.527183 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e1a07-6e3d-45e2-a82a-0ffbf5fbbd92 service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:52.527472 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e1a07-6e3d-45e2-a82a-0ffbf5fbbd92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:52.556081 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07086c5-b5e2-4b8e-8f54-ff95d1c7ed47 None None] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:52.556614 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07086c5-b5e2-4b8e-8f54-ff95d1c7ed47 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:52.556614 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07086c5-b5e2-4b8e-8f54-ff95d1c7ed47 None None] PATH_INFO: `/` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:52.559553 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 913/1822] 10.222.0.37 () {54 vars in 921 bytes} [Wed Dec 29 20:52:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 29 20:52:52.657224 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdb2b9-e11f-4d83-a373-0c9dd73321d9 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:52.657517 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdb2b9-e11f-4d83-a373-0c9dd73321d9 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:52.658372 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdb2b9-e11f-4d83-a373-0c9dd73321d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:52.668340 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e1a07-6e3d-45e2-a82a-0ffbf5fbbd92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:52.712057 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-91cdb2b9-e11f-4d83-a373-0c9dd73321d9 None None] MFA Rules not processed for user `51ef7e54d97a4320bda0c1926d190d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:52.713238 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-91cdb2b9-e11f-4d83-a373-0c9dd73321d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:52.729376 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e1a07-6e3d-45e2-a82a-0ffbf5fbbd92 service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:52.741768 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 910/1823] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:52 2021] GET /identity/v3/auth/tokens => generated 3751 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:52.787477 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e1a07-6e3d-45e2-a82a-0ffbf5fbbd92 service cinder] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:52.789748 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-550e1a07-6e3d-45e2-a82a-0ffbf5fbbd92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:52.864237 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 914/1824] 10.222.0.37 () {58 vars in 1018 bytes} [Wed Dec 29 20:52:52 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:52.886603 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdb2b9-e11f-4d83-a373-0c9dd73321d9 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:52.899673 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdb2b9-e11f-4d83-a373-0c9dd73321d9 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:52.904727 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c8a46-c493-4252-8d9c-894b7bdb2181 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:52.906027 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c8a46-c493-4252-8d9c-894b7bdb2181 service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:52.907256 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c8a46-c493-4252-8d9c-894b7bdb2181 service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:52.907688 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c8a46-c493-4252-8d9c-894b7bdb2181 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:52.910286 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-f76c8a46-c493-4252-8d9c-894b7bdb2181 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:52.927935 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e1a07-6e3d-45e2-a82a-0ffbf5fbbd92 service cinder] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:52.933046 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24802c19-7029-488b-83d2-557c6659d3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:52.933894 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24802c19-7029-488b-83d2-557c6659d3bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:52.934192 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24802c19-7029-488b-83d2-557c6659d3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:52.934620 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24802c19-7029-488b-83d2-557c6659d3bb admin admin] PATH_INFO: `/v3/users/9ed1b58a29f34065a13cb62bb196a145` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:52.936202 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24802c19-7029-488b-83d2-557c6659d3bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ed1b58a29f34065a13cb62bb196a145)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:52.976426 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24802c19-7029-488b-83d2-557c6659d3bb admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:53.028728 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c8a46-c493-4252-8d9c-894b7bdb2181 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:53.042915 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-24802c19-7029-488b-83d2-557c6659d3bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ed1b58a29f34065a13cb62bb196a145'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:53.060290 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-24802c19-7029-488b-83d2-557c6659d3bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ed1b58a29f34065a13cb62bb196a145'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:53.068439 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-24802c19-7029-488b-83d2-557c6659d3bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ed1b58a29f34065a13cb62bb196a145'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:53.070421 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c8a46-c493-4252-8d9c-894b7bdb2181 service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:53.081315 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-24802c19-7029-488b-83d2-557c6659d3bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ed1b58a29f34065a13cb62bb196a145'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:53.086540 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 915/1825] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:52 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:52:53.087615 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c8a46-c493-4252-8d9c-894b7bdb2181 service cinder] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:53.092931 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-f76c8a46-c493-4252-8d9c-894b7bdb2181 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:53.099466 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-24802c19-7029-488b-83d2-557c6659d3bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ed1b58a29f34065a13cb62bb196a145'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:53.110856 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c8a46-c493-4252-8d9c-894b7bdb2181 service cinder] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:53.111974 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 911/1826] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:52:52 2021] DELETE /identity/v3/users/9ed1b58a29f34065a13cb62bb196a145 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:53.113949 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24802c19-7029-488b-83d2-557c6659d3bb admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:53.115739 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-24802c19-7029-488b-83d2-557c6659d3bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:53.238726 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a861df9-f4c2-4b05-a356-372a7400bffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:53.239858 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a861df9-f4c2-4b05-a356-372a7400bffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:53.240155 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a861df9-f4c2-4b05-a356-372a7400bffa admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:53.240435 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a861df9-f4c2-4b05-a356-372a7400bffa admin admin] PATH_INFO: `/v3/projects/67fccb61500a4272b7dae169a33594ac` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:53.241730 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a861df9-f4c2-4b05-a356-372a7400bffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=67fccb61500a4272b7dae169a33594ac)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:53.272039 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a861df9-f4c2-4b05-a356-372a7400bffa admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:53.284050 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24802c19-7029-488b-83d2-557c6659d3bb admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:53.292872 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3c3ee-05e5-4a9d-9bfc-8473603298c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:53.293625 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3c3ee-05e5-4a9d-9bfc-8473603298c5 service nova] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:53.294748 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3c3ee-05e5-4a9d-9bfc-8473603298c5 service nova] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:53.295143 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3c3ee-05e5-4a9d-9bfc-8473603298c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:53.298418 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-b3b3c3ee-05e5-4a9d-9bfc-8473603298c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:53.324760 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3c3ee-05e5-4a9d-9bfc-8473603298c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:53.356159 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3c3ee-05e5-4a9d-9bfc-8473603298c5 service nova] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:53.369791 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 912/1827] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:53 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:53.369927 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6a861df9-f4c2-4b05-a356-372a7400bffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67fccb61500a4272b7dae169a33594ac', 'request_id': 'req-6a861df9-f4c2-4b05-a356-372a7400bffa'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:53.371297 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca02b40-3287-488b-acc6-c35e533a245a None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:53.371700 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca02b40-3287-488b-acc6-c35e533a245a None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:53.371997 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca02b40-3287-488b-acc6-c35e533a245a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:53.384132 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6a861df9-f4c2-4b05-a356-372a7400bffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67fccb61500a4272b7dae169a33594ac', 'request_id': 'req-6a861df9-f4c2-4b05-a356-372a7400bffa'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:53.392314 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6a861df9-f4c2-4b05-a356-372a7400bffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67fccb61500a4272b7dae169a33594ac', 'request_id': 'req-6a861df9-f4c2-4b05-a356-372a7400bffa'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:53.400959 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-dca02b40-3287-488b-acc6-c35e533a245a None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:53.402407 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-dca02b40-3287-488b-acc6-c35e533a245a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:53.413998 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6a861df9-f4c2-4b05-a356-372a7400bffa admin admin] The token cache is being invalidate because project 67fccb61500a4272b7dae169a33594ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:52:53.414830 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6a861df9-f4c2-4b05-a356-372a7400bffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:53.415628 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6a861df9-f4c2-4b05-a356-372a7400bffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:53.417697 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 916/1828] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:52:53 2021] DELETE /identity/v3/projects/67fccb61500a4272b7dae169a33594ac => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:53.424203 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ebfac-8f07-4a02-9516-ad9296c78c93 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:53.424678 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ebfac-8f07-4a02-9516-ad9296c78c93 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:53.425422 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ebfac-8f07-4a02-9516-ad9296c78c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:53.456000 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-641ebfac-8f07-4a02-9516-ad9296c78c93 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:53.457221 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-641ebfac-8f07-4a02-9516-ad9296c78c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:53.500422 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 913/1829] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:53.512344 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca02b40-3287-488b-acc6-c35e533a245a None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:53.513914 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-dca02b40-3287-488b-acc6-c35e533a245a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:53.622349 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 917/1830] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:53.632980 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01cadc-66c7-4742-b488-9f2b178e83cb None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:53.633281 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01cadc-66c7-4742-b488-9f2b178e83cb None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:53.637684 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01cadc-66c7-4742-b488-9f2b178e83cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:53.697276 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca02b40-3287-488b-acc6-c35e533a245a None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:53.709527 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-4a01cadc-66c7-4742-b488-9f2b178e83cb None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:53.711037 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-4a01cadc-66c7-4742-b488-9f2b178e83cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:53.711440 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9901b7-ec14-4b5c-874c-36abb3c057d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:53.712679 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9901b7-ec14-4b5c-874c-36abb3c057d9 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:53.712972 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9901b7-ec14-4b5c-874c-36abb3c057d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:53.714519 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9901b7-ec14-4b5c-874c-36abb3c057d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:53.722555 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 918/1831] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:53.726788 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01cadc-66c7-4742-b488-9f2b178e83cb None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:53.731056 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9901b7-ec14-4b5c-874c-36abb3c057d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:53.741565 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01cadc-66c7-4742-b488-9f2b178e83cb None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:53.760270 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9901b7-ec14-4b5c-874c-36abb3c057d9 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:53.776260 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76093be7-6798-4544-b8bb-3b32d283e2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:53.779190 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76093be7-6798-4544-b8bb-3b32d283e2ca admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:53.784911 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76093be7-6798-4544-b8bb-3b32d283e2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:53.785348 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76093be7-6798-4544-b8bb-3b32d283e2ca admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:53.785921 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 914/1832] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:53 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:53.786867 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76093be7-6798-4544-b8bb-3b32d283e2ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:52:53.787852 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76093be7-6798-4544-b8bb-3b32d283e2ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:53.819352 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76093be7-6798-4544-b8bb-3b32d283e2ca admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:53.852747 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 919/1833] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:52:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:52:53.854440 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9901b7-ec14-4b5c-874c-36abb3c057d9 service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:53.868231 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9901b7-ec14-4b5c-874c-36abb3c057d9 service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:53.873662 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35ba6b-cbbb-4de5-8b5c-1d457ad1ed75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:53.874989 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35ba6b-cbbb-4de5-8b5c-1d457ad1ed75 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:53.875279 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35ba6b-cbbb-4de5-8b5c-1d457ad1ed75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:53.875560 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35ba6b-cbbb-4de5-8b5c-1d457ad1ed75 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:53.876574 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35ba6b-cbbb-4de5-8b5c-1d457ad1ed75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:53.910256 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35ba6b-cbbb-4de5-8b5c-1d457ad1ed75 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:53.947883 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 915/1834] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:53 2021] POST /identity/v3/projects => generated 393 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:53.949067 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76093be7-6798-4544-b8bb-3b32d283e2ca admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:53.962217 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76093be7-6798-4544-b8bb-3b32d283e2ca admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:54.080237 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1624597-2628-48d6-a282-5d836cd9a1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:54.081153 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1624597-2628-48d6-a282-5d836cd9a1ac admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:54.081657 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1624597-2628-48d6-a282-5d836cd9a1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:54.082140 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1624597-2628-48d6-a282-5d836cd9a1ac admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:54.083456 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1624597-2628-48d6-a282-5d836cd9a1ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:54.119345 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1624597-2628-48d6-a282-5d836cd9a1ac admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:54.148027 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 920/1835] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:53 2021] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:52:54.152722 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35ba6b-cbbb-4de5-8b5c-1d457ad1ed75 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:54.168206 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35ba6b-cbbb-4de5-8b5c-1d457ad1ed75 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:54.172880 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85852e-fbcf-4373-b4a4-9bf5d0a961b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:54.173742 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85852e-fbcf-4373-b4a4-9bf5d0a961b3 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:54.173871 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85852e-fbcf-4373-b4a4-9bf5d0a961b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:54.174334 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85852e-fbcf-4373-b4a4-9bf5d0a961b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:54.175141 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85852e-fbcf-4373-b4a4-9bf5d0a961b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:54.202238 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85852e-fbcf-4373-b4a4-9bf5d0a961b3 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:54.216473 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 916/1836] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:54 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:54.217257 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1624597-2628-48d6-a282-5d836cd9a1ac admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:54.228781 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1624597-2628-48d6-a282-5d836cd9a1ac admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:54.235858 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b664e6b-4a0b-45dc-adc4-e1fa14f01f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:54.236757 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b664e6b-4a0b-45dc-adc4-e1fa14f01f36 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:54.237050 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b664e6b-4a0b-45dc-adc4-e1fa14f01f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:54.237328 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b664e6b-4a0b-45dc-adc4-e1fa14f01f36 admin admin] PATH_INFO: `/v3/projects/5fb4fdf5c4a8422ea29a45b55b5deaaf/users/2c8bea1c5fc7492a8a92acf349dfedae/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:54.267475 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b664e6b-4a0b-45dc-adc4-e1fa14f01f36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fb4fdf5c4a8422ea29a45b55b5deaaf, user_id=2c8bea1c5fc7492a8a92acf349dfedae, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:54.300973 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b664e6b-4a0b-45dc-adc4-e1fa14f01f36 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:54.318330 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 921/1837] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:54 2021] PUT /identity/v3/projects/5fb4fdf5c4a8422ea29a45b55b5deaaf/users/2c8bea1c5fc7492a8a92acf349dfedae/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:54.331271 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4433d-2e4f-4a94-b1eb-df62d8bf6aa1 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:54.331271 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4433d-2e4f-4a94-b1eb-df62d8bf6aa1 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:54.331271 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4433d-2e4f-4a94-b1eb-df62d8bf6aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:54.390937 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-acc4433d-2e4f-4a94-b1eb-df62d8bf6aa1 None None] MFA Rules not processed for user `2c8bea1c5fc7492a8a92acf349dfedae`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:54.394597 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-acc4433d-2e4f-4a94-b1eb-df62d8bf6aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:54.500864 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 917/1838] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:54 2021] POST /identity/v3/auth/tokens => generated 3700 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:54.505393 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b664e6b-4a0b-45dc-adc4-e1fa14f01f36 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:54.586036 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b664e6b-4a0b-45dc-adc4-e1fa14f01f36 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:54.591556 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4c7b3-d8d9-49ee-b7b4-40bfd560a88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:54.592171 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4c7b3-d8d9-49ee-b7b4-40bfd560a88a admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:54.592455 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4c7b3-d8d9-49ee-b7b4-40bfd560a88a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:54.593656 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4c7b3-d8d9-49ee-b7b4-40bfd560a88a admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:54.593954 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4c7b3-d8d9-49ee-b7b4-40bfd560a88a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:54.620115 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4c7b3-d8d9-49ee-b7b4-40bfd560a88a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:54.650183 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 922/1839] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:54 2021] POST /identity/v3/projects => generated 393 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:54.654237 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4433d-2e4f-4a94-b1eb-df62d8bf6aa1 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:54.675668 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4433d-2e4f-4a94-b1eb-df62d8bf6aa1 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:54.680127 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4c7b3-d8d9-49ee-b7b4-40bfd560a88a admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:54.682031 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-31d4c7b3-d8d9-49ee-b7b4-40bfd560a88a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:54.761757 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dffd6b-6711-4095-8af4-8644b2e9a543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:54.762369 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dffd6b-6711-4095-8af4-8644b2e9a543 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:54.762669 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dffd6b-6711-4095-8af4-8644b2e9a543 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:54.762955 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dffd6b-6711-4095-8af4-8644b2e9a543 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:54.764847 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dffd6b-6711-4095-8af4-8644b2e9a543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:54.800954 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4c7b3-d8d9-49ee-b7b4-40bfd560a88a admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:54.804554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dffd6b-6711-4095-8af4-8644b2e9a543 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:54.820178 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa2b5e-b5e8-4fc7-98fc-3164c0010b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:54.821625 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa2b5e-b5e8-4fc7-98fc-3164c0010b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:54.822111 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa2b5e-b5e8-4fc7-98fc-3164c0010b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:54.822521 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa2b5e-b5e8-4fc7-98fc-3164c0010b70 admin admin] PATH_INFO: `/v3/projects/ed0af1d4a5e14a0480db61407b90ffd1` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:54.824074 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa2b5e-b5e8-4fc7-98fc-3164c0010b70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed0af1d4a5e14a0480db61407b90ffd1)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:54.836573 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 918/1840] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:54 2021] POST /identity/v3/users => generated 303 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:54.837727 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dffd6b-6711-4095-8af4-8644b2e9a543 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:54.851565 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dffd6b-6711-4095-8af4-8644b2e9a543 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:54.857078 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3114324-201a-4781-b7b4-b1338fb5b952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:54.857454 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa2b5e-b5e8-4fc7-98fc-3164c0010b70 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:54.858168 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3114324-201a-4781-b7b4-b1338fb5b952 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:54.859391 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3114324-201a-4781-b7b4-b1338fb5b952 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:54.859886 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3114324-201a-4781-b7b4-b1338fb5b952 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:54.861665 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3114324-201a-4781-b7b4-b1338fb5b952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:54.892273 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3114324-201a-4781-b7b4-b1338fb5b952 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:54.906721 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 919/1841] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:54 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:54.909188 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3114324-201a-4781-b7b4-b1338fb5b952 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:54.925135 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3114324-201a-4781-b7b4-b1338fb5b952 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:54.930283 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f4aa2b5e-b5e8-4fc7-98fc-3164c0010b70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed0af1d4a5e14a0480db61407b90ffd1', 'request_id': 'req-f4aa2b5e-b5e8-4fc7-98fc-3164c0010b70'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:54.939669 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f4aa2b5e-b5e8-4fc7-98fc-3164c0010b70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed0af1d4a5e14a0480db61407b90ffd1', 'request_id': 'req-f4aa2b5e-b5e8-4fc7-98fc-3164c0010b70'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:54.946737 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f4aa2b5e-b5e8-4fc7-98fc-3164c0010b70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed0af1d4a5e14a0480db61407b90ffd1', 'request_id': 'req-f4aa2b5e-b5e8-4fc7-98fc-3164c0010b70'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:54.964749 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f4aa2b5e-b5e8-4fc7-98fc-3164c0010b70 admin admin] The token cache is being invalidate because project ed0af1d4a5e14a0480db61407b90ffd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:52:54.965138 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f4aa2b5e-b5e8-4fc7-98fc-3164c0010b70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:54.965837 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f4aa2b5e-b5e8-4fc7-98fc-3164c0010b70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:54.970637 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 923/1842] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:52:54 2021] DELETE /identity/v3/projects/ed0af1d4a5e14a0480db61407b90ffd1 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:52:54.971945 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa2b5e-b5e8-4fc7-98fc-3164c0010b70 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:54.973417 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-f4aa2b5e-b5e8-4fc7-98fc-3164c0010b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:54.999732 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f7709-95b6-4897-9298-74e35a9eae70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:55.000520 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f7709-95b6-4897-9298-74e35a9eae70 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:55.000807 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f7709-95b6-4897-9298-74e35a9eae70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:55.001085 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f7709-95b6-4897-9298-74e35a9eae70 admin admin] PATH_INFO: `/v3/projects/1374c4d811684d189605d39682c10793/users/94fe814d31d849f3a15d95f628b6b32b/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:55.020493 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f7709-95b6-4897-9298-74e35a9eae70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1374c4d811684d189605d39682c10793, user_id=94fe814d31d849f3a15d95f628b6b32b, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:55.047230 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f7709-95b6-4897-9298-74e35a9eae70 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:55.056858 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa2b5e-b5e8-4fc7-98fc-3164c0010b70 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:55.065010 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 920/1843] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:54 2021] PUT /identity/v3/projects/1374c4d811684d189605d39682c10793/users/94fe814d31d849f3a15d95f628b6b32b/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:55.065876 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f7709-95b6-4897-9298-74e35a9eae70 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:55.068033 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-224f7709-95b6-4897-9298-74e35a9eae70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:55.122274 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234deaa-e6e5-4bf0-b5ac-90af88132e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:55.123122 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234deaa-e6e5-4bf0-b5ac-90af88132e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:55.123404 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234deaa-e6e5-4bf0-b5ac-90af88132e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:55.123686 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234deaa-e6e5-4bf0-b5ac-90af88132e02 admin admin] PATH_INFO: `/v3/users/1267fb96f82247b7b908918d1edd40e9` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:55.125365 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234deaa-e6e5-4bf0-b5ac-90af88132e02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1267fb96f82247b7b908918d1edd40e9)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:55.149773 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f7709-95b6-4897-9298-74e35a9eae70 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:55.156401 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234deaa-e6e5-4bf0-b5ac-90af88132e02 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:55.168807 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531aeb21-5ff3-4c93-8d1a-a0671472930c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:55.169727 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531aeb21-5ff3-4c93-8d1a-a0671472930c admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:55.170108 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531aeb21-5ff3-4c93-8d1a-a0671472930c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:55.170555 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531aeb21-5ff3-4c93-8d1a-a0671472930c admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:55.173039 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531aeb21-5ff3-4c93-8d1a-a0671472930c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:55.214771 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531aeb21-5ff3-4c93-8d1a-a0671472930c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:55.232982 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 921/1844] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:55 2021] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:55.234900 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531aeb21-5ff3-4c93-8d1a-a0671472930c admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:55.249328 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531aeb21-5ff3-4c93-8d1a-a0671472930c admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:55.256352 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9419440-8232-41d7-b1ab-6a905b3ab336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:55.257706 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9419440-8232-41d7-b1ab-6a905b3ab336 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:55.258172 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9419440-8232-41d7-b1ab-6a905b3ab336 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:55.258682 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9419440-8232-41d7-b1ab-6a905b3ab336 admin admin] PATH_INFO: `/v3/projects/1374c4d811684d189605d39682c10793/users/94fe814d31d849f3a15d95f628b6b32b/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:55.261102 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9419440-8232-41d7-b1ab-6a905b3ab336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1374c4d811684d189605d39682c10793, user_id=94fe814d31d849f3a15d95f628b6b32b, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:55.263060 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-8234deaa-e6e5-4bf0-b5ac-90af88132e02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1267fb96f82247b7b908918d1edd40e9'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:55.264434 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-8234deaa-e6e5-4bf0-b5ac-90af88132e02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1267fb96f82247b7b908918d1edd40e9'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:55.285286 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-8234deaa-e6e5-4bf0-b5ac-90af88132e02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1267fb96f82247b7b908918d1edd40e9'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:55.301137 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9419440-8232-41d7-b1ab-6a905b3ab336 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:55.308134 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-8234deaa-e6e5-4bf0-b5ac-90af88132e02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1267fb96f82247b7b908918d1edd40e9'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:55.318349 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 922/1845] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:55 2021] PUT /identity/v3/projects/1374c4d811684d189605d39682c10793/users/94fe814d31d849f3a15d95f628b6b32b/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:55.321217 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-8234deaa-e6e5-4bf0-b5ac-90af88132e02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1267fb96f82247b7b908918d1edd40e9'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:55.323007 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9419440-8232-41d7-b1ab-6a905b3ab336 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:55.326591 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-b9419440-8232-41d7-b1ab-6a905b3ab336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:55.332572 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 924/1846] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:52:54 2021] DELETE /identity/v3/users/1267fb96f82247b7b908918d1edd40e9 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:55.419724 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9419440-8232-41d7-b1ab-6a905b3ab336 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:55.495072 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a3d7a-1d4b-4fb2-9059-3f2a3c760874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:55.495675 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a3d7a-1d4b-4fb2-9059-3f2a3c760874 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:55.496013 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a3d7a-1d4b-4fb2-9059-3f2a3c760874 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:55.496290 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a3d7a-1d4b-4fb2-9059-3f2a3c760874 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:55.496985 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a3d7a-1d4b-4fb2-9059-3f2a3c760874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:55.526585 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a3d7a-1d4b-4fb2-9059-3f2a3c760874 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:55.542708 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 923/1847] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:55 2021] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:55.544419 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234deaa-e6e5-4bf0-b5ac-90af88132e02 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:55.558782 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234deaa-e6e5-4bf0-b5ac-90af88132e02 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:55.565833 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d9ed1-d01a-4cb8-9539-dc1af865f7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:55.567720 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d9ed1-d01a-4cb8-9539-dc1af865f7a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:55.568574 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d9ed1-d01a-4cb8-9539-dc1af865f7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:55.569111 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d9ed1-d01a-4cb8-9539-dc1af865f7a1 admin admin] PATH_INFO: `/v3/projects/1374c4d811684d189605d39682c10793/users/94fe814d31d849f3a15d95f628b6b32b/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:55.573908 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d9ed1-d01a-4cb8-9539-dc1af865f7a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1374c4d811684d189605d39682c10793, user_id=94fe814d31d849f3a15d95f628b6b32b, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:55.606285 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d9ed1-d01a-4cb8-9539-dc1af865f7a1 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:55.634198 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 925/1848] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:55 2021] PUT /identity/v3/projects/1374c4d811684d189605d39682c10793/users/94fe814d31d849f3a15d95f628b6b32b/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:55.636029 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023f469-5217-425c-97b8-c94454fe6bb3 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:55.637110 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023f469-5217-425c-97b8-c94454fe6bb3 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:55.637390 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023f469-5217-425c-97b8-c94454fe6bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:55.689745 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-4023f469-5217-425c-97b8-c94454fe6bb3 None None] MFA Rules not processed for user `94fe814d31d849f3a15d95f628b6b32b`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:55.691167 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-4023f469-5217-425c-97b8-c94454fe6bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:55.783747 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 924/1849] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:55 2021] POST /identity/v3/auth/tokens => generated 3767 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:55.808817 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d9ed1-d01a-4cb8-9539-dc1af865f7a1 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:55.810668 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-553d9ed1-d01a-4cb8-9539-dc1af865f7a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:55.931908 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d9ed1-d01a-4cb8-9539-dc1af865f7a1 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:55.933563 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023f469-5217-425c-97b8-c94454fe6bb3 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:55.935173 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-4023f469-5217-425c-97b8-c94454fe6bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:55.940822 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56fda0-548f-4056-9eca-b270ffe79634 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:55.941296 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56fda0-548f-4056-9eca-b270ffe79634 service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:55.941586 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56fda0-548f-4056-9eca-b270ffe79634 service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:55.941985 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56fda0-548f-4056-9eca-b270ffe79634 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:55.959966 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56fda0-548f-4056-9eca-b270ffe79634 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:56.002814 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56fda0-548f-4056-9eca-b270ffe79634 service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:56.040279 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 926/1850] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:55 2021] GET /identity/v3/auth/tokens => generated 3767 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:52:56.065450 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023f469-5217-425c-97b8-c94454fe6bb3 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:56.072500 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568acd5-6ac3-480b-849d-3780ff3e4c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:56.073891 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568acd5-6ac3-480b-849d-3780ff3e4c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:56.074695 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568acd5-6ac3-480b-849d-3780ff3e4c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:56.075262 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568acd5-6ac3-480b-849d-3780ff3e4c9c admin admin] PATH_INFO: `/v3/projects/ed880b2883b24f85878625acbcd9fb58` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:56.077681 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568acd5-6ac3-480b-849d-3780ff3e4c9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed880b2883b24f85878625acbcd9fb58)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:56.086632 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56fda0-548f-4056-9eca-b270ffe79634 service cinder] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:56.088761 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-4a56fda0-548f-4056-9eca-b270ffe79634 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:56.101885 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56fda0-548f-4056-9eca-b270ffe79634 service cinder] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:56.105880 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e796d8f-f543-49a2-8e89-167629da119b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:56.106514 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e796d8f-f543-49a2-8e89-167629da119b service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:56.106871 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e796d8f-f543-49a2-8e89-167629da119b service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:56.107156 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e796d8f-f543-49a2-8e89-167629da119b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:56.108936 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-8e796d8f-f543-49a2-8e89-167629da119b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:56.112452 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568acd5-6ac3-480b-849d-3780ff3e4c9c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:56.185830 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-e568acd5-6ac3-480b-849d-3780ff3e4c9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed880b2883b24f85878625acbcd9fb58', 'request_id': 'req-e568acd5-6ac3-480b-849d-3780ff3e4c9c'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:56.188692 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e796d8f-f543-49a2-8e89-167629da119b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:56.198078 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-e568acd5-6ac3-480b-849d-3780ff3e4c9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed880b2883b24f85878625acbcd9fb58', 'request_id': 'req-e568acd5-6ac3-480b-849d-3780ff3e4c9c'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:56.211884 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-e568acd5-6ac3-480b-849d-3780ff3e4c9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed880b2883b24f85878625acbcd9fb58', 'request_id': 'req-e568acd5-6ac3-480b-849d-3780ff3e4c9c'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:56.220151 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e796d8f-f543-49a2-8e89-167629da119b service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:56.226092 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-e568acd5-6ac3-480b-849d-3780ff3e4c9c admin admin] The token cache is being invalidate because project ed880b2883b24f85878625acbcd9fb58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:52:56.226340 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-e568acd5-6ac3-480b-849d-3780ff3e4c9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:56.227035 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-e568acd5-6ac3-480b-849d-3780ff3e4c9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:56.231198 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 925/1851] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:52:55 2021] DELETE /identity/v3/projects/ed880b2883b24f85878625acbcd9fb58 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:52:56.235021 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 927/1852] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:56 2021] GET /identity/v3/auth/tokens => generated 3700 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:52:56.240529 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c3c2a-8637-4c2c-aeb2-3c543c2aa2c1 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:56.241913 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c3c2a-8637-4c2c-aeb2-3c543c2aa2c1 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:56.242204 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c3c2a-8637-4c2c-aeb2-3c543c2aa2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:56.270419 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-220c3c2a-8637-4c2c-aeb2-3c543c2aa2c1 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:56.271642 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-220c3c2a-8637-4c2c-aeb2-3c543c2aa2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:56.362188 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 926/1853] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:52:56.369978 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd5cbf-855d-40a2-964a-1981517fa9e4 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:56.370541 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd5cbf-855d-40a2-964a-1981517fa9e4 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:56.371082 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd5cbf-855d-40a2-964a-1981517fa9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:56.394969 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-6edd5cbf-855d-40a2-964a-1981517fa9e4 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:56.396194 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-6edd5cbf-855d-40a2-964a-1981517fa9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:56.403481 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 928/1854] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:56.408264 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c3c2a-8637-4c2c-aeb2-3c543c2aa2c1 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:56.417513 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c3c2a-8637-4c2c-aeb2-3c543c2aa2c1 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:56.422280 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58370ee8-8966-462f-99bc-e458dfd65cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:56.422897 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58370ee8-8966-462f-99bc-e458dfd65cdc admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:56.423182 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58370ee8-8966-462f-99bc-e458dfd65cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:56.423461 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58370ee8-8966-462f-99bc-e458dfd65cdc admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:56.424145 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58370ee8-8966-462f-99bc-e458dfd65cdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:52:56.424437 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58370ee8-8966-462f-99bc-e458dfd65cdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:56.451578 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58370ee8-8966-462f-99bc-e458dfd65cdc admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:56.466830 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 927/1855] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:52:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:52:56.471921 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd5cbf-855d-40a2-964a-1981517fa9e4 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:56.481004 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd5cbf-855d-40a2-964a-1981517fa9e4 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:56.485494 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792dd634-e572-4b23-9eb5-8380e46e718e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:56.486099 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792dd634-e572-4b23-9eb5-8380e46e718e admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:56.486385 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792dd634-e572-4b23-9eb5-8380e46e718e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:56.486684 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792dd634-e572-4b23-9eb5-8380e46e718e admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:56.487318 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792dd634-e572-4b23-9eb5-8380e46e718e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:56.513110 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792dd634-e572-4b23-9eb5-8380e46e718e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:56.543465 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 929/1856] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:56 2021] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:56.547892 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58370ee8-8966-462f-99bc-e458dfd65cdc admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:56.557939 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58370ee8-8966-462f-99bc-e458dfd65cdc admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:56.626909 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f0059-c140-41a1-88dc-925fee465a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:56.627507 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f0059-c140-41a1-88dc-925fee465a15 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:56.627791 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f0059-c140-41a1-88dc-925fee465a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:56.628067 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f0059-c140-41a1-88dc-925fee465a15 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:56.628763 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f0059-c140-41a1-88dc-925fee465a15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:56.655867 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f0059-c140-41a1-88dc-925fee465a15 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:56.676543 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 928/1857] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:56 2021] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:56.680710 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792dd634-e572-4b23-9eb5-8380e46e718e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:56.692248 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792dd634-e572-4b23-9eb5-8380e46e718e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:56.697267 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d379d-a074-4baf-abea-9a48c12fbf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:56.697859 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d379d-a074-4baf-abea-9a48c12fbf1c admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:56.698145 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d379d-a074-4baf-abea-9a48c12fbf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:56.698736 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d379d-a074-4baf-abea-9a48c12fbf1c admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:56.699288 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d379d-a074-4baf-abea-9a48c12fbf1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:56.769389 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d379d-a074-4baf-abea-9a48c12fbf1c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:56.783451 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 930/1858] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:56 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:56.787502 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f0059-c140-41a1-88dc-925fee465a15 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:56.800803 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f0059-c140-41a1-88dc-925fee465a15 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:56.815269 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8870a-0ee1-48c5-9d35-775e76058160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:56.816379 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8870a-0ee1-48c5-9d35-775e76058160 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:56.816867 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8870a-0ee1-48c5-9d35-775e76058160 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:56.817458 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8870a-0ee1-48c5-9d35-775e76058160 admin admin] PATH_INFO: `/v3/projects/a896976359444af5952c3f853685c958/users/48435b918eb548aea6b5a42b34aeeef4/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:56.858425 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8870a-0ee1-48c5-9d35-775e76058160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a896976359444af5952c3f853685c958, user_id=48435b918eb548aea6b5a42b34aeeef4, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:56.886752 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8870a-0ee1-48c5-9d35-775e76058160 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:56.909286 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 929/1859] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:56 2021] PUT /identity/v3/projects/a896976359444af5952c3f853685c958/users/48435b918eb548aea6b5a42b34aeeef4/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:56.920507 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be554d4f-accf-4207-8006-73a3d2ca0860 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:56.921138 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be554d4f-accf-4207-8006-73a3d2ca0860 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:56.921362 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be554d4f-accf-4207-8006-73a3d2ca0860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:56.993108 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-be554d4f-accf-4207-8006-73a3d2ca0860 None None] MFA Rules not processed for user `48435b918eb548aea6b5a42b34aeeef4`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:56.994682 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-be554d4f-accf-4207-8006-73a3d2ca0860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:57.098069 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 931/1860] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:56 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:57.099230 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8870a-0ee1-48c5-9d35-775e76058160 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:57.141798 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be554d4f-accf-4207-8006-73a3d2ca0860 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:57.143269 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-be554d4f-accf-4207-8006-73a3d2ca0860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:57.185772 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8870a-0ee1-48c5-9d35-775e76058160 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:57.190568 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2914f-3e72-48ad-923f-1e0407bf2827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:57.191392 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2914f-3e72-48ad-923f-1e0407bf2827 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:57.191903 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2914f-3e72-48ad-923f-1e0407bf2827 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:57.192218 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2914f-3e72-48ad-923f-1e0407bf2827 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:57.192875 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2914f-3e72-48ad-923f-1e0407bf2827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:57.219159 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2914f-3e72-48ad-923f-1e0407bf2827 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:57.223294 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be554d4f-accf-4207-8006-73a3d2ca0860 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:57.227593 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b239589-cbbd-4ede-8e3f-dbfad405efce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:57.228398 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b239589-cbbd-4ede-8e3f-dbfad405efce admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:57.228688 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b239589-cbbd-4ede-8e3f-dbfad405efce admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:57.228974 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b239589-cbbd-4ede-8e3f-dbfad405efce admin admin] PATH_INFO: `/v3/users/ceb27b699af14cf2bc7dd00bcd3757da` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:57.230089 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b239589-cbbd-4ede-8e3f-dbfad405efce admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceb27b699af14cf2bc7dd00bcd3757da)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:57.247861 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 930/1861] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:52:57 2021] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:52:57.251965 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2914f-3e72-48ad-923f-1e0407bf2827 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:57.257425 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b239589-cbbd-4ede-8e3f-dbfad405efce admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:57.315766 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4b239589-cbbd-4ede-8e3f-dbfad405efce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceb27b699af14cf2bc7dd00bcd3757da'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:57.316832 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4b239589-cbbd-4ede-8e3f-dbfad405efce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceb27b699af14cf2bc7dd00bcd3757da'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:57.328450 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4b239589-cbbd-4ede-8e3f-dbfad405efce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceb27b699af14cf2bc7dd00bcd3757da'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:57.330614 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2914f-3e72-48ad-923f-1e0407bf2827 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:57.336487 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c2437-111b-47ce-a217-5d0353ea9001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:57.337234 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c2437-111b-47ce-a217-5d0353ea9001 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:57.337533 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c2437-111b-47ce-a217-5d0353ea9001 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:57.337819 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c2437-111b-47ce-a217-5d0353ea9001 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:57.338637 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c2437-111b-47ce-a217-5d0353ea9001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:57.344143 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4b239589-cbbd-4ede-8e3f-dbfad405efce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceb27b699af14cf2bc7dd00bcd3757da'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:57.352950 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4b239589-cbbd-4ede-8e3f-dbfad405efce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceb27b699af14cf2bc7dd00bcd3757da'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:57.366200 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 932/1862] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:52:57 2021] DELETE /identity/v3/users/ceb27b699af14cf2bc7dd00bcd3757da => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:52:57.366200 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd56a79-93be-42f9-a6e0-e62f9b263394 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:57.366200 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd56a79-93be-42f9-a6e0-e62f9b263394 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:57.366200 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd56a79-93be-42f9-a6e0-e62f9b263394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:57.372014 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c2437-111b-47ce-a217-5d0353ea9001 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:57.387451 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-afd56a79-93be-42f9-a6e0-e62f9b263394 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:57.388804 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-afd56a79-93be-42f9-a6e0-e62f9b263394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:57.396560 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 931/1863] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:52:57 2021] POST /identity/v3/users => generated 298 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:52:57.412328 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c2437-111b-47ce-a217-5d0353ea9001 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:57.414846 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c89c2437-111b-47ce-a217-5d0353ea9001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:57.430100 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c2437-111b-47ce-a217-5d0353ea9001 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:57.468942 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 933/1864] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:52:57.479388 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd56a79-93be-42f9-a6e0-e62f9b263394 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:57.480831 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-afd56a79-93be-42f9-a6e0-e62f9b263394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:57.520052 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67faa480-00d4-42d0-bb22-693a3008961e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:57.520790 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faa480-00d4-42d0-bb22-693a3008961e admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:57.521079 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faa480-00d4-42d0-bb22-693a3008961e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:57.521362 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faa480-00d4-42d0-bb22-693a3008961e admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:57.522203 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67faa480-00d4-42d0-bb22-693a3008961e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:57.549921 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67faa480-00d4-42d0-bb22-693a3008961e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:57.561269 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd56a79-93be-42f9-a6e0-e62f9b263394 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:57.561764 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 932/1865] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:57 2021] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:57.565589 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276770f-9eae-4e56-be9c-bbe4f4279d79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:57.565762 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67faa480-00d4-42d0-bb22-693a3008961e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:57.566184 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276770f-9eae-4e56-be9c-bbe4f4279d79 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:57.566480 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276770f-9eae-4e56-be9c-bbe4f4279d79 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:57.566830 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276770f-9eae-4e56-be9c-bbe4f4279d79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:57.576210 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67faa480-00d4-42d0-bb22-693a3008961e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:57.578119 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276770f-9eae-4e56-be9c-bbe4f4279d79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:57.581872 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63c572-3623-479a-850f-c1918e486e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:57.582717 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63c572-3623-479a-850f-c1918e486e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:57.583018 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63c572-3623-479a-850f-c1918e486e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:57.583299 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63c572-3623-479a-850f-c1918e486e92 admin admin] PATH_INFO: `/v3/projects/f647da6ce9ae4ae8b0c0ff36764313d2/users/16be116443b941269af043b2ef5dc624/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:57.603493 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba63c572-3623-479a-850f-c1918e486e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f647da6ce9ae4ae8b0c0ff36764313d2, user_id=16be116443b941269af043b2ef5dc624, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:57.604858 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276770f-9eae-4e56-be9c-bbe4f4279d79 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:57.614751 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 934/1866] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:57 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:52:57.631618 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba63c572-3623-479a-850f-c1918e486e92 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:57.646671 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 933/1867] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:57 2021] PUT /identity/v3/projects/f647da6ce9ae4ae8b0c0ff36764313d2/users/16be116443b941269af043b2ef5dc624/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:52:57.650887 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276770f-9eae-4e56-be9c-bbe4f4279d79 service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:57.660459 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276770f-9eae-4e56-be9c-bbe4f4279d79 service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:57.726214 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac3b25-ad3e-4f7b-b26c-f6ebdbd1d0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:57.726867 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac3b25-ad3e-4f7b-b26c-f6ebdbd1d0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:57.727155 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac3b25-ad3e-4f7b-b26c-f6ebdbd1d0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:57.727434 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac3b25-ad3e-4f7b-b26c-f6ebdbd1d0c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:57.728630 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac3b25-ad3e-4f7b-b26c-f6ebdbd1d0c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:57.754677 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac3b25-ad3e-4f7b-b26c-f6ebdbd1d0c5 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:57.766359 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 935/1868] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:57 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:57.770565 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63c572-3623-479a-850f-c1918e486e92 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:57.781241 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63c572-3623-479a-850f-c1918e486e92 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:57.785804 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2895b18-3ad2-4f04-9e3f-6bb1129a9a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:57.786728 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2895b18-3ad2-4f04-9e3f-6bb1129a9a1d admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:57.787085 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2895b18-3ad2-4f04-9e3f-6bb1129a9a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:57.787434 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2895b18-3ad2-4f04-9e3f-6bb1129a9a1d admin admin] PATH_INFO: `/v3/projects/f647da6ce9ae4ae8b0c0ff36764313d2/users/16be116443b941269af043b2ef5dc624/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:57.789415 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2895b18-3ad2-4f04-9e3f-6bb1129a9a1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f647da6ce9ae4ae8b0c0ff36764313d2, user_id=16be116443b941269af043b2ef5dc624, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:57.832087 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2895b18-3ad2-4f04-9e3f-6bb1129a9a1d admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:57.844741 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 934/1869] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:57 2021] PUT /identity/v3/projects/f647da6ce9ae4ae8b0c0ff36764313d2/users/16be116443b941269af043b2ef5dc624/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:52:57.848524 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac3b25-ad3e-4f7b-b26c-f6ebdbd1d0c5 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:57.861546 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac3b25-ad3e-4f7b-b26c-f6ebdbd1d0c5 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:57.933654 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c9652-0c47-4917-a7a2-4a0074169e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:57.934321 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c9652-0c47-4917-a7a2-4a0074169e76 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:57.934566 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c9652-0c47-4917-a7a2-4a0074169e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:57.934961 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c9652-0c47-4917-a7a2-4a0074169e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:57.935663 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c9652-0c47-4917-a7a2-4a0074169e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:57.963126 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c9652-0c47-4917-a7a2-4a0074169e76 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:57.980561 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 936/1870] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:52:57 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:52:57.981779 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2895b18-3ad2-4f04-9e3f-6bb1129a9a1d admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:57.994099 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2895b18-3ad2-4f04-9e3f-6bb1129a9a1d admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:57.999085 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17552788-ed42-4fa3-8eb5-fd56bfc067e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:58.000298 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17552788-ed42-4fa3-8eb5-fd56bfc067e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:58.000589 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17552788-ed42-4fa3-8eb5-fd56bfc067e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:58.000868 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17552788-ed42-4fa3-8eb5-fd56bfc067e5 admin admin] PATH_INFO: `/v3/projects/f647da6ce9ae4ae8b0c0ff36764313d2/users/16be116443b941269af043b2ef5dc624/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:58.003444 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17552788-ed42-4fa3-8eb5-fd56bfc067e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f647da6ce9ae4ae8b0c0ff36764313d2, user_id=16be116443b941269af043b2ef5dc624, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:58.010327 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c9652-0c47-4917-a7a2-4a0074169e76 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:58.012235 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-623c9652-0c47-4917-a7a2-4a0074169e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:58.029860 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c9652-0c47-4917-a7a2-4a0074169e76 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:58.034034 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17552788-ed42-4fa3-8eb5-fd56bfc067e5 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:58.037176 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d3e0e-b627-44c3-8b50-8479bd0e51da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:58.038511 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d3e0e-b627-44c3-8b50-8479bd0e51da admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:58.039102 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d3e0e-b627-44c3-8b50-8479bd0e51da admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:58.039642 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d3e0e-b627-44c3-8b50-8479bd0e51da admin admin] PATH_INFO: `/v3/projects/246a98522b8347b5bf8fcd3968800446` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:58.041073 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d3e0e-b627-44c3-8b50-8479bd0e51da admin admin] RBAC: Authorizing `identity:delete_project(project_id=246a98522b8347b5bf8fcd3968800446)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:58.054903 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 935/1871] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:52:57 2021] PUT /identity/v3/projects/f647da6ce9ae4ae8b0c0ff36764313d2/users/16be116443b941269af043b2ef5dc624/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:58.067420 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cea8c7-0d71-44aa-b0b4-0425ed684d8b None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:58.067853 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cea8c7-0d71-44aa-b0b4-0425ed684d8b None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:58.068146 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cea8c7-0d71-44aa-b0b4-0425ed684d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:58.074849 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d3e0e-b627-44c3-8b50-8479bd0e51da admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:58.111435 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-d9cea8c7-0d71-44aa-b0b4-0425ed684d8b None None] MFA Rules not processed for user `16be116443b941269af043b2ef5dc624`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:52:58.112654 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-d9cea8c7-0d71-44aa-b0b4-0425ed684d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:58.159152 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-565d3e0e-b627-44c3-8b50-8479bd0e51da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '246a98522b8347b5bf8fcd3968800446', 'request_id': 'req-565d3e0e-b627-44c3-8b50-8479bd0e51da'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:58.169496 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-565d3e0e-b627-44c3-8b50-8479bd0e51da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '246a98522b8347b5bf8fcd3968800446', 'request_id': 'req-565d3e0e-b627-44c3-8b50-8479bd0e51da'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:58.176404 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-565d3e0e-b627-44c3-8b50-8479bd0e51da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '246a98522b8347b5bf8fcd3968800446', 'request_id': 'req-565d3e0e-b627-44c3-8b50-8479bd0e51da'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:58.205495 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-565d3e0e-b627-44c3-8b50-8479bd0e51da admin admin] The token cache is being invalidate because project 246a98522b8347b5bf8fcd3968800446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:52:58.206855 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-565d3e0e-b627-44c3-8b50-8479bd0e51da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:58.208746 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-565d3e0e-b627-44c3-8b50-8479bd0e51da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:58.211927 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 937/1872] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:52:58 2021] DELETE /identity/v3/projects/246a98522b8347b5bf8fcd3968800446 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:52:58.216524 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d3e0e-b627-44c3-8b50-8479bd0e51da admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:58.219079 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-565d3e0e-b627-44c3-8b50-8479bd0e51da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:58.228581 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 936/1873] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:52:58 2021] POST /identity/v3/auth/tokens => generated 3757 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:52:58.236453 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cea8c7-0d71-44aa-b0b4-0425ed684d8b None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:58.238476 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-d9cea8c7-0d71-44aa-b0b4-0425ed684d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:58.355300 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cea8c7-0d71-44aa-b0b4-0425ed684d8b None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:58.397528 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d3e0e-b627-44c3-8b50-8479bd0e51da admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:58.407565 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2881888-bd3a-4cc2-ac9e-8eae59daef06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:58.408518 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2881888-bd3a-4cc2-ac9e-8eae59daef06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:58.408806 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2881888-bd3a-4cc2-ac9e-8eae59daef06 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:58.409084 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2881888-bd3a-4cc2-ac9e-8eae59daef06 admin admin] PATH_INFO: `/v3/users/aad0c0fbfe744941abbad909d36075ce` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:58.410321 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2881888-bd3a-4cc2-ac9e-8eae59daef06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aad0c0fbfe744941abbad909d36075ce)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:58.423556 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e6ab8-f2fe-4fc5-9494-cdb329ba44bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:58.424334 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e6ab8-f2fe-4fc5-9494-cdb329ba44bf service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:58.424630 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e6ab8-f2fe-4fc5-9494-cdb329ba44bf service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:58.425046 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e6ab8-f2fe-4fc5-9494-cdb329ba44bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:58.427651 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-1a9e6ab8-f2fe-4fc5-9494-cdb329ba44bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:58.471829 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2881888-bd3a-4cc2-ac9e-8eae59daef06 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:58.510646 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e6ab8-f2fe-4fc5-9494-cdb329ba44bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:58.539948 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e6ab8-f2fe-4fc5-9494-cdb329ba44bf service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:58.553765 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 937/1874] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:52:58 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:52:58.584262 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d2881888-bd3a-4cc2-ac9e-8eae59daef06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad0c0fbfe744941abbad909d36075ce'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:58.587002 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d2881888-bd3a-4cc2-ac9e-8eae59daef06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad0c0fbfe744941abbad909d36075ce'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:58.602472 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d2881888-bd3a-4cc2-ac9e-8eae59daef06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad0c0fbfe744941abbad909d36075ce'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:58.631626 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d2881888-bd3a-4cc2-ac9e-8eae59daef06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad0c0fbfe744941abbad909d36075ce'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:58.653949 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d2881888-bd3a-4cc2-ac9e-8eae59daef06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad0c0fbfe744941abbad909d36075ce'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:58.666066 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 938/1875] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:52:58 2021] DELETE /identity/v3/users/aad0c0fbfe744941abbad909d36075ce => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:59.417351 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e6ab8-f2fe-4fc5-9494-cdb329ba44bf service cinder] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:59.431681 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e6ab8-f2fe-4fc5-9494-cdb329ba44bf service cinder] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:59.509923 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e19f39-3413-42dd-a873-be293c52e610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:59.510951 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e19f39-3413-42dd-a873-be293c52e610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:59.511314 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e19f39-3413-42dd-a873-be293c52e610 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:59.511679 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e19f39-3413-42dd-a873-be293c52e610 admin admin] PATH_INFO: `/v3/projects/efb51e680c9f4c1288d0534c3b503f45` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:59.513065 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e19f39-3413-42dd-a873-be293c52e610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efb51e680c9f4c1288d0534c3b503f45)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:59.567674 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e19f39-3413-42dd-a873-be293c52e610 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:59.647031 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-d5e19f39-3413-42dd-a873-be293c52e610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efb51e680c9f4c1288d0534c3b503f45', 'request_id': 'req-d5e19f39-3413-42dd-a873-be293c52e610'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:59.658278 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-d5e19f39-3413-42dd-a873-be293c52e610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efb51e680c9f4c1288d0534c3b503f45', 'request_id': 'req-d5e19f39-3413-42dd-a873-be293c52e610'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:59.687473 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-d5e19f39-3413-42dd-a873-be293c52e610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efb51e680c9f4c1288d0534c3b503f45', 'request_id': 'req-d5e19f39-3413-42dd-a873-be293c52e610'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:59.710201 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-d5e19f39-3413-42dd-a873-be293c52e610 admin admin] The token cache is being invalidate because project efb51e680c9f4c1288d0534c3b503f45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:52:59.710201 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-d5e19f39-3413-42dd-a873-be293c52e610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:59.710201 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-d5e19f39-3413-42dd-a873-be293c52e610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:59.710201 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 938/1876] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:52:59 2021] DELETE /identity/v3/projects/efb51e680c9f4c1288d0534c3b503f45 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:52:59.711818 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2881888-bd3a-4cc2-ac9e-8eae59daef06 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:52:59.713171 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-d2881888-bd3a-4cc2-ac9e-8eae59daef06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:52:59.736823 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2881888-bd3a-4cc2-ac9e-8eae59daef06 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:52:59.813830 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10efae-41f0-4836-a877-c2da1245aba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:52:59.814570 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10efae-41f0-4836-a877-c2da1245aba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:52:59.815006 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10efae-41f0-4836-a877-c2da1245aba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:52:59.815297 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10efae-41f0-4836-a877-c2da1245aba7 admin admin] PATH_INFO: `/v3/users/b569f11666804cc9bbd2ad1bdfb8848c` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:52:59.817689 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10efae-41f0-4836-a877-c2da1245aba7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b569f11666804cc9bbd2ad1bdfb8848c)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:52:59.861119 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10efae-41f0-4836-a877-c2da1245aba7 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:52:59.936097 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-7c10efae-41f0-4836-a877-c2da1245aba7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b569f11666804cc9bbd2ad1bdfb8848c'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:59.937381 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-7c10efae-41f0-4836-a877-c2da1245aba7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b569f11666804cc9bbd2ad1bdfb8848c'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:59.947446 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-7c10efae-41f0-4836-a877-c2da1245aba7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b569f11666804cc9bbd2ad1bdfb8848c'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:59.960518 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-7c10efae-41f0-4836-a877-c2da1245aba7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b569f11666804cc9bbd2ad1bdfb8848c'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:59.967695 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-7c10efae-41f0-4836-a877-c2da1245aba7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b569f11666804cc9bbd2ad1bdfb8848c'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:52:59.973625 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 939/1877] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:52:59 2021] DELETE /identity/v3/users/b569f11666804cc9bbd2ad1bdfb8848c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:00.430522 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e19f39-3413-42dd-a873-be293c52e610 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:00.432539 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-d5e19f39-3413-42dd-a873-be293c52e610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:00.444679 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e19f39-3413-42dd-a873-be293c52e610 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:00.520583 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f92ed-54aa-44f2-8c47-d6181e7d2141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:00.521390 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f92ed-54aa-44f2-8c47-d6181e7d2141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:00.521678 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f92ed-54aa-44f2-8c47-d6181e7d2141 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:00.521957 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f92ed-54aa-44f2-8c47-d6181e7d2141 admin admin] PATH_INFO: `/v3/projects/e9c171da84fc43cf9ac53c3efc556dbe` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:00.523067 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f92ed-54aa-44f2-8c47-d6181e7d2141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9c171da84fc43cf9ac53c3efc556dbe)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:00.549035 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f92ed-54aa-44f2-8c47-d6181e7d2141 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:00.598072 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-f83f92ed-54aa-44f2-8c47-d6181e7d2141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9c171da84fc43cf9ac53c3efc556dbe', 'request_id': 'req-f83f92ed-54aa-44f2-8c47-d6181e7d2141'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:00.604885 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-f83f92ed-54aa-44f2-8c47-d6181e7d2141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9c171da84fc43cf9ac53c3efc556dbe', 'request_id': 'req-f83f92ed-54aa-44f2-8c47-d6181e7d2141'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:00.616499 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-f83f92ed-54aa-44f2-8c47-d6181e7d2141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9c171da84fc43cf9ac53c3efc556dbe', 'request_id': 'req-f83f92ed-54aa-44f2-8c47-d6181e7d2141'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:00.626820 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-f83f92ed-54aa-44f2-8c47-d6181e7d2141 admin admin] The token cache is being invalidate because project e9c171da84fc43cf9ac53c3efc556dbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:53:00.627171 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-f83f92ed-54aa-44f2-8c47-d6181e7d2141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:00.627885 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-f83f92ed-54aa-44f2-8c47-d6181e7d2141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:00.629563 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 939/1878] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:53:00 2021] DELETE /identity/v3/projects/e9c171da84fc43cf9ac53c3efc556dbe => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:00.636523 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb7b71-4af7-4231-b9cb-f05d0073e5ea None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:00.636813 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb7b71-4af7-4231-b9cb-f05d0073e5ea None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:00.637092 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb7b71-4af7-4231-b9cb-f05d0073e5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:00.660507 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-56bb7b71-4af7-4231-b9cb-f05d0073e5ea None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:00.661678 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-56bb7b71-4af7-4231-b9cb-f05d0073e5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:00.743463 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 940/1879] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:00.752018 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b60358-925c-4237-986f-6849f9fdb9c8 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:00.752395 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b60358-925c-4237-986f-6849f9fdb9c8 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:00.752685 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b60358-925c-4237-986f-6849f9fdb9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:00.791283 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-21b60358-925c-4237-986f-6849f9fdb9c8 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:00.792597 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-21b60358-925c-4237-986f-6849f9fdb9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:00.804267 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 940/1880] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:00.808283 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb7b71-4af7-4231-b9cb-f05d0073e5ea None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:00.829774 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb7b71-4af7-4231-b9cb-f05d0073e5ea None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:00.834543 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7988b-a5bf-40de-87a8-a5d68118585a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:00.835268 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7988b-a5bf-40de-87a8-a5d68118585a admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:00.835560 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7988b-a5bf-40de-87a8-a5d68118585a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:00.835887 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7988b-a5bf-40de-87a8-a5d68118585a admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:00.836649 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7988b-a5bf-40de-87a8-a5d68118585a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:53:00.837371 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7988b-a5bf-40de-87a8-a5d68118585a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:00.868989 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7988b-a5bf-40de-87a8-a5d68118585a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:00.900125 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 941/1881] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:53:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:53:00.904405 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b60358-925c-4237-986f-6849f9fdb9c8 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:00.918761 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b60358-925c-4237-986f-6849f9fdb9c8 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:00.929173 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f336e00-2256-42f0-904d-55ae0d89bf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:00.929829 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f336e00-2256-42f0-904d-55ae0d89bf4a admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:00.930046 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f336e00-2256-42f0-904d-55ae0d89bf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:00.930327 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f336e00-2256-42f0-904d-55ae0d89bf4a admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:00.931106 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f336e00-2256-42f0-904d-55ae0d89bf4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:01.004445 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f336e00-2256-42f0-904d-55ae0d89bf4a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:01.067568 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 941/1882] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:53:00 2021] POST /identity/v3/projects => generated 367 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:01.072351 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7988b-a5bf-40de-87a8-a5d68118585a admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:01.089368 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7988b-a5bf-40de-87a8-a5d68118585a admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:01.197996 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad7fe3-8767-48ec-8467-818371828a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:01.201506 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad7fe3-8767-48ec-8467-818371828a76 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:01.204713 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad7fe3-8767-48ec-8467-818371828a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:01.205236 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad7fe3-8767-48ec-8467-818371828a76 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:01.206436 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad7fe3-8767-48ec-8467-818371828a76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:01.258482 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad7fe3-8767-48ec-8467-818371828a76 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:01.287003 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 942/1883] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:53:01 2021] POST /identity/v3/users => generated 284 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:01.292485 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f336e00-2256-42f0-904d-55ae0d89bf4a admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:01.308998 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f336e00-2256-42f0-904d-55ae0d89bf4a admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:01.315818 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2efad2-6c09-4971-b739-7fef1e8867e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:01.316787 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2efad2-6c09-4971-b739-7fef1e8867e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:01.317343 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2efad2-6c09-4971-b739-7fef1e8867e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:01.317802 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2efad2-6c09-4971-b739-7fef1e8867e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:01.318754 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2efad2-6c09-4971-b739-7fef1e8867e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:01.350430 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2efad2-6c09-4971-b739-7fef1e8867e3 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:01.361696 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 942/1884] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:01 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:53:01.365713 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad7fe3-8767-48ec-8467-818371828a76 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:01.376611 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad7fe3-8767-48ec-8467-818371828a76 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:01.382238 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e343bbf-ab18-4aa6-aae6-427501608e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:01.383352 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e343bbf-ab18-4aa6-aae6-427501608e3a admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:01.383914 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e343bbf-ab18-4aa6-aae6-427501608e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:01.384198 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e343bbf-ab18-4aa6-aae6-427501608e3a admin admin] PATH_INFO: `/v3/projects/94ceb79f01bf4bcfaf39be1b48e6e831/users/74443b5931a44ecd93e95edb7349e913/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:01.408162 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e343bbf-ab18-4aa6-aae6-427501608e3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=94ceb79f01bf4bcfaf39be1b48e6e831, user_id=74443b5931a44ecd93e95edb7349e913, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:01.435628 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e343bbf-ab18-4aa6-aae6-427501608e3a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:01.454700 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 943/1885] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:01 2021] PUT /identity/v3/projects/94ceb79f01bf4bcfaf39be1b48e6e831/users/74443b5931a44ecd93e95edb7349e913/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:01.463389 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384eb4c-fe1f-4216-924c-65ecf52bba24 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:01.463808 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384eb4c-fe1f-4216-924c-65ecf52bba24 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:01.463963 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384eb4c-fe1f-4216-924c-65ecf52bba24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:01.506781 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-2384eb4c-fe1f-4216-924c-65ecf52bba24 None None] MFA Rules not processed for user `74443b5931a44ecd93e95edb7349e913`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:01.508260 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-2384eb4c-fe1f-4216-924c-65ecf52bba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:01.619684 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 943/1886] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:01 2021] POST /identity/v3/auth/tokens => generated 3674 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:01.623645 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e343bbf-ab18-4aa6-aae6-427501608e3a admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:01.702794 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e343bbf-ab18-4aa6-aae6-427501608e3a admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:01.707360 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0428f7-f082-4ebe-b3cc-5f5e2f3c457a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:01.708235 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0428f7-f082-4ebe-b3cc-5f5e2f3c457a admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:01.708635 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0428f7-f082-4ebe-b3cc-5f5e2f3c457a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:01.709007 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0428f7-f082-4ebe-b3cc-5f5e2f3c457a admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:01.709750 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0428f7-f082-4ebe-b3cc-5f5e2f3c457a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:01.736049 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0428f7-f082-4ebe-b3cc-5f5e2f3c457a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:01.767552 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 944/1887] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:53:01 2021] POST /identity/v3/projects => generated 363 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:01.769393 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384eb4c-fe1f-4216-924c-65ecf52bba24 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:01.782298 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384eb4c-fe1f-4216-924c-65ecf52bba24 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:01.851964 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04adf6f9-fd84-47ad-8d06-b5c247e8cdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:01.852751 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adf6f9-fd84-47ad-8d06-b5c247e8cdb8 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:01.853185 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adf6f9-fd84-47ad-8d06-b5c247e8cdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:01.853612 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adf6f9-fd84-47ad-8d06-b5c247e8cdb8 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:01.854428 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04adf6f9-fd84-47ad-8d06-b5c247e8cdb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:01.882040 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04adf6f9-fd84-47ad-8d06-b5c247e8cdb8 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:01.902873 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 944/1888] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:53:01 2021] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:01.907326 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0428f7-f082-4ebe-b3cc-5f5e2f3c457a admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:01.917611 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0428f7-f082-4ebe-b3cc-5f5e2f3c457a admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:01.923243 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d83d52-4e1c-410f-a021-4dbf3594edc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:01.923623 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d83d52-4e1c-410f-a021-4dbf3594edc1 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:01.924381 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d83d52-4e1c-410f-a021-4dbf3594edc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:01.924795 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d83d52-4e1c-410f-a021-4dbf3594edc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:01.925593 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d83d52-4e1c-410f-a021-4dbf3594edc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:01.952859 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d83d52-4e1c-410f-a021-4dbf3594edc1 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:01.964915 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 945/1889] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:01 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:53:01.969847 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04adf6f9-fd84-47ad-8d06-b5c247e8cdb8 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:01.983634 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04adf6f9-fd84-47ad-8d06-b5c247e8cdb8 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:01.989131 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c25207-e6db-4a06-8663-9270b53c00db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:01.990062 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c25207-e6db-4a06-8663-9270b53c00db admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:01.990353 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c25207-e6db-4a06-8663-9270b53c00db admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:01.990639 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c25207-e6db-4a06-8663-9270b53c00db admin admin] PATH_INFO: `/v3/projects/80fac23c7c7a49618c7a6cca7d3e383f/users/7e22c686415d49718f0126a76a296c69/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:02.018529 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c25207-e6db-4a06-8663-9270b53c00db admin admin] RBAC: Authorizing `identity:create_grant(project_id=80fac23c7c7a49618c7a6cca7d3e383f, user_id=7e22c686415d49718f0126a76a296c69, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:02.046768 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c25207-e6db-4a06-8663-9270b53c00db admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:02.059729 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 945/1890] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:01 2021] PUT /identity/v3/projects/80fac23c7c7a49618c7a6cca7d3e383f/users/7e22c686415d49718f0126a76a296c69/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:02.064081 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d83d52-4e1c-410f-a021-4dbf3594edc1 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:02.074831 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d83d52-4e1c-410f-a021-4dbf3594edc1 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:02.160335 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eee9af-3276-4b51-9f70-b95c20cb7b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:02.160996 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eee9af-3276-4b51-9f70-b95c20cb7b6b admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:02.161385 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eee9af-3276-4b51-9f70-b95c20cb7b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:02.161874 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eee9af-3276-4b51-9f70-b95c20cb7b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:02.162875 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eee9af-3276-4b51-9f70-b95c20cb7b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:02.207019 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eee9af-3276-4b51-9f70-b95c20cb7b6b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:02.227676 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 946/1891] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:02 2021] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:53:02.231822 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c25207-e6db-4a06-8663-9270b53c00db admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:02.252121 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c25207-e6db-4a06-8663-9270b53c00db admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:02.256688 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204112e-1fcf-45d3-b6f6-4d99b3b5af6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:02.257666 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204112e-1fcf-45d3-b6f6-4d99b3b5af6f admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:02.258089 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204112e-1fcf-45d3-b6f6-4d99b3b5af6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:02.258507 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204112e-1fcf-45d3-b6f6-4d99b3b5af6f admin admin] PATH_INFO: `/v3/projects/80fac23c7c7a49618c7a6cca7d3e383f/users/7e22c686415d49718f0126a76a296c69/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:02.260984 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204112e-1fcf-45d3-b6f6-4d99b3b5af6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=80fac23c7c7a49618c7a6cca7d3e383f, user_id=7e22c686415d49718f0126a76a296c69, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:02.289607 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204112e-1fcf-45d3-b6f6-4d99b3b5af6f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:02.301106 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 946/1892] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:02 2021] PUT /identity/v3/projects/80fac23c7c7a49618c7a6cca7d3e383f/users/7e22c686415d49718f0126a76a296c69/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:02.305691 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eee9af-3276-4b51-9f70-b95c20cb7b6b admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:02.317051 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eee9af-3276-4b51-9f70-b95c20cb7b6b admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:02.389406 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b5d05-8612-44a2-adc3-d75069dc842e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:02.390042 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b5d05-8612-44a2-adc3-d75069dc842e admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:02.390408 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b5d05-8612-44a2-adc3-d75069dc842e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:02.390722 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b5d05-8612-44a2-adc3-d75069dc842e admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:02.391505 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b5d05-8612-44a2-adc3-d75069dc842e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:02.425344 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b5d05-8612-44a2-adc3-d75069dc842e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:02.437871 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 947/1893] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:02 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:53:02.441982 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204112e-1fcf-45d3-b6f6-4d99b3b5af6f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:02.466735 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204112e-1fcf-45d3-b6f6-4d99b3b5af6f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:02.477432 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db666c-0621-416a-a6be-bc7d3c7deaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:02.479146 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db666c-0621-416a-a6be-bc7d3c7deaf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:02.480593 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db666c-0621-416a-a6be-bc7d3c7deaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:02.480885 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db666c-0621-416a-a6be-bc7d3c7deaf3 admin admin] PATH_INFO: `/v3/projects/80fac23c7c7a49618c7a6cca7d3e383f/users/7e22c686415d49718f0126a76a296c69/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:02.487539 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db666c-0621-416a-a6be-bc7d3c7deaf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80fac23c7c7a49618c7a6cca7d3e383f, user_id=7e22c686415d49718f0126a76a296c69, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:02.501775 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b5d05-8612-44a2-adc3-d75069dc842e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:02.503844 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-4d2b5d05-8612-44a2-adc3-d75069dc842e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:02.519662 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b5d05-8612-44a2-adc3-d75069dc842e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:02.536124 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04ba90-8ba3-4a07-b19e-60ea50a22fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:02.537024 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04ba90-8ba3-4a07-b19e-60ea50a22fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:02.537575 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04ba90-8ba3-4a07-b19e-60ea50a22fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:02.538086 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04ba90-8ba3-4a07-b19e-60ea50a22fe0 admin admin] PATH_INFO: `/v3/users/2c8bea1c5fc7492a8a92acf349dfedae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:02.539623 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04ba90-8ba3-4a07-b19e-60ea50a22fe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c8bea1c5fc7492a8a92acf349dfedae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:02.550616 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db666c-0621-416a-a6be-bc7d3c7deaf3 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:02.585452 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 947/1894] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:02 2021] PUT /identity/v3/projects/80fac23c7c7a49618c7a6cca7d3e383f/users/7e22c686415d49718f0126a76a296c69/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:53:02.586546 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04ba90-8ba3-4a07-b19e-60ea50a22fe0 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:02.598433 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3fa6a-fdcf-46a4-adac-8bcf059acc3d None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:02.598909 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3fa6a-fdcf-46a4-adac-8bcf059acc3d None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:02.599333 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3fa6a-fdcf-46a4-adac-8bcf059acc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:02.675308 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-fac3fa6a-fdcf-46a4-adac-8bcf059acc3d None None] MFA Rules not processed for user `7e22c686415d49718f0126a76a296c69`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:02.676739 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-fac3fa6a-fdcf-46a4-adac-8bcf059acc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:02.690802 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-fe04ba90-8ba3-4a07-b19e-60ea50a22fe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c8bea1c5fc7492a8a92acf349dfedae'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:02.691458 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-fe04ba90-8ba3-4a07-b19e-60ea50a22fe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c8bea1c5fc7492a8a92acf349dfedae'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:02.711343 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-fe04ba90-8ba3-4a07-b19e-60ea50a22fe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c8bea1c5fc7492a8a92acf349dfedae'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:02.724812 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-fe04ba90-8ba3-4a07-b19e-60ea50a22fe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c8bea1c5fc7492a8a92acf349dfedae'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:02.746923 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-fe04ba90-8ba3-4a07-b19e-60ea50a22fe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c8bea1c5fc7492a8a92acf349dfedae'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:02.758873 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 948/1895] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:53:02 2021] DELETE /identity/v3/users/2c8bea1c5fc7492a8a92acf349dfedae => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:02.763892 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055f6d4-dc92-4248-ac1e-ad8d0ecfbe9e None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:02.764703 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055f6d4-dc92-4248-ac1e-ad8d0ecfbe9e None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:02.765004 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055f6d4-dc92-4248-ac1e-ad8d0ecfbe9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:02.767385 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 948/1896] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:02 2021] POST /identity/v3/auth/tokens => generated 3737 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:53:02.778629 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3fa6a-fdcf-46a4-adac-8bcf059acc3d None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:02.780914 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-fac3fa6a-fdcf-46a4-adac-8bcf059acc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:02.806877 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-2055f6d4-dc92-4248-ac1e-ad8d0ecfbe9e None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:02.808026 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-2055f6d4-dc92-4248-ac1e-ad8d0ecfbe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:02.872771 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3fa6a-fdcf-46a4-adac-8bcf059acc3d None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:02.939038 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 949/1897] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:02.949592 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055f6d4-dc92-4248-ac1e-ad8d0ecfbe9e None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:02.951217 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-2055f6d4-dc92-4248-ac1e-ad8d0ecfbe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:02.958535 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f4b0c-98d6-4aec-a0a0-503ea3a2c79a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:02.959558 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f4b0c-98d6-4aec-a0a0-503ea3a2c79a service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:02.959857 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f4b0c-98d6-4aec-a0a0-503ea3a2c79a service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:02.960144 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f4b0c-98d6-4aec-a0a0-503ea3a2c79a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:03.043959 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f4b0c-98d6-4aec-a0a0-503ea3a2c79a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:03.072581 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f4b0c-98d6-4aec-a0a0-503ea3a2c79a service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:03.083857 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 949/1898] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:02 2021] GET /identity/v3/auth/tokens => generated 3737 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:53:03.121377 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055f6d4-dc92-4248-ac1e-ad8d0ecfbe9e None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:03.125780 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae84e47-86cf-48c4-b947-cf51e381d8e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:03.126517 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae84e47-86cf-48c4-b947-cf51e381d8e0 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:03.126923 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae84e47-86cf-48c4-b947-cf51e381d8e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:03.127266 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae84e47-86cf-48c4-b947-cf51e381d8e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:03.138706 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae84e47-86cf-48c4-b947-cf51e381d8e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:03.164892 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae84e47-86cf-48c4-b947-cf51e381d8e0 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:03.175368 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 950/1899] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:02 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:53:03.206617 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f4b0c-98d6-4aec-a0a0-503ea3a2c79a service cinder] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:03.215458 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f4b0c-98d6-4aec-a0a0-503ea3a2c79a service cinder] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:03.220627 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e8135-2c08-4dfb-8eb6-02ad75a09f64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:03.221605 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e8135-2c08-4dfb-8eb6-02ad75a09f64 service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:03.221605 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e8135-2c08-4dfb-8eb6-02ad75a09f64 service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:03.221909 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e8135-2c08-4dfb-8eb6-02ad75a09f64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:03.223560 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-d67e8135-2c08-4dfb-8eb6-02ad75a09f64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:03.309806 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e8135-2c08-4dfb-8eb6-02ad75a09f64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:03.345953 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e8135-2c08-4dfb-8eb6-02ad75a09f64 service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:03.376118 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 950/1900] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:03 2021] GET /identity/v3/auth/tokens => generated 3674 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:53:03.742073 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae84e47-86cf-48c4-b947-cf51e381d8e0 service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:03.743660 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-8ae84e47-86cf-48c4-b947-cf51e381d8e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:03.774456 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae84e47-86cf-48c4-b947-cf51e381d8e0 service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:03.793936 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6c1df-878d-4937-97fb-5678706dec2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:03.794737 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6c1df-878d-4937-97fb-5678706dec2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:03.795225 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6c1df-878d-4937-97fb-5678706dec2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:03.795944 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6c1df-878d-4937-97fb-5678706dec2c admin admin] PATH_INFO: `/v3/projects/5fb4fdf5c4a8422ea29a45b55b5deaaf` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:03.797358 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6c1df-878d-4937-97fb-5678706dec2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fb4fdf5c4a8422ea29a45b55b5deaaf)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:03.871523 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6c1df-878d-4937-97fb-5678706dec2c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:03.961149 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f6e6c1df-878d-4937-97fb-5678706dec2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fb4fdf5c4a8422ea29a45b55b5deaaf', 'request_id': 'req-f6e6c1df-878d-4937-97fb-5678706dec2c'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:03.973147 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f6e6c1df-878d-4937-97fb-5678706dec2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fb4fdf5c4a8422ea29a45b55b5deaaf', 'request_id': 'req-f6e6c1df-878d-4937-97fb-5678706dec2c'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:03.982423 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f6e6c1df-878d-4937-97fb-5678706dec2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fb4fdf5c4a8422ea29a45b55b5deaaf', 'request_id': 'req-f6e6c1df-878d-4937-97fb-5678706dec2c'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:04.002262 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f6e6c1df-878d-4937-97fb-5678706dec2c admin admin] The token cache is being invalidate because project 5fb4fdf5c4a8422ea29a45b55b5deaaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:53:04.002812 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f6e6c1df-878d-4937-97fb-5678706dec2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:04.004258 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f6e6c1df-878d-4937-97fb-5678706dec2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:04.011167 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 951/1901] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:53:03 2021] DELETE /identity/v3/projects/5fb4fdf5c4a8422ea29a45b55b5deaaf => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:04.012338 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e8135-2c08-4dfb-8eb6-02ad75a09f64 service cinder] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:04.026753 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e8135-2c08-4dfb-8eb6-02ad75a09f64 service cinder] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:04.105624 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf75dce-8005-4478-8d03-258acb1a65d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:04.106430 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf75dce-8005-4478-8d03-258acb1a65d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:04.106752 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf75dce-8005-4478-8d03-258acb1a65d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:04.107036 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf75dce-8005-4478-8d03-258acb1a65d2 admin admin] PATH_INFO: `/v3/users/94fe814d31d849f3a15d95f628b6b32b` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:04.108636 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf75dce-8005-4478-8d03-258acb1a65d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94fe814d31d849f3a15d95f628b6b32b)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:04.136118 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf75dce-8005-4478-8d03-258acb1a65d2 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:04.201750 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-dcf75dce-8005-4478-8d03-258acb1a65d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94fe814d31d849f3a15d95f628b6b32b'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:04.216247 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-dcf75dce-8005-4478-8d03-258acb1a65d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94fe814d31d849f3a15d95f628b6b32b'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:04.217118 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-dcf75dce-8005-4478-8d03-258acb1a65d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94fe814d31d849f3a15d95f628b6b32b'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:04.227105 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-dcf75dce-8005-4478-8d03-258acb1a65d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94fe814d31d849f3a15d95f628b6b32b'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:04.238767 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-dcf75dce-8005-4478-8d03-258acb1a65d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94fe814d31d849f3a15d95f628b6b32b'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:04.245722 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 951/1902] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:53:04 2021] DELETE /identity/v3/users/94fe814d31d849f3a15d95f628b6b32b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:53:04.738697 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6c1df-878d-4937-97fb-5678706dec2c admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:04.744652 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-f6e6c1df-878d-4937-97fb-5678706dec2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:04.767485 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6c1df-878d-4937-97fb-5678706dec2c admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:04.850065 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df8595-cb7e-4ca5-a208-70457a53c06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:04.860441 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df8595-cb7e-4ca5-a208-70457a53c06a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:04.860734 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df8595-cb7e-4ca5-a208-70457a53c06a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:04.861020 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df8595-cb7e-4ca5-a208-70457a53c06a admin admin] PATH_INFO: `/v3/projects/1374c4d811684d189605d39682c10793` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:04.866064 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df8595-cb7e-4ca5-a208-70457a53c06a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1374c4d811684d189605d39682c10793)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:04.925648 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df8595-cb7e-4ca5-a208-70457a53c06a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:05.011709 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-26df8595-cb7e-4ca5-a208-70457a53c06a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1374c4d811684d189605d39682c10793', 'request_id': 'req-26df8595-cb7e-4ca5-a208-70457a53c06a'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:05.024212 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-26df8595-cb7e-4ca5-a208-70457a53c06a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1374c4d811684d189605d39682c10793', 'request_id': 'req-26df8595-cb7e-4ca5-a208-70457a53c06a'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:05.031295 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-26df8595-cb7e-4ca5-a208-70457a53c06a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1374c4d811684d189605d39682c10793', 'request_id': 'req-26df8595-cb7e-4ca5-a208-70457a53c06a'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:05.054022 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-26df8595-cb7e-4ca5-a208-70457a53c06a admin admin] The token cache is being invalidate because project 1374c4d811684d189605d39682c10793 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:53:05.054373 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-26df8595-cb7e-4ca5-a208-70457a53c06a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:05.055026 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-26df8595-cb7e-4ca5-a208-70457a53c06a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:05.056714 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 952/1903] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:53:04 2021] DELETE /identity/v3/projects/1374c4d811684d189605d39682c10793 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:05.062261 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ce6fd-5090-4f68-8be7-d61713c28909 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:05.062701 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ce6fd-5090-4f68-8be7-d61713c28909 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:05.063000 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ce6fd-5090-4f68-8be7-d61713c28909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:05.086645 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-6a4ce6fd-5090-4f68-8be7-d61713c28909 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:05.087918 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-6a4ce6fd-5090-4f68-8be7-d61713c28909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:05.156062 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 952/1904] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:05.165112 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59a7a7-8ea8-45cf-b3f2-b18332b41dac None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:05.165411 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59a7a7-8ea8-45cf-b3f2-b18332b41dac None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:05.165696 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59a7a7-8ea8-45cf-b3f2-b18332b41dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:05.189728 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-fb59a7a7-8ea8-45cf-b3f2-b18332b41dac None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:05.191025 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-fb59a7a7-8ea8-45cf-b3f2-b18332b41dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:05.199057 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 953/1905] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:05.203500 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ce6fd-5090-4f68-8be7-d61713c28909 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:05.213294 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ce6fd-5090-4f68-8be7-d61713c28909 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:05.219599 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758b20b-aad2-4186-98fc-3d31ad727484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:05.220196 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758b20b-aad2-4186-98fc-3d31ad727484 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:05.220482 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758b20b-aad2-4186-98fc-3d31ad727484 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:05.220765 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758b20b-aad2-4186-98fc-3d31ad727484 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:05.221449 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758b20b-aad2-4186-98fc-3d31ad727484 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:53:05.221742 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758b20b-aad2-4186-98fc-3d31ad727484 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:05.249887 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758b20b-aad2-4186-98fc-3d31ad727484 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:05.263672 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 953/1906] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:53:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:53:05.268079 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59a7a7-8ea8-45cf-b3f2-b18332b41dac None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:05.280602 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59a7a7-8ea8-45cf-b3f2-b18332b41dac None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:05.285916 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d5c93-370e-4775-a93e-8c5ba21ad618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:05.286922 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d5c93-370e-4775-a93e-8c5ba21ad618 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:05.288505 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d5c93-370e-4775-a93e-8c5ba21ad618 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:05.288923 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d5c93-370e-4775-a93e-8c5ba21ad618 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:05.289823 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d5c93-370e-4775-a93e-8c5ba21ad618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:05.321372 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d5c93-370e-4775-a93e-8c5ba21ad618 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:05.357937 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 954/1907] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:53:05 2021] POST /identity/v3/projects => generated 385 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:53:05.359134 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758b20b-aad2-4186-98fc-3d31ad727484 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:05.370906 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758b20b-aad2-4186-98fc-3d31ad727484 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:05.458329 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780987c-d632-4ea7-9c96-4c6cb4980f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:05.458998 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780987c-d632-4ea7-9c96-4c6cb4980f5e admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:05.459345 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780987c-d632-4ea7-9c96-4c6cb4980f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:05.459811 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780987c-d632-4ea7-9c96-4c6cb4980f5e admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:05.460594 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780987c-d632-4ea7-9c96-4c6cb4980f5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:05.497208 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780987c-d632-4ea7-9c96-4c6cb4980f5e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:05.519331 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 954/1908] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:53:05 2021] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:05.524097 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d5c93-370e-4775-a93e-8c5ba21ad618 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:05.537025 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d5c93-370e-4775-a93e-8c5ba21ad618 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:05.541883 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862dc2f-51f4-44c6-930a-f241e6a11536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:05.542620 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862dc2f-51f4-44c6-930a-f241e6a11536 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:05.542949 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862dc2f-51f4-44c6-930a-f241e6a11536 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:05.543287 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862dc2f-51f4-44c6-930a-f241e6a11536 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:05.543979 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862dc2f-51f4-44c6-930a-f241e6a11536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:05.571484 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862dc2f-51f4-44c6-930a-f241e6a11536 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:05.584640 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 955/1909] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:05 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:53:05.590695 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780987c-d632-4ea7-9c96-4c6cb4980f5e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:05.617433 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780987c-d632-4ea7-9c96-4c6cb4980f5e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:05.630577 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aef58b-0caf-471d-92a6-f6b536db2d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:05.631580 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aef58b-0caf-471d-92a6-f6b536db2d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:05.631880 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aef58b-0caf-471d-92a6-f6b536db2d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:05.632290 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aef58b-0caf-471d-92a6-f6b536db2d71 admin admin] PATH_INFO: `/v3/projects/8f20e8ee53534ab0a8c738f3d28865d9/users/ec8b21b0652a431baa6e9fa8d9d63a59/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:05.655823 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aef58b-0caf-471d-92a6-f6b536db2d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f20e8ee53534ab0a8c738f3d28865d9, user_id=ec8b21b0652a431baa6e9fa8d9d63a59, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:05.683219 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aef58b-0caf-471d-92a6-f6b536db2d71 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:05.702478 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 955/1910] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:05 2021] PUT /identity/v3/projects/8f20e8ee53534ab0a8c738f3d28865d9/users/ec8b21b0652a431baa6e9fa8d9d63a59/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:05.712486 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3248d8-d129-42c0-bcdc-b577a3993a2e None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:05.712784 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3248d8-d129-42c0-bcdc-b577a3993a2e None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:05.713069 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3248d8-d129-42c0-bcdc-b577a3993a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:05.753389 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-3e3248d8-d129-42c0-bcdc-b577a3993a2e None None] MFA Rules not processed for user `ec8b21b0652a431baa6e9fa8d9d63a59`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:05.754605 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-3e3248d8-d129-42c0-bcdc-b577a3993a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:05.843524 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 956/1911] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:05 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:05.848104 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aef58b-0caf-471d-92a6-f6b536db2d71 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:05.921400 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aef58b-0caf-471d-92a6-f6b536db2d71 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:05.925894 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d8e41-d4f9-4019-a2c1-ff85389b55a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:05.926619 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d8e41-d4f9-4019-a2c1-ff85389b55a4 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:05.926932 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d8e41-d4f9-4019-a2c1-ff85389b55a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:05.927209 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d8e41-d4f9-4019-a2c1-ff85389b55a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:05.927832 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d8e41-d4f9-4019-a2c1-ff85389b55a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:05.953404 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d8e41-d4f9-4019-a2c1-ff85389b55a4 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:05.980435 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 956/1912] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:53:05 2021] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:05.985447 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3248d8-d129-42c0-bcdc-b577a3993a2e None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:05.995886 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3248d8-d129-42c0-bcdc-b577a3993a2e None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:06.059979 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e1d39-6b30-4a77-994d-75013db24aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:06.060500 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e1d39-6b30-4a77-994d-75013db24aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:06.060785 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e1d39-6b30-4a77-994d-75013db24aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:06.061106 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e1d39-6b30-4a77-994d-75013db24aa4 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:06.061756 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e1d39-6b30-4a77-994d-75013db24aa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:06.088466 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e1d39-6b30-4a77-994d-75013db24aa4 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:06.126203 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 957/1913] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:53:05 2021] POST /identity/v3/users => generated 300 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:53:06.130350 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d8e41-d4f9-4019-a2c1-ff85389b55a4 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:06.145100 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d8e41-d4f9-4019-a2c1-ff85389b55a4 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:06.168804 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e1d39-6b30-4a77-994d-75013db24aa4 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:06.170387 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f83ea3-012c-428e-9683-dd05026f2c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:06.171019 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-291e1d39-6b30-4a77-994d-75013db24aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:06.171395 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f83ea3-012c-428e-9683-dd05026f2c75 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:06.172147 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f83ea3-012c-428e-9683-dd05026f2c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:06.172439 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f83ea3-012c-428e-9683-dd05026f2c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:06.173150 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f83ea3-012c-428e-9683-dd05026f2c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:06.190264 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e1d39-6b30-4a77-994d-75013db24aa4 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:06.204290 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5bd54-02e1-43e2-a1e1-8482bba65dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:06.205106 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5bd54-02e1-43e2-a1e1-8482bba65dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:06.206510 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5bd54-02e1-43e2-a1e1-8482bba65dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:06.207011 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5bd54-02e1-43e2-a1e1-8482bba65dd5 admin admin] PATH_INFO: `/v3/users/ef0e68fc30ba42f1a78961795f075444` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:06.210162 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5bd54-02e1-43e2-a1e1-8482bba65dd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef0e68fc30ba42f1a78961795f075444)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:06.238165 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f83ea3-012c-428e-9683-dd05026f2c75 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:06.265987 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 957/1914] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:06 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:53:06.270107 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f83ea3-012c-428e-9683-dd05026f2c75 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:06.273658 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5bd54-02e1-43e2-a1e1-8482bba65dd5 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:06.286989 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f83ea3-012c-428e-9683-dd05026f2c75 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:06.300801 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c1de2-dcd2-42ad-bb28-fd2a58267aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:06.301634 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c1de2-dcd2-42ad-bb28-fd2a58267aea admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:06.301918 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c1de2-dcd2-42ad-bb28-fd2a58267aea admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:06.302368 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c1de2-dcd2-42ad-bb28-fd2a58267aea admin admin] PATH_INFO: `/v3/projects/1497420479da4d2f9314b4fa9689768f/users/40354ae7f09d42db91c20dc48cd58450/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:06.339778 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c1de2-dcd2-42ad-bb28-fd2a58267aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=1497420479da4d2f9314b4fa9689768f, user_id=40354ae7f09d42db91c20dc48cd58450, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:06.381544 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d2b5bd54-02e1-43e2-a1e1-8482bba65dd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef0e68fc30ba42f1a78961795f075444'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:06.383041 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d2b5bd54-02e1-43e2-a1e1-8482bba65dd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef0e68fc30ba42f1a78961795f075444'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:06.407198 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d2b5bd54-02e1-43e2-a1e1-8482bba65dd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef0e68fc30ba42f1a78961795f075444'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:06.410913 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c1de2-dcd2-42ad-bb28-fd2a58267aea admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:06.430227 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d2b5bd54-02e1-43e2-a1e1-8482bba65dd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef0e68fc30ba42f1a78961795f075444'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:06.439427 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 958/1915] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:06 2021] PUT /identity/v3/projects/1497420479da4d2f9314b4fa9689768f/users/40354ae7f09d42db91c20dc48cd58450/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:53:06.441540 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c1de2-dcd2-42ad-bb28-fd2a58267aea admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:06.455452 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d2b5bd54-02e1-43e2-a1e1-8482bba65dd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef0e68fc30ba42f1a78961795f075444'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:06.469923 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 958/1916] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:53:06 2021] DELETE /identity/v3/users/ef0e68fc30ba42f1a78961795f075444 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:53:06.472034 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9f85c-e947-4b8c-80b2-43a56377f6a2 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:06.472744 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9f85c-e947-4b8c-80b2-43a56377f6a2 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:06.473225 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9f85c-e947-4b8c-80b2-43a56377f6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:06.498578 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-91e9f85c-e947-4b8c-80b2-43a56377f6a2 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:06.500493 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-91e9f85c-e947-4b8c-80b2-43a56377f6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:06.557730 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c1de2-dcd2-42ad-bb28-fd2a58267aea admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:06.591577 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 959/1917] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:06.593042 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9f85c-e947-4b8c-80b2-43a56377f6a2 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:06.595429 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-91e9f85c-e947-4b8c-80b2-43a56377f6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:06.639636 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ec60d-7523-4a3f-bab9-2d393dc1f967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:06.641015 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ec60d-7523-4a3f-bab9-2d393dc1f967 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:06.641461 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ec60d-7523-4a3f-bab9-2d393dc1f967 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:06.641779 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ec60d-7523-4a3f-bab9-2d393dc1f967 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:06.642517 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ec60d-7523-4a3f-bab9-2d393dc1f967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:06.681882 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9f85c-e947-4b8c-80b2-43a56377f6a2 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:06.687749 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254e989-96d6-48f8-905b-3540dc9bb23b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:06.688514 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254e989-96d6-48f8-905b-3540dc9bb23b service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:06.688908 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254e989-96d6-48f8-905b-3540dc9bb23b service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:06.689416 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254e989-96d6-48f8-905b-3540dc9bb23b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:06.689795 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ec60d-7523-4a3f-bab9-2d393dc1f967 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:06.692680 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-9254e989-96d6-48f8-905b-3540dc9bb23b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:06.704155 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 959/1918] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:06 2021] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:53:06.705077 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ec60d-7523-4a3f-bab9-2d393dc1f967 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:06.710562 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-654ec60d-7523-4a3f-bab9-2d393dc1f967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:06.803170 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ec60d-7523-4a3f-bab9-2d393dc1f967 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:06.808198 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11232092-875f-4ae7-a355-cb8bc0e634b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:06.808665 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254e989-96d6-48f8-905b-3540dc9bb23b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:06.808996 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11232092-875f-4ae7-a355-cb8bc0e634b4 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:06.809383 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11232092-875f-4ae7-a355-cb8bc0e634b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:06.810213 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11232092-875f-4ae7-a355-cb8bc0e634b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:06.837396 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11232092-875f-4ae7-a355-cb8bc0e634b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:06.840869 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254e989-96d6-48f8-905b-3540dc9bb23b service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:06.853262 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 960/1919] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:06 2021] GET /identity/v3/auth/tokens => generated 3757 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:53:06.854449 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254e989-96d6-48f8-905b-3540dc9bb23b service cinder] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:06.856097 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-9254e989-96d6-48f8-905b-3540dc9bb23b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:06.877618 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254e989-96d6-48f8-905b-3540dc9bb23b service cinder] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:06.891961 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68db72-f0b4-4ec5-b187-5fe5571f4b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:06.898008 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68db72-f0b4-4ec5-b187-5fe5571f4b12 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:06.898310 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68db72-f0b4-4ec5-b187-5fe5571f4b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:06.898594 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68db72-f0b4-4ec5-b187-5fe5571f4b12 admin admin] PATH_INFO: `/v3/projects/1497420479da4d2f9314b4fa9689768f/users/40354ae7f09d42db91c20dc48cd58450/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:06.903175 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68db72-f0b4-4ec5-b187-5fe5571f4b12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1497420479da4d2f9314b4fa9689768f, user_id=40354ae7f09d42db91c20dc48cd58450, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:06.904833 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11232092-875f-4ae7-a355-cb8bc0e634b4 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:06.951413 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 960/1920] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:53:06.981118 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68db72-f0b4-4ec5-b187-5fe5571f4b12 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:06.996927 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 961/1921] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:06 2021] PUT /identity/v3/projects/1497420479da4d2f9314b4fa9689768f/users/40354ae7f09d42db91c20dc48cd58450/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:07.003787 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11232092-875f-4ae7-a355-cb8bc0e634b4 service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:07.016424 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11232092-875f-4ae7-a355-cb8bc0e634b4 service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:07.148061 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3808b-cf73-4b1c-b0ac-cf0c050f548d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:07.150182 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3808b-cf73-4b1c-b0ac-cf0c050f548d admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:07.150479 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3808b-cf73-4b1c-b0ac-cf0c050f548d admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:07.150791 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3808b-cf73-4b1c-b0ac-cf0c050f548d admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:07.151593 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3808b-cf73-4b1c-b0ac-cf0c050f548d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:07.181720 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3808b-cf73-4b1c-b0ac-cf0c050f548d admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:07.194235 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 961/1922] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:07 2021] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:53:07.200404 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68db72-f0b4-4ec5-b187-5fe5571f4b12 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:07.212303 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68db72-f0b4-4ec5-b187-5fe5571f4b12 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:07.218225 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e177fd3-e9ee-4145-b596-f294d42b4b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:07.219184 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e177fd3-e9ee-4145-b596-f294d42b4b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:07.219770 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e177fd3-e9ee-4145-b596-f294d42b4b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:07.220133 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e177fd3-e9ee-4145-b596-f294d42b4b84 admin admin] PATH_INFO: `/v3/projects/1497420479da4d2f9314b4fa9689768f/users/40354ae7f09d42db91c20dc48cd58450/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:07.222573 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e177fd3-e9ee-4145-b596-f294d42b4b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1497420479da4d2f9314b4fa9689768f, user_id=40354ae7f09d42db91c20dc48cd58450, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:07.261033 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e177fd3-e9ee-4145-b596-f294d42b4b84 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:07.298216 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 962/1923] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:07 2021] PUT /identity/v3/projects/1497420479da4d2f9314b4fa9689768f/users/40354ae7f09d42db91c20dc48cd58450/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:07.310946 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf16bc-4f6e-49a9-9fcc-2f81afc53b2e None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:07.312102 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf16bc-4f6e-49a9-9fcc-2f81afc53b2e None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:07.312626 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf16bc-4f6e-49a9-9fcc-2f81afc53b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:07.401867 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-5dbf16bc-4f6e-49a9-9fcc-2f81afc53b2e None None] MFA Rules not processed for user `40354ae7f09d42db91c20dc48cd58450`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:07.403077 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-5dbf16bc-4f6e-49a9-9fcc-2f81afc53b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:07.568002 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 962/1924] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:07 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:07.619945 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e177fd3-e9ee-4145-b596-f294d42b4b84 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:07.621918 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-4e177fd3-e9ee-4145-b596-f294d42b4b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:07.723126 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf16bc-4f6e-49a9-9fcc-2f81afc53b2e None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:07.747576 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e177fd3-e9ee-4145-b596-f294d42b4b84 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:07.761316 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e11a04-7dd5-4638-b514-b39c2610d8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:07.762256 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e11a04-7dd5-4638-b514-b39c2610d8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:07.762728 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e11a04-7dd5-4638-b514-b39c2610d8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:07.763159 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e11a04-7dd5-4638-b514-b39c2610d8d5 admin admin] PATH_INFO: `/v3/projects/b7446ae14b9c4067b5b2e49b5fdb8825` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:07.765595 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e11a04-7dd5-4638-b514-b39c2610d8d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7446ae14b9c4067b5b2e49b5fdb8825)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:07.794888 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e11a04-7dd5-4638-b514-b39c2610d8d5 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:07.836384 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf16bc-4f6e-49a9-9fcc-2f81afc53b2e None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:07.841052 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bacb5-3ada-4f1d-9aba-652fa54dd2cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:07.841708 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bacb5-3ada-4f1d-9aba-652fa54dd2cf service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:07.842000 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bacb5-3ada-4f1d-9aba-652fa54dd2cf service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:07.842965 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bacb5-3ada-4f1d-9aba-652fa54dd2cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:07.854715 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bacb5-3ada-4f1d-9aba-652fa54dd2cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:07.879310 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-a9e11a04-7dd5-4638-b514-b39c2610d8d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7446ae14b9c4067b5b2e49b5fdb8825', 'request_id': 'req-a9e11a04-7dd5-4638-b514-b39c2610d8d5'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:07.891156 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bacb5-3ada-4f1d-9aba-652fa54dd2cf service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:07.892522 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-a9e11a04-7dd5-4638-b514-b39c2610d8d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7446ae14b9c4067b5b2e49b5fdb8825', 'request_id': 'req-a9e11a04-7dd5-4638-b514-b39c2610d8d5'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:07.899671 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-a9e11a04-7dd5-4638-b514-b39c2610d8d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7446ae14b9c4067b5b2e49b5fdb8825', 'request_id': 'req-a9e11a04-7dd5-4638-b514-b39c2610d8d5'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:07.914447 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 963/1925] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:07 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:53:07.921608 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-a9e11a04-7dd5-4638-b514-b39c2610d8d5 admin admin] The token cache is being invalidate because project b7446ae14b9c4067b5b2e49b5fdb8825 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:53:07.922390 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-a9e11a04-7dd5-4638-b514-b39c2610d8d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:07.931850 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-a9e11a04-7dd5-4638-b514-b39c2610d8d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:07.945356 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 963/1926] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:53:07 2021] DELETE /identity/v3/projects/b7446ae14b9c4067b5b2e49b5fdb8825 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:07.947528 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace02c87-b3e6-4235-96b3-7efa17e71666 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:07.947844 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace02c87-b3e6-4235-96b3-7efa17e71666 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:07.948120 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace02c87-b3e6-4235-96b3-7efa17e71666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:07.985256 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-ace02c87-b3e6-4235-96b3-7efa17e71666 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:07.987523 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-ace02c87-b3e6-4235-96b3-7efa17e71666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:08.080116 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 964/1927] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:08.089589 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b86980-f414-4f44-a560-dfa910de69bd None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:08.090112 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b86980-f414-4f44-a560-dfa910de69bd None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:08.090199 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b86980-f414-4f44-a560-dfa910de69bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:08.120151 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-55b86980-f414-4f44-a560-dfa910de69bd None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:08.121236 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-55b86980-f414-4f44-a560-dfa910de69bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:08.139431 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace02c87-b3e6-4235-96b3-7efa17e71666 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:08.147837 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 964/1928] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:53:08.152565 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace02c87-b3e6-4235-96b3-7efa17e71666 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:08.158784 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a9f89-fcf5-4ee4-a8d7-76b0704d03b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:08.159538 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a9f89-fcf5-4ee4-a8d7-76b0704d03b7 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:08.159834 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a9f89-fcf5-4ee4-a8d7-76b0704d03b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:08.160113 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a9f89-fcf5-4ee4-a8d7-76b0704d03b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:08.161206 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a9f89-fcf5-4ee4-a8d7-76b0704d03b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:53:08.161663 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a9f89-fcf5-4ee4-a8d7-76b0704d03b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:08.236513 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a9f89-fcf5-4ee4-a8d7-76b0704d03b7 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:08.281157 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 965/1929] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:53:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:53:08.285060 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b86980-f414-4f44-a560-dfa910de69bd None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:08.294852 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b86980-f414-4f44-a560-dfa910de69bd None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:08.301418 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3a270-a7d1-4f9b-9cf0-0b2bde6e61e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:08.302013 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3a270-a7d1-4f9b-9cf0-0b2bde6e61e0 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:08.302302 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3a270-a7d1-4f9b-9cf0-0b2bde6e61e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:08.302577 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3a270-a7d1-4f9b-9cf0-0b2bde6e61e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:08.303252 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f3a270-a7d1-4f9b-9cf0-0b2bde6e61e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:08.333644 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f3a270-a7d1-4f9b-9cf0-0b2bde6e61e0 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:08.369742 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 965/1930] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:53:08 2021] POST /identity/v3/projects => generated 377 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:08.374918 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a9f89-fcf5-4ee4-a8d7-76b0704d03b7 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:08.389064 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a9f89-fcf5-4ee4-a8d7-76b0704d03b7 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:08.537746 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711f65b-0717-44ad-bc0f-827842e07a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:08.538531 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711f65b-0717-44ad-bc0f-827842e07a92 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:08.538990 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711f65b-0717-44ad-bc0f-827842e07a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:08.539451 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711f65b-0717-44ad-bc0f-827842e07a92 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:08.540263 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711f65b-0717-44ad-bc0f-827842e07a92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:08.597517 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711f65b-0717-44ad-bc0f-827842e07a92 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:08.628121 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 966/1931] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:53:08 2021] POST /identity/v3/users => generated 289 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:08.633160 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3a270-a7d1-4f9b-9cf0-0b2bde6e61e0 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:08.657157 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3a270-a7d1-4f9b-9cf0-0b2bde6e61e0 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:08.678407 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a1546-7674-4d7f-8e2d-b4302608459b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:08.679432 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a1546-7674-4d7f-8e2d-b4302608459b admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:08.679874 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a1546-7674-4d7f-8e2d-b4302608459b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:08.680458 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a1546-7674-4d7f-8e2d-b4302608459b admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:08.681310 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a1546-7674-4d7f-8e2d-b4302608459b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:08.742088 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a1546-7674-4d7f-8e2d-b4302608459b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:08.773012 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 966/1932] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:08 2021] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:53:08.777502 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711f65b-0717-44ad-bc0f-827842e07a92 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:08.788583 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711f65b-0717-44ad-bc0f-827842e07a92 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:08.804225 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6a6f2-2619-400c-ad81-97732bfce6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:08.805421 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6a6f2-2619-400c-ad81-97732bfce6d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:08.805714 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6a6f2-2619-400c-ad81-97732bfce6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:08.806009 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6a6f2-2619-400c-ad81-97732bfce6d8 admin admin] PATH_INFO: `/v3/projects/a467968e44b8484d90f8329ba179c42b/users/702d6326d00f484b85d27dfceb875d11/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:08.869269 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6a6f2-2619-400c-ad81-97732bfce6d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a467968e44b8484d90f8329ba179c42b, user_id=702d6326d00f484b85d27dfceb875d11, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:08.930049 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6a6f2-2619-400c-ad81-97732bfce6d8 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:08.969003 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 967/1933] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:08 2021] PUT /identity/v3/projects/a467968e44b8484d90f8329ba179c42b/users/702d6326d00f484b85d27dfceb875d11/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:08.979200 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c94af2-d2b6-4b44-9b6d-89b238e6133e None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:08.979504 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c94af2-d2b6-4b44-9b6d-89b238e6133e None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:08.979796 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c94af2-d2b6-4b44-9b6d-89b238e6133e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:09.054011 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-01c94af2-d2b6-4b44-9b6d-89b238e6133e None None] MFA Rules not processed for user `702d6326d00f484b85d27dfceb875d11`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:09.056153 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-01c94af2-d2b6-4b44-9b6d-89b238e6133e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:09.194702 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 967/1934] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:08 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:09.199157 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6a6f2-2619-400c-ad81-97732bfce6d8 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:09.358425 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6a6f2-2619-400c-ad81-97732bfce6d8 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:09.364390 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226e1c2-4add-41f0-b028-8ab6b2d6da74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:09.365847 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226e1c2-4add-41f0-b028-8ab6b2d6da74 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:09.366367 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226e1c2-4add-41f0-b028-8ab6b2d6da74 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:09.366925 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226e1c2-4add-41f0-b028-8ab6b2d6da74 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:09.368897 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226e1c2-4add-41f0-b028-8ab6b2d6da74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:09.402580 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226e1c2-4add-41f0-b028-8ab6b2d6da74 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:09.442099 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 968/1935] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:53:09 2021] POST /identity/v3/projects => generated 375 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:09.446071 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c94af2-d2b6-4b44-9b6d-89b238e6133e None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:09.464117 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c94af2-d2b6-4b44-9b6d-89b238e6133e None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:09.592247 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa30a7b-e658-4a9f-8d52-f7a437fb1563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:09.595984 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa30a7b-e658-4a9f-8d52-f7a437fb1563 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:09.596858 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa30a7b-e658-4a9f-8d52-f7a437fb1563 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:09.597520 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa30a7b-e658-4a9f-8d52-f7a437fb1563 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:09.598399 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa30a7b-e658-4a9f-8d52-f7a437fb1563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:09.633443 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa30a7b-e658-4a9f-8d52-f7a437fb1563 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:09.661267 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 968/1936] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:53:09 2021] POST /identity/v3/users => generated 288 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:09.665226 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226e1c2-4add-41f0-b028-8ab6b2d6da74 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:09.688660 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226e1c2-4add-41f0-b028-8ab6b2d6da74 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:09.702759 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa28a69-9fbc-4f78-8995-d29aa81807e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:09.703396 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa28a69-9fbc-4f78-8995-d29aa81807e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:09.703687 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa28a69-9fbc-4f78-8995-d29aa81807e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:09.704018 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa28a69-9fbc-4f78-8995-d29aa81807e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:09.704718 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa28a69-9fbc-4f78-8995-d29aa81807e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:09.752282 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa28a69-9fbc-4f78-8995-d29aa81807e0 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:09.769599 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 969/1937] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:09 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:53:09.775745 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa30a7b-e658-4a9f-8d52-f7a437fb1563 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:09.790043 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa30a7b-e658-4a9f-8d52-f7a437fb1563 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:09.794957 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654083c-5080-4e6e-b064-390497d747b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:09.796773 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654083c-5080-4e6e-b064-390497d747b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:09.797337 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654083c-5080-4e6e-b064-390497d747b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:09.797971 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654083c-5080-4e6e-b064-390497d747b9 admin admin] PATH_INFO: `/v3/projects/1aee2389d0bb436ab73bda8c10d1a551/users/c38496124bc444288948d092226711ed/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:09.836422 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654083c-5080-4e6e-b064-390497d747b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aee2389d0bb436ab73bda8c10d1a551, user_id=c38496124bc444288948d092226711ed, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:09.874620 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654083c-5080-4e6e-b064-390497d747b9 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:09.899696 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 969/1938] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:09 2021] PUT /identity/v3/projects/1aee2389d0bb436ab73bda8c10d1a551/users/c38496124bc444288948d092226711ed/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:09.912537 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d61df1-ed25-49c3-a803-356fbc7bd6f8 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:09.913070 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d61df1-ed25-49c3-a803-356fbc7bd6f8 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:09.913493 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d61df1-ed25-49c3-a803-356fbc7bd6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:09.994912 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-41d61df1-ed25-49c3-a803-356fbc7bd6f8 None None] MFA Rules not processed for user `c38496124bc444288948d092226711ed`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:09.997931 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-41d61df1-ed25-49c3-a803-356fbc7bd6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:10.039134 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654083c-5080-4e6e-b064-390497d747b9 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:10.041996 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-5654083c-5080-4e6e-b064-390497d747b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:10.121163 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 970/1939] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:09 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:10.127062 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d61df1-ed25-49c3-a803-356fbc7bd6f8 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:10.178994 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654083c-5080-4e6e-b064-390497d747b9 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:10.187505 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbea86-fdbe-42d4-901a-7acae4fae277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:10.188684 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbea86-fdbe-42d4-901a-7acae4fae277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:10.189223 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbea86-fdbe-42d4-901a-7acae4fae277 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:10.189677 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbea86-fdbe-42d4-901a-7acae4fae277 admin admin] PATH_INFO: `/v3/users/ec8b21b0652a431baa6e9fa8d9d63a59` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:10.192906 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbea86-fdbe-42d4-901a-7acae4fae277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec8b21b0652a431baa6e9fa8d9d63a59)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:10.217452 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d61df1-ed25-49c3-a803-356fbc7bd6f8 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:10.222219 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbea86-fdbe-42d4-901a-7acae4fae277 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:10.222673 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189352d-831b-415f-a469-731af838eae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:10.223228 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189352d-831b-415f-a469-731af838eae6 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:10.223654 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189352d-831b-415f-a469-731af838eae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:10.224015 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189352d-831b-415f-a469-731af838eae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:10.224766 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189352d-831b-415f-a469-731af838eae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:10.253800 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189352d-831b-415f-a469-731af838eae6 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:10.289257 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 971/1940] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:53:10 2021] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:10.290326 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189352d-831b-415f-a469-731af838eae6 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:10.296157 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-41dbea86-fdbe-42d4-901a-7acae4fae277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec8b21b0652a431baa6e9fa8d9d63a59'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:10.297149 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-41dbea86-fdbe-42d4-901a-7acae4fae277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec8b21b0652a431baa6e9fa8d9d63a59'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:10.307148 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-41dbea86-fdbe-42d4-901a-7acae4fae277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec8b21b0652a431baa6e9fa8d9d63a59'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:10.320192 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-41dbea86-fdbe-42d4-901a-7acae4fae277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec8b21b0652a431baa6e9fa8d9d63a59'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:10.328685 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-41dbea86-fdbe-42d4-901a-7acae4fae277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec8b21b0652a431baa6e9fa8d9d63a59'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:10.334904 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 970/1941] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:53:10 2021] DELETE /identity/v3/users/ec8b21b0652a431baa6e9fa8d9d63a59 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:10.339368 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b4e19-51c7-4624-bff3-6b0830f1bfe6 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:10.339775 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b4e19-51c7-4624-bff3-6b0830f1bfe6 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:10.340974 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b4e19-51c7-4624-bff3-6b0830f1bfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:10.371741 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-421b4e19-51c7-4624-bff3-6b0830f1bfe6 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:10.373302 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-421b4e19-51c7-4624-bff3-6b0830f1bfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:10.374402 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189352d-831b-415f-a469-731af838eae6 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:10.461857 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 971/1942] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:10.470548 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b4e19-51c7-4624-bff3-6b0830f1bfe6 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:10.472048 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-421b4e19-51c7-4624-bff3-6b0830f1bfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:10.547641 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8661438-c5b0-4376-bc67-1939ed6a8176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:10.548948 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8661438-c5b0-4376-bc67-1939ed6a8176 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:10.549616 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8661438-c5b0-4376-bc67-1939ed6a8176 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:10.550088 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8661438-c5b0-4376-bc67-1939ed6a8176 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:10.551135 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8661438-c5b0-4376-bc67-1939ed6a8176 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:10.579117 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b4e19-51c7-4624-bff3-6b0830f1bfe6 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:10.582921 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8661438-c5b0-4376-bc67-1939ed6a8176 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:10.585684 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ef875-37fc-4e6a-8a35-83a5ddd60748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:10.586350 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ef875-37fc-4e6a-8a35-83a5ddd60748 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:10.586804 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ef875-37fc-4e6a-8a35-83a5ddd60748 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:10.587166 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ef875-37fc-4e6a-8a35-83a5ddd60748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:10.600868 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ef875-37fc-4e6a-8a35-83a5ddd60748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:10.631204 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ef875-37fc-4e6a-8a35-83a5ddd60748 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:10.631402 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 972/1943] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:53:10 2021] POST /identity/v3/users => generated 295 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:10.632658 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8661438-c5b0-4376-bc67-1939ed6a8176 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:10.634261 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-b8661438-c5b0-4376-bc67-1939ed6a8176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:10.638732 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 972/1944] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:53:10.646578 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8661438-c5b0-4376-bc67-1939ed6a8176 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:10.651151 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fe447-fbe4-41ac-a76f-8959fe061bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:10.651752 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fe447-fbe4-41ac-a76f-8959fe061bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:10.652045 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fe447-fbe4-41ac-a76f-8959fe061bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:10.652322 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fe447-fbe4-41ac-a76f-8959fe061bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:10.653013 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976fe447-fbe4-41ac-a76f-8959fe061bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:10.685234 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976fe447-fbe4-41ac-a76f-8959fe061bb6 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:10.701031 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 973/1945] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:10 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:53:10.704224 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ef875-37fc-4e6a-8a35-83a5ddd60748 service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:10.714910 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ef875-37fc-4e6a-8a35-83a5ddd60748 service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:10.719736 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664385ed-98f5-4e32-abbf-678249e68dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:10.720541 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664385ed-98f5-4e32-abbf-678249e68dd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:10.720841 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664385ed-98f5-4e32-abbf-678249e68dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:10.721108 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664385ed-98f5-4e32-abbf-678249e68dd9 admin admin] PATH_INFO: `/v3/projects/9cc07280be1e4f2ea5e18cc545d7bd0f/users/f7b921f74d16434c860558634efad704/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:10.744390 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664385ed-98f5-4e32-abbf-678249e68dd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc07280be1e4f2ea5e18cc545d7bd0f, user_id=f7b921f74d16434c860558634efad704, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:10.773137 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664385ed-98f5-4e32-abbf-678249e68dd9 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:10.797889 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 973/1946] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:10 2021] PUT /identity/v3/projects/9cc07280be1e4f2ea5e18cc545d7bd0f/users/f7b921f74d16434c860558634efad704/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:10.801932 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fe447-fbe4-41ac-a76f-8959fe061bb6 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:10.815113 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fe447-fbe4-41ac-a76f-8959fe061bb6 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:10.898320 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664385ed-98f5-4e32-abbf-678249e68dd9 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:10.901171 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-664385ed-98f5-4e32-abbf-678249e68dd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:10.971924 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70512e41-8161-4aae-8169-7186a701958a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:10.972728 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70512e41-8161-4aae-8169-7186a701958a admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:10.973126 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70512e41-8161-4aae-8169-7186a701958a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:10.973695 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70512e41-8161-4aae-8169-7186a701958a admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:10.974541 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70512e41-8161-4aae-8169-7186a701958a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:11.017946 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664385ed-98f5-4e32-abbf-678249e68dd9 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:11.024707 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bf46e-4cbe-412c-912b-71ef0dadf9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:11.025931 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bf46e-4cbe-412c-912b-71ef0dadf9d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:11.026423 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bf46e-4cbe-412c-912b-71ef0dadf9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:11.026902 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bf46e-4cbe-412c-912b-71ef0dadf9d3 admin admin] PATH_INFO: `/v3/users/74443b5931a44ecd93e95edb7349e913` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:11.028180 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209bf46e-4cbe-412c-912b-71ef0dadf9d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74443b5931a44ecd93e95edb7349e913)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:11.054171 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70512e41-8161-4aae-8169-7186a701958a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:11.061840 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209bf46e-4cbe-412c-912b-71ef0dadf9d3 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:11.079620 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 974/1947] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:10 2021] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:53:11.086333 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70512e41-8161-4aae-8169-7186a701958a admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:11.115064 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70512e41-8161-4aae-8169-7186a701958a admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:11.120153 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee5f92-ccd5-4972-8caa-5c17372054e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:11.125368 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee5f92-ccd5-4972-8caa-5c17372054e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:11.128714 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee5f92-ccd5-4972-8caa-5c17372054e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:11.129046 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee5f92-ccd5-4972-8caa-5c17372054e8 admin admin] PATH_INFO: `/v3/projects/9cc07280be1e4f2ea5e18cc545d7bd0f/users/f7b921f74d16434c860558634efad704/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:11.135735 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee5f92-ccd5-4972-8caa-5c17372054e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc07280be1e4f2ea5e18cc545d7bd0f, user_id=f7b921f74d16434c860558634efad704, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:11.148132 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-209bf46e-4cbe-412c-912b-71ef0dadf9d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74443b5931a44ecd93e95edb7349e913'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:11.148944 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-209bf46e-4cbe-412c-912b-71ef0dadf9d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74443b5931a44ecd93e95edb7349e913'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:11.167727 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-209bf46e-4cbe-412c-912b-71ef0dadf9d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74443b5931a44ecd93e95edb7349e913'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:11.184322 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee5f92-ccd5-4972-8caa-5c17372054e8 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:11.197084 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-209bf46e-4cbe-412c-912b-71ef0dadf9d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74443b5931a44ecd93e95edb7349e913'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:11.198268 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 975/1948] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:11 2021] PUT /identity/v3/projects/9cc07280be1e4f2ea5e18cc545d7bd0f/users/f7b921f74d16434c860558634efad704/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:11.203035 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee5f92-ccd5-4972-8caa-5c17372054e8 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:11.204951 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-7dee5f92-ccd5-4972-8caa-5c17372054e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:11.205092 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-209bf46e-4cbe-412c-912b-71ef0dadf9d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74443b5931a44ecd93e95edb7349e913'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:11.211918 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 974/1949] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:53:10 2021] DELETE /identity/v3/users/74443b5931a44ecd93e95edb7349e913 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:11.212661 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bf46e-4cbe-412c-912b-71ef0dadf9d3 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:11.214070 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-209bf46e-4cbe-412c-912b-71ef0dadf9d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:11.286796 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee5f92-ccd5-4972-8caa-5c17372054e8 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:11.292270 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bf46e-4cbe-412c-912b-71ef0dadf9d3 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:11.293274 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929be196-3f59-4606-96f5-f7f32f6bc1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:11.294262 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929be196-3f59-4606-96f5-f7f32f6bc1f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:11.294557 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929be196-3f59-4606-96f5-f7f32f6bc1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:11.294975 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929be196-3f59-4606-96f5-f7f32f6bc1f2 admin admin] PATH_INFO: `/v3/projects/8f20e8ee53534ab0a8c738f3d28865d9` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:11.296066 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929be196-3f59-4606-96f5-f7f32f6bc1f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f20e8ee53534ab0a8c738f3d28865d9)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:11.297478 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884435a-71d1-4b6c-8c07-d3b101d7bf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:11.298136 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884435a-71d1-4b6c-8c07-d3b101d7bf3f admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:11.298427 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884435a-71d1-4b6c-8c07-d3b101d7bf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:11.298739 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884435a-71d1-4b6c-8c07-d3b101d7bf3f admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:11.299480 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884435a-71d1-4b6c-8c07-d3b101d7bf3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:11.324612 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929be196-3f59-4606-96f5-f7f32f6bc1f2 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:11.327388 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884435a-71d1-4b6c-8c07-d3b101d7bf3f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:11.341138 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 975/1950] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:11 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:53:11.341138 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101cbbf-01d0-420e-b8ff-ea24f6ea2723 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:11.341138 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101cbbf-01d0-420e-b8ff-ea24f6ea2723 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:11.341138 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101cbbf-01d0-420e-b8ff-ea24f6ea2723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:11.365524 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-a101cbbf-01d0-420e-b8ff-ea24f6ea2723 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:11.366720 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-a101cbbf-01d0-420e-b8ff-ea24f6ea2723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:11.374994 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 976/1951] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:11.375586 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101cbbf-01d0-420e-b8ff-ea24f6ea2723 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:11.386119 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101cbbf-01d0-420e-b8ff-ea24f6ea2723 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:11.395505 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-929be196-3f59-4606-96f5-f7f32f6bc1f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f20e8ee53534ab0a8c738f3d28865d9', 'request_id': 'req-929be196-3f59-4606-96f5-f7f32f6bc1f2'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:11.403600 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-929be196-3f59-4606-96f5-f7f32f6bc1f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f20e8ee53534ab0a8c738f3d28865d9', 'request_id': 'req-929be196-3f59-4606-96f5-f7f32f6bc1f2'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:11.415115 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-929be196-3f59-4606-96f5-f7f32f6bc1f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f20e8ee53534ab0a8c738f3d28865d9', 'request_id': 'req-929be196-3f59-4606-96f5-f7f32f6bc1f2'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:11.426564 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-929be196-3f59-4606-96f5-f7f32f6bc1f2 admin admin] The token cache is being invalidate because project 8f20e8ee53534ab0a8c738f3d28865d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:53:11.426877 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-929be196-3f59-4606-96f5-f7f32f6bc1f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:11.427498 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-929be196-3f59-4606-96f5-f7f32f6bc1f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:11.429365 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 976/1952] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:53:11 2021] DELETE /identity/v3/projects/8f20e8ee53534ab0a8c738f3d28865d9 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:11.430450 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929be196-3f59-4606-96f5-f7f32f6bc1f2 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:11.433826 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-929be196-3f59-4606-96f5-f7f32f6bc1f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:11.455469 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cbdcf-945a-4f9b-8238-72b8d5438634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:11.456366 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cbdcf-945a-4f9b-8238-72b8d5438634 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:11.456661 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cbdcf-945a-4f9b-8238-72b8d5438634 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:11.456951 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cbdcf-945a-4f9b-8238-72b8d5438634 admin admin] PATH_INFO: `/v3/projects/9cc07280be1e4f2ea5e18cc545d7bd0f/users/f7b921f74d16434c860558634efad704/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:11.458876 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cbdcf-945a-4f9b-8238-72b8d5438634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc07280be1e4f2ea5e18cc545d7bd0f, user_id=f7b921f74d16434c860558634efad704, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:11.488255 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cbdcf-945a-4f9b-8238-72b8d5438634 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:11.497693 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929be196-3f59-4606-96f5-f7f32f6bc1f2 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:11.501922 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 977/1953] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:11 2021] PUT /identity/v3/projects/9cc07280be1e4f2ea5e18cc545d7bd0f/users/f7b921f74d16434c860558634efad704/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:11.502808 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cbdcf-945a-4f9b-8238-72b8d5438634 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:11.504852 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-5b5cbdcf-945a-4f9b-8238-72b8d5438634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:11.555663 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e217d-74d5-4f78-bff3-2231773d8b14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:11.556247 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e217d-74d5-4f78-bff3-2231773d8b14 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:11.556528 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e217d-74d5-4f78-bff3-2231773d8b14 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:11.556911 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e217d-74d5-4f78-bff3-2231773d8b14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:11.558602 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-b01e217d-74d5-4f78-bff3-2231773d8b14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:11.574542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cbdcf-945a-4f9b-8238-72b8d5438634 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:11.578845 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99afa10-ac0d-447c-ba37-b6603a7880a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:11.579653 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99afa10-ac0d-447c-ba37-b6603a7880a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:11.579942 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99afa10-ac0d-447c-ba37-b6603a7880a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:11.580223 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99afa10-ac0d-447c-ba37-b6603a7880a7 admin admin] PATH_INFO: `/v3/users/40354ae7f09d42db91c20dc48cd58450` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:11.581325 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99afa10-ac0d-447c-ba37-b6603a7880a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40354ae7f09d42db91c20dc48cd58450)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:11.607036 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99afa10-ac0d-447c-ba37-b6603a7880a7 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:11.628927 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e217d-74d5-4f78-bff3-2231773d8b14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:11.656606 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-c99afa10-ac0d-447c-ba37-b6603a7880a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40354ae7f09d42db91c20dc48cd58450'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:11.656836 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e217d-74d5-4f78-bff3-2231773d8b14 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:11.657248 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-c99afa10-ac0d-447c-ba37-b6603a7880a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40354ae7f09d42db91c20dc48cd58450'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:11.665136 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-c99afa10-ac0d-447c-ba37-b6603a7880a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40354ae7f09d42db91c20dc48cd58450'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:11.667983 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 977/1954] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:53:11.669381 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc6624-c2c0-4e74-9e73-1b50f49bc48e None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:11.669674 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc6624-c2c0-4e74-9e73-1b50f49bc48e None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:11.670467 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc6624-c2c0-4e74-9e73-1b50f49bc48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:11.681039 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-c99afa10-ac0d-447c-ba37-b6603a7880a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40354ae7f09d42db91c20dc48cd58450'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:11.692436 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-c99afa10-ac0d-447c-ba37-b6603a7880a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40354ae7f09d42db91c20dc48cd58450'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:11.700297 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 978/1955] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:53:11 2021] DELETE /identity/v3/users/40354ae7f09d42db91c20dc48cd58450 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:11.726805 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-4dbc6624-c2c0-4e74-9e73-1b50f49bc48e None None] MFA Rules not processed for user `f7b921f74d16434c860558634efad704`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:11.728917 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-4dbc6624-c2c0-4e74-9e73-1b50f49bc48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:11.851085 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 978/1956] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:11 2021] POST /identity/v3/auth/tokens => generated 3751 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:11.862181 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99afa10-ac0d-447c-ba37-b6603a7880a7 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:11.863533 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-c99afa10-ac0d-447c-ba37-b6603a7880a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:11.946928 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99afa10-ac0d-447c-ba37-b6603a7880a7 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:11.955398 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22979bad-84bf-4c38-942b-4ee4cf53bbf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:11.956088 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22979bad-84bf-4c38-942b-4ee4cf53bbf8 service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:11.956442 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22979bad-84bf-4c38-942b-4ee4cf53bbf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:11.956787 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22979bad-84bf-4c38-942b-4ee4cf53bbf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:11.958794 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-22979bad-84bf-4c38-942b-4ee4cf53bbf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:12.037563 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22979bad-84bf-4c38-942b-4ee4cf53bbf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:12.063650 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22979bad-84bf-4c38-942b-4ee4cf53bbf8 service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:12.073774 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 979/1957] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:11 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:53:12.156829 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc6624-c2c0-4e74-9e73-1b50f49bc48e None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:12.158362 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-4dbc6624-c2c0-4e74-9e73-1b50f49bc48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:12.260776 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22979bad-84bf-4c38-942b-4ee4cf53bbf8 service cinder] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:12.262414 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-22979bad-84bf-4c38-942b-4ee4cf53bbf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:12.310464 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc6624-c2c0-4e74-9e73-1b50f49bc48e None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:12.315829 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49aa7e-83bc-461b-b92a-8ec1cf47000a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:12.316544 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49aa7e-83bc-461b-b92a-8ec1cf47000a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:12.316875 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49aa7e-83bc-461b-b92a-8ec1cf47000a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:12.317293 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49aa7e-83bc-461b-b92a-8ec1cf47000a admin admin] PATH_INFO: `/v3/projects/1497420479da4d2f9314b4fa9689768f` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:12.318778 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49aa7e-83bc-461b-b92a-8ec1cf47000a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1497420479da4d2f9314b4fa9689768f)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:12.347171 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49aa7e-83bc-461b-b92a-8ec1cf47000a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:12.360072 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22979bad-84bf-4c38-942b-4ee4cf53bbf8 service cinder] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:12.367812 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5409c2-5319-49ca-afeb-61b62e814d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:12.368761 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5409c2-5319-49ca-afeb-61b62e814d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:12.369143 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5409c2-5319-49ca-afeb-61b62e814d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:12.369650 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5409c2-5319-49ca-afeb-61b62e814d37 admin admin] PATH_INFO: `/v3/projects/94ceb79f01bf4bcfaf39be1b48e6e831` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:12.371139 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5409c2-5319-49ca-afeb-61b62e814d37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94ceb79f01bf4bcfaf39be1b48e6e831)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:12.408720 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5409c2-5319-49ca-afeb-61b62e814d37 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:12.436027 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-3d49aa7e-83bc-461b-b92a-8ec1cf47000a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1497420479da4d2f9314b4fa9689768f', 'request_id': 'req-3d49aa7e-83bc-461b-b92a-8ec1cf47000a'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:12.446077 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-3d49aa7e-83bc-461b-b92a-8ec1cf47000a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1497420479da4d2f9314b4fa9689768f', 'request_id': 'req-3d49aa7e-83bc-461b-b92a-8ec1cf47000a'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:12.461870 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-3d49aa7e-83bc-461b-b92a-8ec1cf47000a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1497420479da4d2f9314b4fa9689768f', 'request_id': 'req-3d49aa7e-83bc-461b-b92a-8ec1cf47000a'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:12.479096 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-3d49aa7e-83bc-461b-b92a-8ec1cf47000a admin admin] The token cache is being invalidate because project 1497420479da4d2f9314b4fa9689768f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:53:12.479395 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-3d49aa7e-83bc-461b-b92a-8ec1cf47000a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:12.480067 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-3d49aa7e-83bc-461b-b92a-8ec1cf47000a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:12.482097 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 979/1958] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:53:12 2021] DELETE /identity/v3/projects/1497420479da4d2f9314b4fa9689768f => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:12.489238 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7901da9-496c-4e65-8e19-934982993c26 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:12.489723 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7901da9-496c-4e65-8e19-934982993c26 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:12.490015 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7901da9-496c-4e65-8e19-934982993c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:12.499866 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-2f5409c2-5319-49ca-afeb-61b62e814d37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94ceb79f01bf4bcfaf39be1b48e6e831', 'request_id': 'req-2f5409c2-5319-49ca-afeb-61b62e814d37'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:12.515768 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-2f5409c2-5319-49ca-afeb-61b62e814d37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94ceb79f01bf4bcfaf39be1b48e6e831', 'request_id': 'req-2f5409c2-5319-49ca-afeb-61b62e814d37'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:12.522943 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-2f5409c2-5319-49ca-afeb-61b62e814d37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94ceb79f01bf4bcfaf39be1b48e6e831', 'request_id': 'req-2f5409c2-5319-49ca-afeb-61b62e814d37'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:12.525509 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-d7901da9-496c-4e65-8e19-934982993c26 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:12.526846 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-d7901da9-496c-4e65-8e19-934982993c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:12.571434 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-2f5409c2-5319-49ca-afeb-61b62e814d37 admin admin] The token cache is being invalidate because project 94ceb79f01bf4bcfaf39be1b48e6e831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:53:12.571684 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-2f5409c2-5319-49ca-afeb-61b62e814d37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:12.574635 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-2f5409c2-5319-49ca-afeb-61b62e814d37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:12.581134 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 980/1959] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:53:12 2021] DELETE /identity/v3/projects/94ceb79f01bf4bcfaf39be1b48e6e831 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:12.585035 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5409c2-5319-49ca-afeb-61b62e814d37 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:12.586357 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-2f5409c2-5319-49ca-afeb-61b62e814d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:12.650568 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 980/1960] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:53:12.660291 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375b60b-a5b1-4dc1-8098-28b1f75c7eba None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:12.660727 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375b60b-a5b1-4dc1-8098-28b1f75c7eba None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:12.661290 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375b60b-a5b1-4dc1-8098-28b1f75c7eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:12.691111 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-e375b60b-a5b1-4dc1-8098-28b1f75c7eba None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:12.692609 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-e375b60b-a5b1-4dc1-8098-28b1f75c7eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:12.708396 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 981/1961] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:12.708629 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5409c2-5319-49ca-afeb-61b62e814d37 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:12.711343 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375b60b-a5b1-4dc1-8098-28b1f75c7eba None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:12.719414 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2b1a3-b1f0-45cf-b7a4-ee226b30e569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:12.720468 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2b1a3-b1f0-45cf-b7a4-ee226b30e569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:12.720917 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2b1a3-b1f0-45cf-b7a4-ee226b30e569 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:12.721316 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2b1a3-b1f0-45cf-b7a4-ee226b30e569 admin admin] PATH_INFO: `/v3/users/7e22c686415d49718f0126a76a296c69` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:12.724598 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2b1a3-b1f0-45cf-b7a4-ee226b30e569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e22c686415d49718f0126a76a296c69)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:12.731535 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375b60b-a5b1-4dc1-8098-28b1f75c7eba None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:12.741931 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb502e-9972-4b59-9bd9-fe37bffe8a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:12.743032 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb502e-9972-4b59-9bd9-fe37bffe8a94 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:12.743430 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb502e-9972-4b59-9bd9-fe37bffe8a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:12.743948 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb502e-9972-4b59-9bd9-fe37bffe8a94 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:12.744847 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb502e-9972-4b59-9bd9-fe37bffe8a94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:53:12.745249 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb502e-9972-4b59-9bd9-fe37bffe8a94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:12.763543 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2b1a3-b1f0-45cf-b7a4-ee226b30e569 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:12.775846 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb502e-9972-4b59-9bd9-fe37bffe8a94 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:12.798282 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 982/1962] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:53:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:53:12.800048 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb502e-9972-4b59-9bd9-fe37bffe8a94 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:12.815428 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb502e-9972-4b59-9bd9-fe37bffe8a94 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:12.819855 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13494069-2a67-4dd6-b239-7f83d237ed9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:12.820446 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13494069-2a67-4dd6-b239-7f83d237ed9f admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:12.821113 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13494069-2a67-4dd6-b239-7f83d237ed9f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:12.821458 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13494069-2a67-4dd6-b239-7f83d237ed9f admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:12.822308 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13494069-2a67-4dd6-b239-7f83d237ed9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:12.830590 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-78d2b1a3-b1f0-45cf-b7a4-ee226b30e569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e22c686415d49718f0126a76a296c69'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:12.831376 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-78d2b1a3-b1f0-45cf-b7a4-ee226b30e569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e22c686415d49718f0126a76a296c69'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:12.840217 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-78d2b1a3-b1f0-45cf-b7a4-ee226b30e569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e22c686415d49718f0126a76a296c69'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:12.852515 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13494069-2a67-4dd6-b239-7f83d237ed9f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:12.854039 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-78d2b1a3-b1f0-45cf-b7a4-ee226b30e569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e22c686415d49718f0126a76a296c69'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:12.863885 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-78d2b1a3-b1f0-45cf-b7a4-ee226b30e569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e22c686415d49718f0126a76a296c69'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:12.876240 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 981/1963] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:53:12 2021] DELETE /identity/v3/users/7e22c686415d49718f0126a76a296c69 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:12.893415 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 983/1964] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:53:12 2021] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:12.897763 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2b1a3-b1f0-45cf-b7a4-ee226b30e569 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:12.899247 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-78d2b1a3-b1f0-45cf-b7a4-ee226b30e569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:12.976316 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2b1a3-b1f0-45cf-b7a4-ee226b30e569 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:13.044935 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778d165-ee40-43af-8660-a8ac31cef846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:13.045635 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778d165-ee40-43af-8660-a8ac31cef846 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:13.045929 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778d165-ee40-43af-8660-a8ac31cef846 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:13.046210 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778d165-ee40-43af-8660-a8ac31cef846 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:13.046895 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778d165-ee40-43af-8660-a8ac31cef846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:13.072939 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778d165-ee40-43af-8660-a8ac31cef846 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:13.098317 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 982/1965] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:53:12 2021] POST /identity/v3/users => generated 286 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:13.102788 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13494069-2a67-4dd6-b239-7f83d237ed9f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:13.127366 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13494069-2a67-4dd6-b239-7f83d237ed9f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:13.133672 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e1823-9f7b-4d4a-b414-09a71470e9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:13.134366 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e1823-9f7b-4d4a-b414-09a71470e9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:13.134882 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e1823-9f7b-4d4a-b414-09a71470e9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:13.135436 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e1823-9f7b-4d4a-b414-09a71470e9d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:13.136211 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e1823-9f7b-4d4a-b414-09a71470e9d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:13.166148 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e1823-9f7b-4d4a-b414-09a71470e9d5 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:13.183990 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 984/1966] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:13 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:53:13.185110 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778d165-ee40-43af-8660-a8ac31cef846 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:13.198396 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778d165-ee40-43af-8660-a8ac31cef846 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:13.203900 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e1702-b248-4f11-8c6d-a94fdb4e36b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:13.204797 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e1702-b248-4f11-8c6d-a94fdb4e36b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:13.205155 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e1702-b248-4f11-8c6d-a94fdb4e36b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:13.205504 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e1702-b248-4f11-8c6d-a94fdb4e36b4 admin admin] PATH_INFO: `/v3/projects/3da5bb1985d541ab9ef7006ba04bc019/users/a33a26a04b6b4e9e85b92b6d06bb7219/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:13.228726 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e1702-b248-4f11-8c6d-a94fdb4e36b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3da5bb1985d541ab9ef7006ba04bc019, user_id=a33a26a04b6b4e9e85b92b6d06bb7219, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:13.257703 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e1702-b248-4f11-8c6d-a94fdb4e36b4 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:13.275323 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 983/1967] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:13 2021] PUT /identity/v3/projects/3da5bb1985d541ab9ef7006ba04bc019/users/a33a26a04b6b4e9e85b92b6d06bb7219/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:53:13.281726 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3eaee-96ae-46d0-9f69-8157cf49a637 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:13.282029 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3eaee-96ae-46d0-9f69-8157cf49a637 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:13.282316 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3eaee-96ae-46d0-9f69-8157cf49a637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:13.308388 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-97e3eaee-96ae-46d0-9f69-8157cf49a637 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:13.309773 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-97e3eaee-96ae-46d0-9f69-8157cf49a637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:13.400948 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e1702-b248-4f11-8c6d-a94fdb4e36b4 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:13.403019 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-5b2e1702-b248-4f11-8c6d-a94fdb4e36b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:13.484027 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 985/1968] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:13.494733 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3eaee-96ae-46d0-9f69-8157cf49a637 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:13.496182 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-97e3eaee-96ae-46d0-9f69-8157cf49a637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:13.535603 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e1702-b248-4f11-8c6d-a94fdb4e36b4 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:13.542283 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137e1c3-eeeb-4188-981d-b173ea3e9e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:13.543837 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137e1c3-eeeb-4188-981d-b173ea3e9e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:13.544282 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137e1c3-eeeb-4188-981d-b173ea3e9e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:13.546707 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137e1c3-eeeb-4188-981d-b173ea3e9e34 admin admin] PATH_INFO: `/v3/projects/80fac23c7c7a49618c7a6cca7d3e383f` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:13.548240 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137e1c3-eeeb-4188-981d-b173ea3e9e34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80fac23c7c7a49618c7a6cca7d3e383f)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:13.577093 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3eaee-96ae-46d0-9f69-8157cf49a637 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:13.580224 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298e011-e110-445d-b366-dd53995be76f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:13.580960 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298e011-e110-445d-b366-dd53995be76f service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:13.581351 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298e011-e110-445d-b366-dd53995be76f service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:13.581736 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298e011-e110-445d-b366-dd53995be76f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:13.582847 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137e1c3-eeeb-4188-981d-b173ea3e9e34 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:13.594621 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298e011-e110-445d-b366-dd53995be76f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:13.624715 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298e011-e110-445d-b366-dd53995be76f service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:13.643397 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6137e1c3-eeeb-4188-981d-b173ea3e9e34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80fac23c7c7a49618c7a6cca7d3e383f', 'request_id': 'req-6137e1c3-eeeb-4188-981d-b173ea3e9e34'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:13.646641 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 986/1969] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:53:13.647821 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b4da6-64c6-4ab5-a5e1-d7884e6d387f None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:13.648117 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b4da6-64c6-4ab5-a5e1-d7884e6d387f None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:13.648555 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b4da6-64c6-4ab5-a5e1-d7884e6d387f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:13.655621 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6137e1c3-eeeb-4188-981d-b173ea3e9e34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80fac23c7c7a49618c7a6cca7d3e383f', 'request_id': 'req-6137e1c3-eeeb-4188-981d-b173ea3e9e34'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:13.662931 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6137e1c3-eeeb-4188-981d-b173ea3e9e34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80fac23c7c7a49618c7a6cca7d3e383f', 'request_id': 'req-6137e1c3-eeeb-4188-981d-b173ea3e9e34'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:13.695368 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6137e1c3-eeeb-4188-981d-b173ea3e9e34 admin admin] The token cache is being invalidate because project 80fac23c7c7a49618c7a6cca7d3e383f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:53:13.695961 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6137e1c3-eeeb-4188-981d-b173ea3e9e34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:13.696154 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-ab1b4da6-64c6-4ab5-a5e1-d7884e6d387f None None] MFA Rules not processed for user `e8cf467bd7664df4a7f9d8c45f12a1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:13.696586 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6137e1c3-eeeb-4188-981d-b173ea3e9e34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:13.697310 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-ab1b4da6-64c6-4ab5-a5e1-d7884e6d387f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:13.698359 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 984/1970] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:53:13 2021] DELETE /identity/v3/projects/80fac23c7c7a49618c7a6cca7d3e383f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:53:13.705712 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f848b9d-4c04-405b-939d-2a4785a46537 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:13.706118 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f848b9d-4c04-405b-939d-2a4785a46537 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:13.706288 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f848b9d-4c04-405b-939d-2a4785a46537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:13.736018 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-5f848b9d-4c04-405b-939d-2a4785a46537 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:13.744308 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-5f848b9d-4c04-405b-939d-2a4785a46537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:13.841347 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 987/1971] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:13 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:13.912831 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 985/1972] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:13.920762 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3170e98-5a62-4390-b062-228f37961429 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:13.921076 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3170e98-5a62-4390-b062-228f37961429 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:13.921352 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3170e98-5a62-4390-b062-228f37961429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:13.979154 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-b3170e98-5a62-4390-b062-228f37961429 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:13.979955 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-b3170e98-5a62-4390-b062-228f37961429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:13.993060 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 988/1973] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:13.998817 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f848b9d-4c04-405b-939d-2a4785a46537 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:14.012750 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3170e98-5a62-4390-b062-228f37961429 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:14.014927 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-b3170e98-5a62-4390-b062-228f37961429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:14.016673 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f848b9d-4c04-405b-939d-2a4785a46537 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:14.030503 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763370f8-199b-40cd-9a35-86894d9ced39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:14.031234 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763370f8-199b-40cd-9a35-86894d9ced39 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:14.031414 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763370f8-199b-40cd-9a35-86894d9ced39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:14.032105 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763370f8-199b-40cd-9a35-86894d9ced39 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:14.032813 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763370f8-199b-40cd-9a35-86894d9ced39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:53:14.033120 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763370f8-199b-40cd-9a35-86894d9ced39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:14.036218 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3170e98-5a62-4390-b062-228f37961429 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:14.047376 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd61d59-ab99-4b77-abc6-1073914c3947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:14.048723 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd61d59-ab99-4b77-abc6-1073914c3947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:14.049905 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd61d59-ab99-4b77-abc6-1073914c3947 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:14.050736 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd61d59-ab99-4b77-abc6-1073914c3947 admin admin] PATH_INFO: `/v3/users/48435b918eb548aea6b5a42b34aeeef4` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:14.055213 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd61d59-ab99-4b77-abc6-1073914c3947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48435b918eb548aea6b5a42b34aeeef4)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:14.086625 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763370f8-199b-40cd-9a35-86894d9ced39 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:14.092226 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd61d59-ab99-4b77-abc6-1073914c3947 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:14.112669 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 986/1974] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:53:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:53:14.113995 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763370f8-199b-40cd-9a35-86894d9ced39 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:14.125978 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763370f8-199b-40cd-9a35-86894d9ced39 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:14.131631 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57862c0e-c968-49d1-921e-049762c5a083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:14.132789 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57862c0e-c968-49d1-921e-049762c5a083 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:14.133472 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57862c0e-c968-49d1-921e-049762c5a083 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:14.133901 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57862c0e-c968-49d1-921e-049762c5a083 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:14.134944 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57862c0e-c968-49d1-921e-049762c5a083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:14.164881 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57862c0e-c968-49d1-921e-049762c5a083 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:14.170408 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-1bd61d59-ab99-4b77-abc6-1073914c3947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48435b918eb548aea6b5a42b34aeeef4'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:14.186834 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-1bd61d59-ab99-4b77-abc6-1073914c3947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48435b918eb548aea6b5a42b34aeeef4'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:14.188099 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-1bd61d59-ab99-4b77-abc6-1073914c3947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48435b918eb548aea6b5a42b34aeeef4'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:14.199919 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-1bd61d59-ab99-4b77-abc6-1073914c3947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48435b918eb548aea6b5a42b34aeeef4'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:14.202003 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 987/1975] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:53:14 2021] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:14.206875 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57862c0e-c968-49d1-921e-049762c5a083 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:14.211851 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-1bd61d59-ab99-4b77-abc6-1073914c3947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48435b918eb548aea6b5a42b34aeeef4'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:14.221365 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 989/1976] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:53:14 2021] DELETE /identity/v3/users/48435b918eb548aea6b5a42b34aeeef4 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:14.226092 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272a545-5ec3-4026-9ce4-5779cb03c666 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:14.226392 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272a545-5ec3-4026-9ce4-5779cb03c666 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:14.226837 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272a545-5ec3-4026-9ce4-5779cb03c666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:14.251790 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-6272a545-5ec3-4026-9ce4-5779cb03c666 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:14.253289 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-6272a545-5ec3-4026-9ce4-5779cb03c666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:14.288285 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57862c0e-c968-49d1-921e-049762c5a083 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:14.339705 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 990/1977] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:53:14.339909 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272a545-5ec3-4026-9ce4-5779cb03c666 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:14.343924 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-6272a545-5ec3-4026-9ce4-5779cb03c666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:14.362415 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ba77e-0004-42f8-9b70-ef56a5ffb89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:14.363210 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ba77e-0004-42f8-9b70-ef56a5ffb89f admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:14.363592 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ba77e-0004-42f8-9b70-ef56a5ffb89f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:14.363999 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ba77e-0004-42f8-9b70-ef56a5ffb89f admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:14.364745 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ba77e-0004-42f8-9b70-ef56a5ffb89f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:14.398559 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ba77e-0004-42f8-9b70-ef56a5ffb89f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:14.414350 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272a545-5ec3-4026-9ce4-5779cb03c666 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:14.418099 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6114d-e9a2-49ff-b861-35258ac902ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:14.418875 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6114d-e9a2-49ff-b861-35258ac902ae service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:14.419118 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6114d-e9a2-49ff-b861-35258ac902ae service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:14.419601 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6114d-e9a2-49ff-b861-35258ac902ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:14.423550 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-52d6114d-e9a2-49ff-b861-35258ac902ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:14.423831 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 988/1978] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:53:14 2021] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:14.424955 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ba77e-0004-42f8-9b70-ef56a5ffb89f admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:14.427043 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-de4ba77e-0004-42f8-9b70-ef56a5ffb89f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:14.528398 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6114d-e9a2-49ff-b861-35258ac902ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:14.561832 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ba77e-0004-42f8-9b70-ef56a5ffb89f admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:14.566930 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6114d-e9a2-49ff-b861-35258ac902ae service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:14.574367 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc827a8-3402-41ca-8ebb-bae0004d5a0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:14.574724 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc827a8-3402-41ca-8ebb-bae0004d5a0b service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:14.575004 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc827a8-3402-41ca-8ebb-bae0004d5a0b service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:14.575284 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc827a8-3402-41ca-8ebb-bae0004d5a0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:14.580636 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 991/1979] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:14 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:53:14.593911 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6114d-e9a2-49ff-b861-35258ac902ae service cinder] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:14.594240 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc827a8-3402-41ca-8ebb-bae0004d5a0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:14.598323 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-52d6114d-e9a2-49ff-b861-35258ac902ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:14.632310 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6114d-e9a2-49ff-b861-35258ac902ae service cinder] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:14.641817 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44255da2-cbbb-4192-aa8e-6e7143b1aba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:14.644436 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc827a8-3402-41ca-8ebb-bae0004d5a0b service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:14.644853 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44255da2-cbbb-4192-aa8e-6e7143b1aba0 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:14.645351 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44255da2-cbbb-4192-aa8e-6e7143b1aba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:14.645992 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44255da2-cbbb-4192-aa8e-6e7143b1aba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:14.648538 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44255da2-cbbb-4192-aa8e-6e7143b1aba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:14.656898 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 989/1980] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:14 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:53:14.703255 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44255da2-cbbb-4192-aa8e-6e7143b1aba0 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:14.722129 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 992/1981] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:14 2021] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:53:14.726630 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc827a8-3402-41ca-8ebb-bae0004d5a0b service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:14.738422 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc827a8-3402-41ca-8ebb-bae0004d5a0b service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:14.745291 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdbba3-08d5-4d5d-8bbd-cf93815ed873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:14.746610 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdbba3-08d5-4d5d-8bbd-cf93815ed873 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:14.747184 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdbba3-08d5-4d5d-8bbd-cf93815ed873 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:14.747590 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdbba3-08d5-4d5d-8bbd-cf93815ed873 admin admin] PATH_INFO: `/v3/projects/eb866fc361f746c29289a87b8947f5d9/users/0d91faed9be642af977af7a34d8c5d37/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:14.773885 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdbba3-08d5-4d5d-8bbd-cf93815ed873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb866fc361f746c29289a87b8947f5d9, user_id=0d91faed9be642af977af7a34d8c5d37, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:14.806187 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdbba3-08d5-4d5d-8bbd-cf93815ed873 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:14.847272 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da579cfd-3a4e-419f-99d0-0bf83124f977 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:14.847661 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da579cfd-3a4e-419f-99d0-0bf83124f977 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:14.848119 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da579cfd-3a4e-419f-99d0-0bf83124f977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:14.849606 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 990/1982] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:14 2021] PUT /identity/v3/projects/eb866fc361f746c29289a87b8947f5d9/users/0d91faed9be642af977af7a34d8c5d37/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:14.914137 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-da579cfd-3a4e-419f-99d0-0bf83124f977 None None] MFA Rules not processed for user `0d91faed9be642af977af7a34d8c5d37`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:14.916006 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-da579cfd-3a4e-419f-99d0-0bf83124f977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:15.062940 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 993/1983] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:14 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:15.069980 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdbba3-08d5-4d5d-8bbd-cf93815ed873 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:15.073431 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-25cdbba3-08d5-4d5d-8bbd-cf93815ed873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:15.162163 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdbba3-08d5-4d5d-8bbd-cf93815ed873 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:15.166012 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f36431-edd5-4876-8304-e42286400710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:15.166906 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f36431-edd5-4876-8304-e42286400710 service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:15.167393 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f36431-edd5-4876-8304-e42286400710 service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:15.167867 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f36431-edd5-4876-8304-e42286400710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:15.179811 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f36431-edd5-4876-8304-e42286400710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:15.212694 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f36431-edd5-4876-8304-e42286400710 service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:15.223675 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 991/1984] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:15 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:53:15.356936 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da579cfd-3a4e-419f-99d0-0bf83124f977 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:15.359344 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-da579cfd-3a4e-419f-99d0-0bf83124f977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:15.483625 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a2527-64cc-4d06-8379-be22ef173b69 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:15.484274 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a2527-64cc-4d06-8379-be22ef173b69 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:15.484274 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a2527-64cc-4d06-8379-be22ef173b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:15.503661 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da579cfd-3a4e-419f-99d0-0bf83124f977 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:15.509741 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe510f4a-64d4-4ce8-951e-2ba0189f8e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:15.510970 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe510f4a-64d4-4ce8-951e-2ba0189f8e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:15.512098 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe510f4a-64d4-4ce8-951e-2ba0189f8e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:15.512660 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe510f4a-64d4-4ce8-951e-2ba0189f8e84 admin admin] PATH_INFO: `/v3/projects/a896976359444af5952c3f853685c958` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:15.515547 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe510f4a-64d4-4ce8-951e-2ba0189f8e84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a896976359444af5952c3f853685c958)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:15.552057 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe510f4a-64d4-4ce8-951e-2ba0189f8e84 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:15.587185 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-f68a2527-64cc-4d06-8379-be22ef173b69 None None] MFA Rules not processed for user `a33a26a04b6b4e9e85b92b6d06bb7219`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:15.592253 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-f68a2527-64cc-4d06-8379-be22ef173b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:15.679124 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-fe510f4a-64d4-4ce8-951e-2ba0189f8e84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a896976359444af5952c3f853685c958', 'request_id': 'req-fe510f4a-64d4-4ce8-951e-2ba0189f8e84'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:15.693002 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-fe510f4a-64d4-4ce8-951e-2ba0189f8e84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a896976359444af5952c3f853685c958', 'request_id': 'req-fe510f4a-64d4-4ce8-951e-2ba0189f8e84'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:15.707765 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-fe510f4a-64d4-4ce8-951e-2ba0189f8e84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a896976359444af5952c3f853685c958', 'request_id': 'req-fe510f4a-64d4-4ce8-951e-2ba0189f8e84'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:15.723082 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-fe510f4a-64d4-4ce8-951e-2ba0189f8e84 admin admin] The token cache is being invalidate because project a896976359444af5952c3f853685c958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:53:15.723519 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-fe510f4a-64d4-4ce8-951e-2ba0189f8e84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:15.724303 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-fe510f4a-64d4-4ce8-951e-2ba0189f8e84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:15.728604 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 994/1985] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:53:15 2021] DELETE /identity/v3/projects/a896976359444af5952c3f853685c958 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:15.730247 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe510f4a-64d4-4ce8-951e-2ba0189f8e84 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:15.732156 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-fe510f4a-64d4-4ce8-951e-2ba0189f8e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:15.773630 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 992/1986] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:15 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:53:15.776541 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a2527-64cc-4d06-8379-be22ef173b69 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:15.782992 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-f68a2527-64cc-4d06-8379-be22ef173b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:15.830848 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a2527-64cc-4d06-8379-be22ef173b69 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:15.870751 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe510f4a-64d4-4ce8-951e-2ba0189f8e84 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:15.884935 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aaf25d-85c6-4296-969d-36fe1e5d5f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:15.885841 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaf25d-85c6-4296-969d-36fe1e5d5f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:15.886230 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaf25d-85c6-4296-969d-36fe1e5d5f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:15.886595 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaf25d-85c6-4296-969d-36fe1e5d5f5b admin admin] PATH_INFO: `/v3/users/16be116443b941269af043b2ef5dc624` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:15.888862 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aaf25d-85c6-4296-969d-36fe1e5d5f5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=16be116443b941269af043b2ef5dc624)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:15.955935 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aaf25d-85c6-4296-969d-36fe1e5d5f5b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:16.017795 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef107d7f-77ca-433c-bfe1-1928c406f423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:16.018406 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef107d7f-77ca-433c-bfe1-1928c406f423 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:16.018720 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef107d7f-77ca-433c-bfe1-1928c406f423 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:16.019009 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef107d7f-77ca-433c-bfe1-1928c406f423 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:16.020579 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef107d7f-77ca-433c-bfe1-1928c406f423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:16.055900 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-75aaf25d-85c6-4296-969d-36fe1e5d5f5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16be116443b941269af043b2ef5dc624'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:16.065121 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef107d7f-77ca-433c-bfe1-1928c406f423 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:16.084079 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-75aaf25d-85c6-4296-969d-36fe1e5d5f5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16be116443b941269af043b2ef5dc624'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:16.085696 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-75aaf25d-85c6-4296-969d-36fe1e5d5f5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16be116443b941269af043b2ef5dc624'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:16.099190 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-75aaf25d-85c6-4296-969d-36fe1e5d5f5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16be116443b941269af043b2ef5dc624'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:16.112738 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 993/1987] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:53:15 2021] POST /identity/v3/projects => generated 373 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:16.116427 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef107d7f-77ca-433c-bfe1-1928c406f423 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:16.121189 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-ef107d7f-77ca-433c-bfe1-1928c406f423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:16.124550 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-75aaf25d-85c6-4296-969d-36fe1e5d5f5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16be116443b941269af043b2ef5dc624'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:16.133023 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 995/1988] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:53:15 2021] DELETE /identity/v3/users/16be116443b941269af043b2ef5dc624 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:16.255501 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aaf25d-85c6-4296-969d-36fe1e5d5f5b admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:16.256912 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-75aaf25d-85c6-4296-969d-36fe1e5d5f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:16.303340 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef107d7f-77ca-433c-bfe1-1928c406f423 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:16.330536 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aaf25d-85c6-4296-969d-36fe1e5d5f5b admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:16.341948 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76d473-ab91-47bd-9671-428cec7f312a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:16.343264 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76d473-ab91-47bd-9671-428cec7f312a service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:16.345115 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76d473-ab91-47bd-9671-428cec7f312a service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:16.345233 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76d473-ab91-47bd-9671-428cec7f312a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:16.349204 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-0c76d473-ab91-47bd-9671-428cec7f312a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:16.392453 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2d0a1-5593-4b90-bda6-994b3bdaac6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:16.393114 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2d0a1-5593-4b90-bda6-994b3bdaac6e admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:16.393407 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2d0a1-5593-4b90-bda6-994b3bdaac6e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:16.393689 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2d0a1-5593-4b90-bda6-994b3bdaac6e admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:16.395057 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2d0a1-5593-4b90-bda6-994b3bdaac6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:16.425653 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2d0a1-5593-4b90-bda6-994b3bdaac6e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:16.451026 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76d473-ab91-47bd-9671-428cec7f312a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:16.455347 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 994/1989] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:53:16 2021] POST /identity/v3/users => generated 293 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:16.470631 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2d0a1-5593-4b90-bda6-994b3bdaac6e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:16.473770 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-5be2d0a1-5593-4b90-bda6-994b3bdaac6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:16.477617 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76d473-ab91-47bd-9671-428cec7f312a service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:16.489721 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 996/1990] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:16 2021] GET /identity/v3/auth/tokens => generated 3751 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:53:16.507797 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2d0a1-5593-4b90-bda6-994b3bdaac6e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:16.519644 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf2819-9c52-4ae0-a9af-202e4d605ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:16.520547 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf2819-9c52-4ae0-a9af-202e4d605ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:16.521180 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf2819-9c52-4ae0-a9af-202e4d605ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:16.521643 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf2819-9c52-4ae0-a9af-202e4d605ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:16.522569 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf2819-9c52-4ae0-a9af-202e4d605ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:16.558589 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf2819-9c52-4ae0-a9af-202e4d605ff5 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:16.572367 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 995/1991] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:16 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:53:16.575593 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76d473-ab91-47bd-9671-428cec7f312a service cinder] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:16.588775 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76d473-ab91-47bd-9671-428cec7f312a service cinder] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:16.594483 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3cff5-67ca-469b-a5ca-7127980ca7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:16.595386 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3cff5-67ca-469b-a5ca-7127980ca7c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:16.595661 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3cff5-67ca-469b-a5ca-7127980ca7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:16.595945 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3cff5-67ca-469b-a5ca-7127980ca7c8 admin admin] PATH_INFO: `/v3/projects/d9968be3d4a745cab454719e27709fbc/users/8458899854994a7697fb52b486df2f8c/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:16.618312 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3cff5-67ca-469b-a5ca-7127980ca7c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9968be3d4a745cab454719e27709fbc, user_id=8458899854994a7697fb52b486df2f8c, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:16.646511 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3cff5-67ca-469b-a5ca-7127980ca7c8 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:16.662156 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 997/1992] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:16 2021] PUT /identity/v3/projects/d9968be3d4a745cab454719e27709fbc/users/8458899854994a7697fb52b486df2f8c/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:53:16.666082 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf2819-9c52-4ae0-a9af-202e4d605ff5 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:16.677307 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf2819-9c52-4ae0-a9af-202e4d605ff5 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:16.734151 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3cff5-67ca-469b-a5ca-7127980ca7c8 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:16.735931 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-d5c3cff5-67ca-469b-a5ca-7127980ca7c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:16.764421 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119e2d8-3559-446b-81c1-7215e9b03050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:16.765027 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119e2d8-3559-446b-81c1-7215e9b03050 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:16.765315 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119e2d8-3559-446b-81c1-7215e9b03050 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:16.765588 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119e2d8-3559-446b-81c1-7215e9b03050 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:16.766319 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119e2d8-3559-446b-81c1-7215e9b03050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:16.792246 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119e2d8-3559-446b-81c1-7215e9b03050 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:16.803728 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 996/1993] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:16 2021] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:53:16.808079 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119e2d8-3559-446b-81c1-7215e9b03050 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:16.818698 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119e2d8-3559-446b-81c1-7215e9b03050 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:16.823741 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53c146-749a-472d-a248-32a5f5411abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:16.825365 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53c146-749a-472d-a248-32a5f5411abd admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:16.825971 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53c146-749a-472d-a248-32a5f5411abd admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:16.827280 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53c146-749a-472d-a248-32a5f5411abd admin admin] PATH_INFO: `/v3/projects/d9968be3d4a745cab454719e27709fbc/users/8458899854994a7697fb52b486df2f8c/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:16.830456 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53c146-749a-472d-a248-32a5f5411abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9968be3d4a745cab454719e27709fbc, user_id=8458899854994a7697fb52b486df2f8c, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:16.831383 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3cff5-67ca-469b-a5ca-7127980ca7c8 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:16.836119 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5f01c-7edb-41b3-82a9-3553a3deb225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:16.837186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5f01c-7edb-41b3-82a9-3553a3deb225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:16.837617 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5f01c-7edb-41b3-82a9-3553a3deb225 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:16.838110 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5f01c-7edb-41b3-82a9-3553a3deb225 admin admin] PATH_INFO: `/v3/projects/f647da6ce9ae4ae8b0c0ff36764313d2` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:16.839702 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5f01c-7edb-41b3-82a9-3553a3deb225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f647da6ce9ae4ae8b0c0ff36764313d2)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:16.859253 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53c146-749a-472d-a248-32a5f5411abd admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:16.866447 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5f01c-7edb-41b3-82a9-3553a3deb225 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:16.873714 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 997/1994] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:16 2021] PUT /identity/v3/projects/d9968be3d4a745cab454719e27709fbc/users/8458899854994a7697fb52b486df2f8c/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:16.874726 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53c146-749a-472d-a248-32a5f5411abd admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:16.920495 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-44a5f01c-7edb-41b3-82a9-3553a3deb225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f647da6ce9ae4ae8b0c0ff36764313d2', 'request_id': 'req-44a5f01c-7edb-41b3-82a9-3553a3deb225'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:16.928033 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-44a5f01c-7edb-41b3-82a9-3553a3deb225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f647da6ce9ae4ae8b0c0ff36764313d2', 'request_id': 'req-44a5f01c-7edb-41b3-82a9-3553a3deb225'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:16.940475 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-44a5f01c-7edb-41b3-82a9-3553a3deb225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f647da6ce9ae4ae8b0c0ff36764313d2', 'request_id': 'req-44a5f01c-7edb-41b3-82a9-3553a3deb225'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:16.947940 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53c146-749a-472d-a248-32a5f5411abd admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:16.952445 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-44a5f01c-7edb-41b3-82a9-3553a3deb225 admin admin] The token cache is being invalidate because project f647da6ce9ae4ae8b0c0ff36764313d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:53:16.952724 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-44a5f01c-7edb-41b3-82a9-3553a3deb225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:16.953335 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-44a5f01c-7edb-41b3-82a9-3553a3deb225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:16.954810 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 998/1995] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:53:16 2021] DELETE /identity/v3/projects/f647da6ce9ae4ae8b0c0ff36764313d2 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:53:16.961786 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6b4b9-3fe8-4976-8a85-7c2d7406c9ac None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:16.962126 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6b4b9-3fe8-4976-8a85-7c2d7406c9ac None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:16.962406 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6b4b9-3fe8-4976-8a85-7c2d7406c9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:16.985529 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-a1c6b4b9-3fe8-4976-8a85-7c2d7406c9ac None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:16.986695 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-a1c6b4b9-3fe8-4976-8a85-7c2d7406c9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:17.021764 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fabc1-09bd-4736-b77f-8e7072640ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:17.022481 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fabc1-09bd-4736-b77f-8e7072640ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:17.022874 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fabc1-09bd-4736-b77f-8e7072640ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:17.023214 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fabc1-09bd-4736-b77f-8e7072640ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:17.024006 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fabc1-09bd-4736-b77f-8e7072640ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:17.049969 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fabc1-09bd-4736-b77f-8e7072640ee7 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:17.058162 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 999/1996] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:53:17.060356 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 998/1997] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:16 2021] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:53:17.064224 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6b4b9-3fe8-4976-8a85-7c2d7406c9ac None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:17.065484 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-a1c6b4b9-3fe8-4976-8a85-7c2d7406c9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:17.066117 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b3767-5e99-4028-92ec-ae59b1076091 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:17.066410 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b3767-5e99-4028-92ec-ae59b1076091 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:17.066716 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b3767-5e99-4028-92ec-ae59b1076091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:17.077299 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6b4b9-3fe8-4976-8a85-7c2d7406c9ac None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:17.082517 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45af1f-423a-467e-9b24-9a63d91fd6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:17.083373 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45af1f-423a-467e-9b24-9a63d91fd6be admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:17.083658 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45af1f-423a-467e-9b24-9a63d91fd6be admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:17.083939 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45af1f-423a-467e-9b24-9a63d91fd6be admin admin] PATH_INFO: `/v3/projects/d9968be3d4a745cab454719e27709fbc/users/8458899854994a7697fb52b486df2f8c/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:17.086169 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45af1f-423a-467e-9b24-9a63d91fd6be admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9968be3d4a745cab454719e27709fbc, user_id=8458899854994a7697fb52b486df2f8c, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:17.097603 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-e70b3767-5e99-4028-92ec-ae59b1076091 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:17.098785 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-e70b3767-5e99-4028-92ec-ae59b1076091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:17.106387 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 999/1998] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:17.110441 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b3767-5e99-4028-92ec-ae59b1076091 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:17.118184 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45af1f-423a-467e-9b24-9a63d91fd6be admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:17.119916 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b3767-5e99-4028-92ec-ae59b1076091 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:17.127550 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee808cfe-11e0-4b6b-b7c6-618e47422add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:17.128137 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee808cfe-11e0-4b6b-b7c6-618e47422add admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:17.128433 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee808cfe-11e0-4b6b-b7c6-618e47422add admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:17.128767 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee808cfe-11e0-4b6b-b7c6-618e47422add admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:17.129488 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee808cfe-11e0-4b6b-b7c6-618e47422add admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:53:17.129994 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee808cfe-11e0-4b6b-b7c6-618e47422add admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:17.143882 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1000/1999] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:17 2021] PUT /identity/v3/projects/d9968be3d4a745cab454719e27709fbc/users/8458899854994a7697fb52b486df2f8c/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:17.184869 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee808cfe-11e0-4b6b-b7c6-618e47422add admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:17.204343 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1000/2000] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:53:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:53:17.205325 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45af1f-423a-467e-9b24-9a63d91fd6be admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:17.372265 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45af1f-423a-467e-9b24-9a63d91fd6be admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:17.388631 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770feb3-7c9b-4b16-814a-afa9ea1ce266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:17.389685 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770feb3-7c9b-4b16-814a-afa9ea1ce266 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:17.390136 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770feb3-7c9b-4b16-814a-afa9ea1ce266 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:17.390994 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770feb3-7c9b-4b16-814a-afa9ea1ce266 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:17.392053 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770feb3-7c9b-4b16-814a-afa9ea1ce266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:17.427899 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770feb3-7c9b-4b16-814a-afa9ea1ce266 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:17.465263 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1001/2001] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:53:17 2021] POST /identity/v3/projects => generated 371 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:17.467938 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee808cfe-11e0-4b6b-b7c6-618e47422add admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:17.477975 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee808cfe-11e0-4b6b-b7c6-618e47422add admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:17.633502 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fd2da-c879-4c05-9ec5-207b3382e9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:17.635922 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fd2da-c879-4c05-9ec5-207b3382e9d4 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:17.636587 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fd2da-c879-4c05-9ec5-207b3382e9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:17.637697 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fd2da-c879-4c05-9ec5-207b3382e9d4 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:17.639865 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798fd2da-c879-4c05-9ec5-207b3382e9d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:17.670708 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798fd2da-c879-4c05-9ec5-207b3382e9d4 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:17.701945 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1001/2002] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:53:17 2021] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:17.706106 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770feb3-7c9b-4b16-814a-afa9ea1ce266 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:17.716143 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770feb3-7c9b-4b16-814a-afa9ea1ce266 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:17.727884 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd785c-afae-458d-82e9-338ac7bb0747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:17.728704 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd785c-afae-458d-82e9-338ac7bb0747 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:17.729113 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd785c-afae-458d-82e9-338ac7bb0747 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:17.729436 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd785c-afae-458d-82e9-338ac7bb0747 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:17.730317 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd785c-afae-458d-82e9-338ac7bb0747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:17.761759 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd785c-afae-458d-82e9-338ac7bb0747 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:17.777128 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1002/2003] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:17 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:53:17.782640 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fd2da-c879-4c05-9ec5-207b3382e9d4 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:17.797678 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fd2da-c879-4c05-9ec5-207b3382e9d4 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:17.802587 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fedd9-5d55-4360-8970-ea9f63206193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:17.803820 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fedd9-5d55-4360-8970-ea9f63206193 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:17.804396 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fedd9-5d55-4360-8970-ea9f63206193 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:17.805049 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fedd9-5d55-4360-8970-ea9f63206193 admin admin] PATH_INFO: `/v3/projects/df273bcc20b64b94993fec02abf64b55/users/22d2ecb59b0f4018a2ad039aca8992fd/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:17.840997 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83fedd9-5d55-4360-8970-ea9f63206193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df273bcc20b64b94993fec02abf64b55, user_id=22d2ecb59b0f4018a2ad039aca8992fd, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:17.878193 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83fedd9-5d55-4360-8970-ea9f63206193 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:17.916963 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1002/2004] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:17 2021] PUT /identity/v3/projects/df273bcc20b64b94993fec02abf64b55/users/22d2ecb59b0f4018a2ad039aca8992fd/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:17.926710 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0a959-aee8-4b6d-8948-ec43f1f2f2df None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:17.926710 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0a959-aee8-4b6d-8948-ec43f1f2f2df None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:17.927770 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0a959-aee8-4b6d-8948-ec43f1f2f2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:17.974063 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-81d0a959-aee8-4b6d-8948-ec43f1f2f2df None None] MFA Rules not processed for user `22d2ecb59b0f4018a2ad039aca8992fd`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:17.975387 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-81d0a959-aee8-4b6d-8948-ec43f1f2f2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:18.128558 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1003/2005] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:17 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:18.135822 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fedd9-5d55-4360-8970-ea9f63206193 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:18.137767 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-b83fedd9-5d55-4360-8970-ea9f63206193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:18.244294 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fedd9-5d55-4360-8970-ea9f63206193 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:18.248289 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2664286-8adc-49ec-a6e7-170b69d04911 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:18.248915 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2664286-8adc-49ec-a6e7-170b69d04911 service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:18.249894 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2664286-8adc-49ec-a6e7-170b69d04911 service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:18.250382 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2664286-8adc-49ec-a6e7-170b69d04911 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:18.261606 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2664286-8adc-49ec-a6e7-170b69d04911 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:18.296018 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2664286-8adc-49ec-a6e7-170b69d04911 service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:18.308848 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1003/2006] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:18 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:53:18.333166 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0a959-aee8-4b6d-8948-ec43f1f2f2df None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:18.444526 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0a959-aee8-4b6d-8948-ec43f1f2f2df None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:18.459383 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab202579-d980-4f0e-97c8-b08fe159e441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:18.460300 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab202579-d980-4f0e-97c8-b08fe159e441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:18.460667 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab202579-d980-4f0e-97c8-b08fe159e441 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:18.461522 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab202579-d980-4f0e-97c8-b08fe159e441 admin admin] PATH_INFO: `/v3/users/22d2ecb59b0f4018a2ad039aca8992fd` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:18.463666 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab202579-d980-4f0e-97c8-b08fe159e441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22d2ecb59b0f4018a2ad039aca8992fd)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:18.533415 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab202579-d980-4f0e-97c8-b08fe159e441 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:18.628728 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ab202579-d980-4f0e-97c8-b08fe159e441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22d2ecb59b0f4018a2ad039aca8992fd'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:18.645265 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ab202579-d980-4f0e-97c8-b08fe159e441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22d2ecb59b0f4018a2ad039aca8992fd'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:18.646070 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ab202579-d980-4f0e-97c8-b08fe159e441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22d2ecb59b0f4018a2ad039aca8992fd'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:18.659363 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ab202579-d980-4f0e-97c8-b08fe159e441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22d2ecb59b0f4018a2ad039aca8992fd'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:18.692257 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ab202579-d980-4f0e-97c8-b08fe159e441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22d2ecb59b0f4018a2ad039aca8992fd'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:18.702488 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1004/2007] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:53:18 2021] DELETE /identity/v3/users/22d2ecb59b0f4018a2ad039aca8992fd => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:18.707225 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bab7d-6581-4597-8fcd-313f3ed9aec5 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:18.707762 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bab7d-6581-4597-8fcd-313f3ed9aec5 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:18.707892 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bab7d-6581-4597-8fcd-313f3ed9aec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:18.748179 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-e84bab7d-6581-4597-8fcd-313f3ed9aec5 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:18.751418 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-e84bab7d-6581-4597-8fcd-313f3ed9aec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:18.936459 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1004/2008] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:18.945276 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab202579-d980-4f0e-97c8-b08fe159e441 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:18.949192 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-ab202579-d980-4f0e-97c8-b08fe159e441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:18.971113 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8e28f-3545-436e-beb4-dbd83c84e7e9 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:18.971754 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8e28f-3545-436e-beb4-dbd83c84e7e9 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:18.972386 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8e28f-3545-436e-beb4-dbd83c84e7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:19.023740 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-e0e8e28f-3545-436e-beb4-dbd83c84e7e9 None None] MFA Rules not processed for user `8458899854994a7697fb52b486df2f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:19.025057 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-e0e8e28f-3545-436e-beb4-dbd83c84e7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:19.077802 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab202579-d980-4f0e-97c8-b08fe159e441 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:19.081028 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16afed77-0705-401f-8b5c-544c4281d622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:19.081608 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afed77-0705-401f-8b5c-544c4281d622 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:19.081893 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afed77-0705-401f-8b5c-544c4281d622 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:19.082170 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afed77-0705-401f-8b5c-544c4281d622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:19.091537 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16afed77-0705-401f-8b5c-544c4281d622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:19.119673 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16afed77-0705-401f-8b5c-544c4281d622 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:19.130822 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1005/2009] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:53:19.178384 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1005/2010] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:18 2021] POST /identity/v3/auth/tokens => generated 3747 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:19.194121 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16afed77-0705-401f-8b5c-544c4281d622 service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:19.195992 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-16afed77-0705-401f-8b5c-544c4281d622 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:19.376551 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16afed77-0705-401f-8b5c-544c4281d622 service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:19.385703 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751df6fa-55a4-43bf-b7d4-ffe49bfb2d2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:19.387855 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751df6fa-55a4-43bf-b7d4-ffe49bfb2d2c service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:19.388679 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751df6fa-55a4-43bf-b7d4-ffe49bfb2d2c service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:19.392077 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751df6fa-55a4-43bf-b7d4-ffe49bfb2d2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:19.394301 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-751df6fa-55a4-43bf-b7d4-ffe49bfb2d2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:19.510077 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751df6fa-55a4-43bf-b7d4-ffe49bfb2d2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:19.544878 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751df6fa-55a4-43bf-b7d4-ffe49bfb2d2c service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:19.571250 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1006/2011] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:19 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:53:19.850137 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8e28f-3545-436e-beb4-dbd83c84e7e9 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:19.851924 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-e0e8e28f-3545-436e-beb4-dbd83c84e7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:19.880802 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8e28f-3545-436e-beb4-dbd83c84e7e9 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:19.899338 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ada59-e013-4ad6-8baa-6131948abc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:19.900723 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ada59-e013-4ad6-8baa-6131948abc4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:19.901313 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ada59-e013-4ad6-8baa-6131948abc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:19.901659 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ada59-e013-4ad6-8baa-6131948abc4e admin admin] PATH_INFO: `/v3/projects/df273bcc20b64b94993fec02abf64b55` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:19.902987 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ada59-e013-4ad6-8baa-6131948abc4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=df273bcc20b64b94993fec02abf64b55)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:19.954867 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ada59-e013-4ad6-8baa-6131948abc4e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:20.090688 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f45ada59-e013-4ad6-8baa-6131948abc4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df273bcc20b64b94993fec02abf64b55', 'request_id': 'req-f45ada59-e013-4ad6-8baa-6131948abc4e'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:20.105226 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f45ada59-e013-4ad6-8baa-6131948abc4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df273bcc20b64b94993fec02abf64b55', 'request_id': 'req-f45ada59-e013-4ad6-8baa-6131948abc4e'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:20.115264 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f45ada59-e013-4ad6-8baa-6131948abc4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df273bcc20b64b94993fec02abf64b55', 'request_id': 'req-f45ada59-e013-4ad6-8baa-6131948abc4e'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:20.138198 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f45ada59-e013-4ad6-8baa-6131948abc4e admin admin] The token cache is being invalidate because project df273bcc20b64b94993fec02abf64b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:53:20.138605 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f45ada59-e013-4ad6-8baa-6131948abc4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:20.139248 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f45ada59-e013-4ad6-8baa-6131948abc4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:20.141110 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1006/2012] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:53:19 2021] DELETE /identity/v3/projects/df273bcc20b64b94993fec02abf64b55 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:20.151802 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642c7f5-d664-488b-9661-1aa5011dcf96 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:20.153036 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642c7f5-d664-488b-9661-1aa5011dcf96 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:20.153662 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642c7f5-d664-488b-9661-1aa5011dcf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:20.213747 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-e642c7f5-d664-488b-9661-1aa5011dcf96 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:20.217494 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-e642c7f5-d664-488b-9661-1aa5011dcf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:20.316817 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1007/2013] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:20.325301 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfe476-be14-4ba7-a564-34f4f8319087 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:20.325659 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfe476-be14-4ba7-a564-34f4f8319087 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:20.326070 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfe476-be14-4ba7-a564-34f4f8319087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:20.359497 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-9bdfe476-be14-4ba7-a564-34f4f8319087 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:20.360887 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-9bdfe476-be14-4ba7-a564-34f4f8319087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:20.371743 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1007/2014] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:20.376700 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642c7f5-d664-488b-9661-1aa5011dcf96 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:20.392052 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642c7f5-d664-488b-9661-1aa5011dcf96 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:20.396347 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc42899-90f2-4303-9b10-ac76aa8a4191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:20.397058 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc42899-90f2-4303-9b10-ac76aa8a4191 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:20.397528 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc42899-90f2-4303-9b10-ac76aa8a4191 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:20.397750 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc42899-90f2-4303-9b10-ac76aa8a4191 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:20.398720 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc42899-90f2-4303-9b10-ac76aa8a4191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:53:20.398949 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc42899-90f2-4303-9b10-ac76aa8a4191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:20.425177 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc42899-90f2-4303-9b10-ac76aa8a4191 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:20.439140 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1008/2015] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:53:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:53:20.444335 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfe476-be14-4ba7-a564-34f4f8319087 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:20.453935 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfe476-be14-4ba7-a564-34f4f8319087 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:20.458431 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cfeda-77b6-4081-a965-16226adf0968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:20.459051 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cfeda-77b6-4081-a965-16226adf0968 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:20.459407 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cfeda-77b6-4081-a965-16226adf0968 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:20.459759 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cfeda-77b6-4081-a965-16226adf0968 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:20.460479 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cfeda-77b6-4081-a965-16226adf0968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:20.487152 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cfeda-77b6-4081-a965-16226adf0968 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:20.521450 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1008/2016] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:53:20 2021] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:53:20.525407 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc42899-90f2-4303-9b10-ac76aa8a4191 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:20.538547 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc42899-90f2-4303-9b10-ac76aa8a4191 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:20.573330 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cfeda-77b6-4081-a965-16226adf0968 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:20.585862 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-542cfeda-77b6-4081-a965-16226adf0968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:20.628354 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53765cc6-65d9-4aee-8195-449a0358f346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:20.628993 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53765cc6-65d9-4aee-8195-449a0358f346 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:20.629332 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53765cc6-65d9-4aee-8195-449a0358f346 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:20.629617 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53765cc6-65d9-4aee-8195-449a0358f346 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:20.630376 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53765cc6-65d9-4aee-8195-449a0358f346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:20.665918 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53765cc6-65d9-4aee-8195-449a0358f346 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:20.672064 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cfeda-77b6-4081-a965-16226adf0968 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:20.678054 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffb716-09d0-43d0-a576-252aab654030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:20.678900 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffb716-09d0-43d0-a576-252aab654030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:20.679211 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffb716-09d0-43d0-a576-252aab654030 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:20.679620 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffb716-09d0-43d0-a576-252aab654030 admin admin] PATH_INFO: `/v3/users/0d91faed9be642af977af7a34d8c5d37` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:20.681012 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cffb716-09d0-43d0-a576-252aab654030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d91faed9be642af977af7a34d8c5d37)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:20.692740 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1009/2017] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:53:20 2021] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:53:20.695875 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53765cc6-65d9-4aee-8195-449a0358f346 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:20.711738 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cffb716-09d0-43d0-a576-252aab654030 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:20.714925 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53765cc6-65d9-4aee-8195-449a0358f346 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:20.720124 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3a2fb-8b67-4d79-aacd-175159366609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:20.720801 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3a2fb-8b67-4d79-aacd-175159366609 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:20.721157 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3a2fb-8b67-4d79-aacd-175159366609 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:20.721505 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3a2fb-8b67-4d79-aacd-175159366609 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:20.722613 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3a2fb-8b67-4d79-aacd-175159366609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:20.761521 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3a2fb-8b67-4d79-aacd-175159366609 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:20.777782 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1010/2018] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:20 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:53:20.778623 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-9cffb716-09d0-43d0-a576-252aab654030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d91faed9be642af977af7a34d8c5d37'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:20.778948 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3a2fb-8b67-4d79-aacd-175159366609 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:20.779896 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-9cffb716-09d0-43d0-a576-252aab654030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d91faed9be642af977af7a34d8c5d37'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:20.789863 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3a2fb-8b67-4d79-aacd-175159366609 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:20.791569 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-9cffb716-09d0-43d0-a576-252aab654030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d91faed9be642af977af7a34d8c5d37'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:20.793591 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34da4b-1577-4c04-91a7-f607e7ed1f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:20.795060 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34da4b-1577-4c04-91a7-f607e7ed1f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:20.795337 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34da4b-1577-4c04-91a7-f607e7ed1f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:20.795615 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34da4b-1577-4c04-91a7-f607e7ed1f7e admin admin] PATH_INFO: `/v3/projects/4571ff0de0f3460cbd122222fa652641/users/2a6e346d5ebb470eb4258fd097d197eb/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:20.805554 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-9cffb716-09d0-43d0-a576-252aab654030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d91faed9be642af977af7a34d8c5d37'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:20.825049 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-9cffb716-09d0-43d0-a576-252aab654030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d91faed9be642af977af7a34d8c5d37'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:20.832605 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34da4b-1577-4c04-91a7-f607e7ed1f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4571ff0de0f3460cbd122222fa652641, user_id=2a6e346d5ebb470eb4258fd097d197eb, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:20.833974 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1009/2019] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:53:20 2021] DELETE /identity/v3/users/0d91faed9be642af977af7a34d8c5d37 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:53:20.838458 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60b535-3693-4821-8dbb-4e933bbb64a4 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:20.838969 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60b535-3693-4821-8dbb-4e933bbb64a4 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:20.839466 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60b535-3693-4821-8dbb-4e933bbb64a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:20.887626 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-bd60b535-3693-4821-8dbb-4e933bbb64a4 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:20.890851 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-bd60b535-3693-4821-8dbb-4e933bbb64a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:20.899876 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34da4b-1577-4c04-91a7-f607e7ed1f7e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:20.931548 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1011/2020] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:20 2021] PUT /identity/v3/projects/4571ff0de0f3460cbd122222fa652641/users/2a6e346d5ebb470eb4258fd097d197eb/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:53:20.933633 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec73195-ea97-4e6d-8580-4631d262ca91 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:20.933633 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec73195-ea97-4e6d-8580-4631d262ca91 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:20.933633 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec73195-ea97-4e6d-8580-4631d262ca91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:20.969336 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-bec73195-ea97-4e6d-8580-4631d262ca91 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:20.970511 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-bec73195-ea97-4e6d-8580-4631d262ca91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:20.997459 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1010/2021] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:53:21.016427 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60b535-3693-4821-8dbb-4e933bbb64a4 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:21.018139 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-bd60b535-3693-4821-8dbb-4e933bbb64a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:21.085744 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1012/2022] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:53:21.095016 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec73195-ea97-4e6d-8580-4631d262ca91 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:21.096743 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60b535-3693-4821-8dbb-4e933bbb64a4 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:21.182631 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd600d-6145-43da-b8a8-059c4a2c672f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:21.183327 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd600d-6145-43da-b8a8-059c4a2c672f service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:21.183622 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd600d-6145-43da-b8a8-059c4a2c672f service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:21.183953 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd600d-6145-43da-b8a8-059c4a2c672f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:21.199130 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd600d-6145-43da-b8a8-059c4a2c672f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:21.203961 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec73195-ea97-4e6d-8580-4631d262ca91 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:21.212979 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c6cf0-f8d3-4e8d-bfb7-f18791bf41cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:21.213720 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c6cf0-f8d3-4e8d-bfb7-f18791bf41cf service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:21.214106 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c6cf0-f8d3-4e8d-bfb7-f18791bf41cf service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:21.214483 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c6cf0-f8d3-4e8d-bfb7-f18791bf41cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:21.226989 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd600d-6145-43da-b8a8-059c4a2c672f service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:21.228479 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c6cf0-f8d3-4e8d-bfb7-f18791bf41cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:21.238339 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1011/2023] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:53:21.260073 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c6cf0-f8d3-4e8d-bfb7-f18791bf41cf service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:21.271299 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1013/2024] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:53:21.471492 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd600d-6145-43da-b8a8-059c4a2c672f service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:21.473226 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-f8dd600d-6145-43da-b8a8-059c4a2c672f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:21.553576 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd600d-6145-43da-b8a8-059c4a2c672f service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:21.558125 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7561d89-b99b-4e06-86b0-0144c40d7221 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:21.559148 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7561d89-b99b-4e06-86b0-0144c40d7221 service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:21.559690 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7561d89-b99b-4e06-86b0-0144c40d7221 service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:21.560400 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7561d89-b99b-4e06-86b0-0144c40d7221 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:21.563429 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-b7561d89-b99b-4e06-86b0-0144c40d7221 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:21.653399 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7561d89-b99b-4e06-86b0-0144c40d7221 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:21.686058 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7561d89-b99b-4e06-86b0-0144c40d7221 service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:21.698449 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1012/2025] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:21 2021] GET /identity/v3/auth/tokens => generated 3747 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:53:22.077425 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c6cf0-f8d3-4e8d-bfb7-f18791bf41cf service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:22.079003 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-934c6cf0-f8d3-4e8d-bfb7-f18791bf41cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:22.092252 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7561d89-b99b-4e06-86b0-0144c40d7221 service cinder] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:22.094030 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-b7561d89-b99b-4e06-86b0-0144c40d7221 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:22.095539 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c6cf0-f8d3-4e8d-bfb7-f18791bf41cf service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:22.101055 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af306b2-b804-4081-b09e-1277030564f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:22.102051 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af306b2-b804-4081-b09e-1277030564f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:22.102344 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af306b2-b804-4081-b09e-1277030564f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:22.102624 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af306b2-b804-4081-b09e-1277030564f2 admin admin] PATH_INFO: `/v3/users/702d6326d00f484b85d27dfceb875d11` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:22.104546 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af306b2-b804-4081-b09e-1277030564f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=702d6326d00f484b85d27dfceb875d11)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:22.133522 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7561d89-b99b-4e06-86b0-0144c40d7221 service cinder] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:22.143113 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168a6f3-f553-456f-8f65-f580bded9942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:22.143940 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168a6f3-f553-456f-8f65-f580bded9942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:22.144295 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168a6f3-f553-456f-8f65-f580bded9942 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:22.144740 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168a6f3-f553-456f-8f65-f580bded9942 admin admin] PATH_INFO: `/v3/projects/eb866fc361f746c29289a87b8947f5d9` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:22.149247 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168a6f3-f553-456f-8f65-f580bded9942 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb866fc361f746c29289a87b8947f5d9)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:22.175298 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af306b2-b804-4081-b09e-1277030564f2 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:22.204850 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168a6f3-f553-456f-8f65-f580bded9942 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:22.304684 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-8af306b2-b804-4081-b09e-1277030564f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '702d6326d00f484b85d27dfceb875d11'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:22.317668 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-c168a6f3-f553-456f-8f65-f580bded9942 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb866fc361f746c29289a87b8947f5d9', 'request_id': 'req-c168a6f3-f553-456f-8f65-f580bded9942'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:22.327758 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-8af306b2-b804-4081-b09e-1277030564f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '702d6326d00f484b85d27dfceb875d11'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:22.329212 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-8af306b2-b804-4081-b09e-1277030564f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '702d6326d00f484b85d27dfceb875d11'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:22.335249 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-c168a6f3-f553-456f-8f65-f580bded9942 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb866fc361f746c29289a87b8947f5d9', 'request_id': 'req-c168a6f3-f553-456f-8f65-f580bded9942'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:22.344779 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-c168a6f3-f553-456f-8f65-f580bded9942 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb866fc361f746c29289a87b8947f5d9', 'request_id': 'req-c168a6f3-f553-456f-8f65-f580bded9942'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:22.345438 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-8af306b2-b804-4081-b09e-1277030564f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '702d6326d00f484b85d27dfceb875d11'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:22.359945 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-8af306b2-b804-4081-b09e-1277030564f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '702d6326d00f484b85d27dfceb875d11'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:22.366969 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-c168a6f3-f553-456f-8f65-f580bded9942 admin admin] The token cache is being invalidate because project eb866fc361f746c29289a87b8947f5d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:53:22.367293 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-c168a6f3-f553-456f-8f65-f580bded9942 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:22.367909 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-c168a6f3-f553-456f-8f65-f580bded9942 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:22.376051 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1013/2026] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:53:22 2021] DELETE /identity/v3/projects/eb866fc361f746c29289a87b8947f5d9 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:22.377528 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1014/2027] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:53:22 2021] DELETE /identity/v3/users/702d6326d00f484b85d27dfceb875d11 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:22.380630 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ba2d4-613e-402f-8a33-7f4f68b32065 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:22.380945 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ba2d4-613e-402f-8a33-7f4f68b32065 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:22.381414 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ba2d4-613e-402f-8a33-7f4f68b32065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:22.381599 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90cbf7-74fa-47eb-a4bd-7de040de153c None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:22.381902 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90cbf7-74fa-47eb-a4bd-7de040de153c None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:22.382186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90cbf7-74fa-47eb-a4bd-7de040de153c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:22.415383 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-2c90cbf7-74fa-47eb-a4bd-7de040de153c None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:22.416881 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-2c90cbf7-74fa-47eb-a4bd-7de040de153c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:22.420079 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-c39ba2d4-613e-402f-8a33-7f4f68b32065 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:22.422563 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-c39ba2d4-613e-402f-8a33-7f4f68b32065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:22.501289 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1015/2028] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:53:22.510843 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1014/2029] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:22.512015 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90cbf7-74fa-47eb-a4bd-7de040de153c None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:22.514103 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-2c90cbf7-74fa-47eb-a4bd-7de040de153c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:22.518794 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14293fe2-1c57-4985-a79a-7d5b9999803a None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:22.519101 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14293fe2-1c57-4985-a79a-7d5b9999803a None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:22.519386 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14293fe2-1c57-4985-a79a-7d5b9999803a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:22.543115 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-14293fe2-1c57-4985-a79a-7d5b9999803a None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:22.544395 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-14293fe2-1c57-4985-a79a-7d5b9999803a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:22.553280 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1015/2030] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:53:22.557380 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14293fe2-1c57-4985-a79a-7d5b9999803a None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:22.568996 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14293fe2-1c57-4985-a79a-7d5b9999803a None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:22.573817 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd0cb6-c88d-4f9a-b6a5-e99082070d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:22.574415 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd0cb6-c88d-4f9a-b6a5-e99082070d76 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:22.574844 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd0cb6-c88d-4f9a-b6a5-e99082070d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:22.575127 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd0cb6-c88d-4f9a-b6a5-e99082070d76 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:22.576345 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd0cb6-c88d-4f9a-b6a5-e99082070d76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:53:22.576712 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd0cb6-c88d-4f9a-b6a5-e99082070d76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:22.594354 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90cbf7-74fa-47eb-a4bd-7de040de153c None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:22.598184 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f100fa-f153-4b49-8976-89046ffb1088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:22.599002 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f100fa-f153-4b49-8976-89046ffb1088 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:22.599133 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f100fa-f153-4b49-8976-89046ffb1088 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:22.599357 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f100fa-f153-4b49-8976-89046ffb1088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:22.603663 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd0cb6-c88d-4f9a-b6a5-e99082070d76 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:22.612076 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f100fa-f153-4b49-8976-89046ffb1088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:22.621047 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1016/2031] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:53:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:53:22.627842 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd0cb6-c88d-4f9a-b6a5-e99082070d76 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:22.638391 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f100fa-f153-4b49-8976-89046ffb1088 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:22.638582 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd0cb6-c88d-4f9a-b6a5-e99082070d76 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:22.644177 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4a811-1365-45a3-babd-4e966711d9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:22.645283 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4a811-1365-45a3-babd-4e966711d9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:22.645749 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4a811-1365-45a3-babd-4e966711d9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:22.646421 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4a811-1365-45a3-babd-4e966711d9b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:22.647154 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4a811-1365-45a3-babd-4e966711d9b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:22.650369 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1016/2032] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:22 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:53:22.679040 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4a811-1365-45a3-babd-4e966711d9b6 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:22.724350 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1017/2033] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:53:22 2021] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:22.729330 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f100fa-f153-4b49-8976-89046ffb1088 service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:22.752269 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f100fa-f153-4b49-8976-89046ffb1088 service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:22.813566 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852b214-76a9-422c-a34f-1d4c4155d208 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:22.814087 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852b214-76a9-422c-a34f-1d4c4155d208 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:22.814364 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852b214-76a9-422c-a34f-1d4c4155d208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:22.844592 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b4edd-281d-4619-8698-4f9604f57cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:22.845219 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b4edd-281d-4619-8698-4f9604f57cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:22.845510 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b4edd-281d-4619-8698-4f9604f57cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:22.845792 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b4edd-281d-4619-8698-4f9604f57cf0 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:22.846437 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b4edd-281d-4619-8698-4f9604f57cf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:22.902684 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b4edd-281d-4619-8698-4f9604f57cf0 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:22.913542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-2852b214-76a9-422c-a34f-1d4c4155d208 None None] MFA Rules not processed for user `2a6e346d5ebb470eb4258fd097d197eb`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:22.915240 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-2852b214-76a9-422c-a34f-1d4c4155d208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:22.930728 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1017/2034] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:53:22 2021] POST /identity/v3/users => generated 285 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:22.934263 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b4edd-281d-4619-8698-4f9604f57cf0 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:22.945979 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b4edd-281d-4619-8698-4f9604f57cf0 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:22.951158 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91126841-2835-4b35-aa72-88cb6d1246f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:22.951984 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91126841-2835-4b35-aa72-88cb6d1246f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:22.952273 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91126841-2835-4b35-aa72-88cb6d1246f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:22.952705 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91126841-2835-4b35-aa72-88cb6d1246f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:22.953428 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91126841-2835-4b35-aa72-88cb6d1246f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:22.984411 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91126841-2835-4b35-aa72-88cb6d1246f1 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:22.997179 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1018/2035] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:22 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:53:23.001183 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91126841-2835-4b35-aa72-88cb6d1246f1 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:23.009373 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1018/2036] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:22 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:53:23.016628 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852b214-76a9-422c-a34f-1d4c4155d208 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:23.018020 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-2852b214-76a9-422c-a34f-1d4c4155d208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:23.019483 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91126841-2835-4b35-aa72-88cb6d1246f1 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:23.025268 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d78dff-d8d8-45d0-8b08-4319a931cce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:23.026436 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d78dff-d8d8-45d0-8b08-4319a931cce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:23.026945 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d78dff-d8d8-45d0-8b08-4319a931cce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:23.027515 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d78dff-d8d8-45d0-8b08-4319a931cce3 admin admin] PATH_INFO: `/v3/projects/07f1392f4bce44c4bb68ab1dfd103f18/users/5c22f447fece425c99e9227948141a27/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:23.053091 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d78dff-d8d8-45d0-8b08-4319a931cce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f1392f4bce44c4bb68ab1dfd103f18, user_id=5c22f447fece425c99e9227948141a27, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:23.101573 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852b214-76a9-422c-a34f-1d4c4155d208 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:23.105932 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a79e15-59a6-48ad-9520-c8671437435d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:23.106530 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a79e15-59a6-48ad-9520-c8671437435d service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:23.107336 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a79e15-59a6-48ad-9520-c8671437435d service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:23.107599 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a79e15-59a6-48ad-9520-c8671437435d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:23.112623 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d78dff-d8d8-45d0-8b08-4319a931cce3 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:23.118915 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a79e15-59a6-48ad-9520-c8671437435d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:23.143404 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1019/2037] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:23 2021] PUT /identity/v3/projects/07f1392f4bce44c4bb68ab1dfd103f18/users/5c22f447fece425c99e9227948141a27/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:23.154863 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a79e15-59a6-48ad-9520-c8671437435d service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:23.157070 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6ee03-9952-45b9-8d2a-774b920513cc None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:23.159086 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6ee03-9952-45b9-8d2a-774b920513cc None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:23.159529 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6ee03-9952-45b9-8d2a-774b920513cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:23.172673 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1019/2038] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:23 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:53:23.202100 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-73f6ee03-9952-45b9-8d2a-774b920513cc None None] MFA Rules not processed for user `5c22f447fece425c99e9227948141a27`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:23.203477 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-73f6ee03-9952-45b9-8d2a-774b920513cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:23.294907 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1020/2039] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:23 2021] POST /identity/v3/auth/tokens => generated 3676 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:23.308959 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a79e15-59a6-48ad-9520-c8671437435d service cinder] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:23.311215 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-59a79e15-59a6-48ad-9520-c8671437435d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:23.337843 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6ee03-9952-45b9-8d2a-774b920513cc None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:23.339245 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-73f6ee03-9952-45b9-8d2a-774b920513cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:23.437533 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a79e15-59a6-48ad-9520-c8671437435d service cinder] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:23.439926 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6ee03-9952-45b9-8d2a-774b920513cc None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:23.444603 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa93a3-d706-4f96-b3ae-e4fd2cc0cf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:23.445804 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa93a3-d706-4f96-b3ae-e4fd2cc0cf00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:23.446185 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa93a3-d706-4f96-b3ae-e4fd2cc0cf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:23.446588 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa93a3-d706-4f96-b3ae-e4fd2cc0cf00 admin admin] PATH_INFO: `/v3/projects/a467968e44b8484d90f8329ba179c42b` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:23.447953 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa93a3-d706-4f96-b3ae-e4fd2cc0cf00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a467968e44b8484d90f8329ba179c42b)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:23.490733 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa93a3-d706-4f96-b3ae-e4fd2cc0cf00 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:23.515277 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df817b6-8a6b-42f2-bc9d-5aa1c62bccf2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1976a528ee24585bcaccc83e308fec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:23.518025 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df817b6-8a6b-42f2-bc9d-5aa1c62bccf2 service glance] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:23.518342 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df817b6-8a6b-42f2-bc9d-5aa1c62bccf2 service glance] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:23.518631 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df817b6-8a6b-42f2-bc9d-5aa1c62bccf2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:23.531017 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df817b6-8a6b-42f2-bc9d-5aa1c62bccf2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:23.561121 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df817b6-8a6b-42f2-bc9d-5aa1c62bccf2 service glance] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:23.572664 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1020/2040] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:23 2021] GET /identity/v3/auth/tokens => generated 3676 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:53:23.587765 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-86fa93a3-d706-4f96-b3ae-e4fd2cc0cf00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a467968e44b8484d90f8329ba179c42b', 'request_id': 'req-86fa93a3-d706-4f96-b3ae-e4fd2cc0cf00'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:23.598144 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-86fa93a3-d706-4f96-b3ae-e4fd2cc0cf00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a467968e44b8484d90f8329ba179c42b', 'request_id': 'req-86fa93a3-d706-4f96-b3ae-e4fd2cc0cf00'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:23.624517 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-86fa93a3-d706-4f96-b3ae-e4fd2cc0cf00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a467968e44b8484d90f8329ba179c42b', 'request_id': 'req-86fa93a3-d706-4f96-b3ae-e4fd2cc0cf00'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:23.634030 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-86fa93a3-d706-4f96-b3ae-e4fd2cc0cf00 admin admin] The token cache is being invalidate because project a467968e44b8484d90f8329ba179c42b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:53:23.634462 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-86fa93a3-d706-4f96-b3ae-e4fd2cc0cf00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:23.635130 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-86fa93a3-d706-4f96-b3ae-e4fd2cc0cf00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:23.637374 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1021/2041] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:53:23 2021] DELETE /identity/v3/projects/a467968e44b8484d90f8329ba179c42b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:23.641816 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df817b6-8a6b-42f2-bc9d-5aa1c62bccf2 service glance] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:23.652999 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df817b6-8a6b-42f2-bc9d-5aa1c62bccf2 service glance] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:23.755699 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002174d-173a-4e37-92f8-6a686726c0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:23.756557 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002174d-173a-4e37-92f8-6a686726c0df admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:23.756814 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002174d-173a-4e37-92f8-6a686726c0df admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:23.757100 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002174d-173a-4e37-92f8-6a686726c0df admin admin] PATH_INFO: `/v3/users/c38496124bc444288948d092226711ed` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:23.759630 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002174d-173a-4e37-92f8-6a686726c0df admin admin] RBAC: Authorizing `identity:delete_user(user_id=c38496124bc444288948d092226711ed)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:23.792368 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002174d-173a-4e37-92f8-6a686726c0df admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:23.905743 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-b002174d-173a-4e37-92f8-6a686726c0df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c38496124bc444288948d092226711ed'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:23.908474 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-b002174d-173a-4e37-92f8-6a686726c0df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c38496124bc444288948d092226711ed'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:23.927267 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-b002174d-173a-4e37-92f8-6a686726c0df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c38496124bc444288948d092226711ed'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:23.945942 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-b002174d-173a-4e37-92f8-6a686726c0df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c38496124bc444288948d092226711ed'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:23.955877 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-b002174d-173a-4e37-92f8-6a686726c0df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c38496124bc444288948d092226711ed'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:23.971784 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1021/2042] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:53:23 2021] DELETE /identity/v3/users/c38496124bc444288948d092226711ed => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:24.867482 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa93a3-d706-4f96-b3ae-e4fd2cc0cf00 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:24.869862 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-86fa93a3-d706-4f96-b3ae-e4fd2cc0cf00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:24.884263 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa93a3-d706-4f96-b3ae-e4fd2cc0cf00 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:25.038068 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00eb6eb-2ffa-4dde-8424-dc9beb5c5704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:25.038991 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00eb6eb-2ffa-4dde-8424-dc9beb5c5704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:25.039280 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00eb6eb-2ffa-4dde-8424-dc9beb5c5704 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:25.039564 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00eb6eb-2ffa-4dde-8424-dc9beb5c5704 admin admin] PATH_INFO: `/v3/projects/1aee2389d0bb436ab73bda8c10d1a551` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:25.040844 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00eb6eb-2ffa-4dde-8424-dc9beb5c5704 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aee2389d0bb436ab73bda8c10d1a551)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:25.068869 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00eb6eb-2ffa-4dde-8424-dc9beb5c5704 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:25.139214 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c00eb6eb-2ffa-4dde-8424-dc9beb5c5704 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aee2389d0bb436ab73bda8c10d1a551', 'request_id': 'req-c00eb6eb-2ffa-4dde-8424-dc9beb5c5704'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:25.152958 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c00eb6eb-2ffa-4dde-8424-dc9beb5c5704 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aee2389d0bb436ab73bda8c10d1a551', 'request_id': 'req-c00eb6eb-2ffa-4dde-8424-dc9beb5c5704'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:25.170515 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c00eb6eb-2ffa-4dde-8424-dc9beb5c5704 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aee2389d0bb436ab73bda8c10d1a551', 'request_id': 'req-c00eb6eb-2ffa-4dde-8424-dc9beb5c5704'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:25.183353 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c00eb6eb-2ffa-4dde-8424-dc9beb5c5704 admin admin] The token cache is being invalidate because project 1aee2389d0bb436ab73bda8c10d1a551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:53:25.184358 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c00eb6eb-2ffa-4dde-8424-dc9beb5c5704 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:25.185750 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c00eb6eb-2ffa-4dde-8424-dc9beb5c5704 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:25.188188 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1022/2043] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:53:24 2021] DELETE /identity/v3/projects/1aee2389d0bb436ab73bda8c10d1a551 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:25.191966 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002174d-173a-4e37-92f8-6a686726c0df admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:25.194223 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-b002174d-173a-4e37-92f8-6a686726c0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:25.213108 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002174d-173a-4e37-92f8-6a686726c0df admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:25.292176 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded5ca8-c4a7-4b5b-ab6f-bc49a0214e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:25.292988 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded5ca8-c4a7-4b5b-ab6f-bc49a0214e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:25.293279 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded5ca8-c4a7-4b5b-ab6f-bc49a0214e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:25.293561 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded5ca8-c4a7-4b5b-ab6f-bc49a0214e41 admin admin] PATH_INFO: `/v3/users/f7b921f74d16434c860558634efad704` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:25.295202 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded5ca8-c4a7-4b5b-ab6f-bc49a0214e41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7b921f74d16434c860558634efad704)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:25.322159 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded5ca8-c4a7-4b5b-ab6f-bc49a0214e41 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:25.385785 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-7ded5ca8-c4a7-4b5b-ab6f-bc49a0214e41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7b921f74d16434c860558634efad704'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:25.386473 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-7ded5ca8-c4a7-4b5b-ab6f-bc49a0214e41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7b921f74d16434c860558634efad704'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:25.395053 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-7ded5ca8-c4a7-4b5b-ab6f-bc49a0214e41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7b921f74d16434c860558634efad704'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:25.407456 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-7ded5ca8-c4a7-4b5b-ab6f-bc49a0214e41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7b921f74d16434c860558634efad704'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:25.416416 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-7ded5ca8-c4a7-4b5b-ab6f-bc49a0214e41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7b921f74d16434c860558634efad704'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:25.417411 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4eb6b-15c9-444a-a31f-03244f76eebb None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:25.417743 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4eb6b-15c9-444a-a31f-03244f76eebb None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:25.418064 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4eb6b-15c9-444a-a31f-03244f76eebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:25.426793 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1022/2044] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:53:25 2021] DELETE /identity/v3/users/f7b921f74d16434c860558634efad704 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:25.448569 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-52c4eb6b-15c9-444a-a31f-03244f76eebb None None] MFA Rules not processed for user `2a6e346d5ebb470eb4258fd097d197eb`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:25.449664 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-52c4eb6b-15c9-444a-a31f-03244f76eebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:25.535438 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1023/2045] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:25 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:53:26.127875 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded5ca8-c4a7-4b5b-ab6f-bc49a0214e41 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:26.129680 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-7ded5ca8-c4a7-4b5b-ab6f-bc49a0214e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:26.280572 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded5ca8-c4a7-4b5b-ab6f-bc49a0214e41 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:26.284927 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187df8e-096b-4857-8a44-39613dc74bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:26.285711 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187df8e-096b-4857-8a44-39613dc74bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:26.286161 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187df8e-096b-4857-8a44-39613dc74bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:26.286589 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187df8e-096b-4857-8a44-39613dc74bfa admin admin] PATH_INFO: `/v3/projects/9cc07280be1e4f2ea5e18cc545d7bd0f` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:26.287844 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187df8e-096b-4857-8a44-39613dc74bfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cc07280be1e4f2ea5e18cc545d7bd0f)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:26.315536 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187df8e-096b-4857-8a44-39613dc74bfa admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:26.374861 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f187df8e-096b-4857-8a44-39613dc74bfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cc07280be1e4f2ea5e18cc545d7bd0f', 'request_id': 'req-f187df8e-096b-4857-8a44-39613dc74bfa'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:26.383053 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f187df8e-096b-4857-8a44-39613dc74bfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cc07280be1e4f2ea5e18cc545d7bd0f', 'request_id': 'req-f187df8e-096b-4857-8a44-39613dc74bfa'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:26.388704 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f187df8e-096b-4857-8a44-39613dc74bfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cc07280be1e4f2ea5e18cc545d7bd0f', 'request_id': 'req-f187df8e-096b-4857-8a44-39613dc74bfa'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:26.406199 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f187df8e-096b-4857-8a44-39613dc74bfa admin admin] The token cache is being invalidate because project 9cc07280be1e4f2ea5e18cc545d7bd0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:53:26.406387 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f187df8e-096b-4857-8a44-39613dc74bfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:26.407221 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f187df8e-096b-4857-8a44-39613dc74bfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:26.408853 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1023/2046] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:53:26 2021] DELETE /identity/v3/projects/9cc07280be1e4f2ea5e18cc545d7bd0f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:26.416523 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b997bb-9827-4504-8482-3d30cb787c15 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:26.417102 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b997bb-9827-4504-8482-3d30cb787c15 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:26.417102 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b997bb-9827-4504-8482-3d30cb787c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:26.441343 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-e1b997bb-9827-4504-8482-3d30cb787c15 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:26.442709 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-e1b997bb-9827-4504-8482-3d30cb787c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:26.534694 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1024/2047] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:26.540328 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466c79d-7217-4982-8392-800069751ba9 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:26.540585 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466c79d-7217-4982-8392-800069751ba9 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:26.540861 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466c79d-7217-4982-8392-800069751ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:26.566511 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-9466c79d-7217-4982-8392-800069751ba9 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:26.567899 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-9466c79d-7217-4982-8392-800069751ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:26.576830 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1024/2048] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:26.581510 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b997bb-9827-4504-8482-3d30cb787c15 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:26.591924 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b997bb-9827-4504-8482-3d30cb787c15 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:26.599368 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a4601-cbb1-4a39-9c30-a5a5f4f90d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:26.599960 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a4601-cbb1-4a39-9c30-a5a5f4f90d4c admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:26.600246 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a4601-cbb1-4a39-9c30-a5a5f4f90d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:26.600529 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a4601-cbb1-4a39-9c30-a5a5f4f90d4c admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:26.601220 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a4601-cbb1-4a39-9c30-a5a5f4f90d4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:53:26.601514 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a4601-cbb1-4a39-9c30-a5a5f4f90d4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:26.650111 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a4601-cbb1-4a39-9c30-a5a5f4f90d4c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:26.673557 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1025/2049] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:53:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:53:26.679506 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466c79d-7217-4982-8392-800069751ba9 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:26.706305 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466c79d-7217-4982-8392-800069751ba9 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:26.718641 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5a8cb-77fe-42cb-8dbf-f2b7b4ddde84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:26.719337 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5a8cb-77fe-42cb-8dbf-f2b7b4ddde84 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:26.719703 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5a8cb-77fe-42cb-8dbf-f2b7b4ddde84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:26.720062 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5a8cb-77fe-42cb-8dbf-f2b7b4ddde84 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:26.721255 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5a8cb-77fe-42cb-8dbf-f2b7b4ddde84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:26.767248 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5a8cb-77fe-42cb-8dbf-f2b7b4ddde84 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:26.938994 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1025/2050] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:53:26 2021] POST /identity/v3/projects => generated 365 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:26.940128 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a4601-cbb1-4a39-9c30-a5a5f4f90d4c admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:26.950398 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a4601-cbb1-4a39-9c30-a5a5f4f90d4c admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:27.030721 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107faae-0c31-40f0-a2aa-5770ee22b545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:27.031624 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107faae-0c31-40f0-a2aa-5770ee22b545 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:27.032013 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107faae-0c31-40f0-a2aa-5770ee22b545 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:27.032398 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107faae-0c31-40f0-a2aa-5770ee22b545 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:27.033886 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107faae-0c31-40f0-a2aa-5770ee22b545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:27.062037 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107faae-0c31-40f0-a2aa-5770ee22b545 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:27.087344 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1026/2051] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:53:26 2021] POST /identity/v3/users => generated 283 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:27.091822 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5a8cb-77fe-42cb-8dbf-f2b7b4ddde84 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:27.103978 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5a8cb-77fe-42cb-8dbf-f2b7b4ddde84 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:27.108616 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f91b99-ea8e-4141-8843-ec43724f73c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:27.109214 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f91b99-ea8e-4141-8843-ec43724f73c3 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:27.109499 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f91b99-ea8e-4141-8843-ec43724f73c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:27.109808 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f91b99-ea8e-4141-8843-ec43724f73c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:27.110570 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f91b99-ea8e-4141-8843-ec43724f73c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:27.136650 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f91b99-ea8e-4141-8843-ec43724f73c3 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:27.147910 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1026/2052] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:27 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:53:27.153271 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107faae-0c31-40f0-a2aa-5770ee22b545 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:27.163333 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107faae-0c31-40f0-a2aa-5770ee22b545 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:27.168014 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b822cb-bc8c-46bf-a1f6-aa30b4a9eb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:27.169073 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b822cb-bc8c-46bf-a1f6-aa30b4a9eb18 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:27.169464 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b822cb-bc8c-46bf-a1f6-aa30b4a9eb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:27.169714 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b822cb-bc8c-46bf-a1f6-aa30b4a9eb18 admin admin] PATH_INFO: `/v3/projects/7dd0bcb664614307872df6dfd2fe970c/users/d87f4289c77c4891ada462981082e97a/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:27.197472 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b822cb-bc8c-46bf-a1f6-aa30b4a9eb18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd0bcb664614307872df6dfd2fe970c, user_id=d87f4289c77c4891ada462981082e97a, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:27.226547 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b822cb-bc8c-46bf-a1f6-aa30b4a9eb18 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:27.243473 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1027/2053] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:27 2021] PUT /identity/v3/projects/7dd0bcb664614307872df6dfd2fe970c/users/d87f4289c77c4891ada462981082e97a/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:27.254304 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36eb6e-bba1-48c3-ad6d-f49da49a0b68 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:27.254723 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36eb6e-bba1-48c3-ad6d-f49da49a0b68 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:27.255008 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36eb6e-bba1-48c3-ad6d-f49da49a0b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:27.327205 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-4a36eb6e-bba1-48c3-ad6d-f49da49a0b68 None None] MFA Rules not processed for user `d87f4289c77c4891ada462981082e97a`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:27.328389 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-4a36eb6e-bba1-48c3-ad6d-f49da49a0b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:27.451806 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1027/2054] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:27 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:27.462068 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b822cb-bc8c-46bf-a1f6-aa30b4a9eb18 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:27.464324 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c7b822cb-bc8c-46bf-a1f6-aa30b4a9eb18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:27.564542 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b822cb-bc8c-46bf-a1f6-aa30b4a9eb18 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:27.573605 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b906a1b-ff1f-4450-bba7-da2364431760 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:27.574432 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b906a1b-ff1f-4450-bba7-da2364431760 service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:27.574763 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b906a1b-ff1f-4450-bba7-da2364431760 service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:27.575034 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b906a1b-ff1f-4450-bba7-da2364431760 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:27.591713 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b906a1b-ff1f-4450-bba7-da2364431760 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:27.618318 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b906a1b-ff1f-4450-bba7-da2364431760 service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:27.628261 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1028/2055] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:27 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:53:31.225885 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36eb6e-bba1-48c3-ad6d-f49da49a0b68 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:31.228234 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-4a36eb6e-bba1-48c3-ad6d-f49da49a0b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:31.318152 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36eb6e-bba1-48c3-ad6d-f49da49a0b68 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:31.326739 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e474a3f-3fbb-4985-9c1e-4547457c3e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:31.326739 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e474a3f-3fbb-4985-9c1e-4547457c3e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:31.326739 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e474a3f-3fbb-4985-9c1e-4547457c3e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:31.326739 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e474a3f-3fbb-4985-9c1e-4547457c3e4d admin admin] PATH_INFO: `/v3/users/fc138a6520b541c692e49b6f3063c5c1` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:31.327549 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e474a3f-3fbb-4985-9c1e-4547457c3e4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc138a6520b541c692e49b6f3063c5c1)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:31.357979 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e474a3f-3fbb-4985-9c1e-4547457c3e4d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:31.418900 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-2e474a3f-3fbb-4985-9c1e-4547457c3e4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc138a6520b541c692e49b6f3063c5c1'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:31.420547 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-2e474a3f-3fbb-4985-9c1e-4547457c3e4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc138a6520b541c692e49b6f3063c5c1'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:31.430617 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-2e474a3f-3fbb-4985-9c1e-4547457c3e4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc138a6520b541c692e49b6f3063c5c1'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:31.447432 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-2e474a3f-3fbb-4985-9c1e-4547457c3e4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc138a6520b541c692e49b6f3063c5c1'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:31.467049 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-2e474a3f-3fbb-4985-9c1e-4547457c3e4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc138a6520b541c692e49b6f3063c5c1'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:31.479263 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1028/2056] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:53:31 2021] DELETE /identity/v3/users/fc138a6520b541c692e49b6f3063c5c1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:31.890597 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b906a1b-ff1f-4450-bba7-da2364431760 service cinder] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:31.908918 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b906a1b-ff1f-4450-bba7-da2364431760 service cinder] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:32.029813 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe9304-3c93-4dab-9fd2-c8b2740ee7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:32.030932 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe9304-3c93-4dab-9fd2-c8b2740ee7ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:32.031468 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe9304-3c93-4dab-9fd2-c8b2740ee7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:32.031684 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe9304-3c93-4dab-9fd2-c8b2740ee7ab admin admin] PATH_INFO: `/v3/projects/ffcf9686384c4da28a25fd97ff272168` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:32.033137 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe9304-3c93-4dab-9fd2-c8b2740ee7ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffcf9686384c4da28a25fd97ff272168)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:32.062280 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe9304-3c93-4dab-9fd2-c8b2740ee7ab admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:32.130597 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-aafe9304-3c93-4dab-9fd2-c8b2740ee7ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffcf9686384c4da28a25fd97ff272168', 'request_id': 'req-aafe9304-3c93-4dab-9fd2-c8b2740ee7ab'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:32.138834 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-aafe9304-3c93-4dab-9fd2-c8b2740ee7ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffcf9686384c4da28a25fd97ff272168', 'request_id': 'req-aafe9304-3c93-4dab-9fd2-c8b2740ee7ab'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:32.151362 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-aafe9304-3c93-4dab-9fd2-c8b2740ee7ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffcf9686384c4da28a25fd97ff272168', 'request_id': 'req-aafe9304-3c93-4dab-9fd2-c8b2740ee7ab'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:32.164061 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-aafe9304-3c93-4dab-9fd2-c8b2740ee7ab admin admin] The token cache is being invalidate because project ffcf9686384c4da28a25fd97ff272168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:53:32.164949 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-aafe9304-3c93-4dab-9fd2-c8b2740ee7ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:32.165917 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-aafe9304-3c93-4dab-9fd2-c8b2740ee7ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:32.168895 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1029/2057] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:53:31 2021] DELETE /identity/v3/projects/ffcf9686384c4da28a25fd97ff272168 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:32.174476 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049d69e-0e1d-449d-ac42-82f297cb3505 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:32.174642 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049d69e-0e1d-449d-ac42-82f297cb3505 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:32.175164 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049d69e-0e1d-449d-ac42-82f297cb3505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:32.200643 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-3049d69e-0e1d-449d-ac42-82f297cb3505 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:32.201803 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-3049d69e-0e1d-449d-ac42-82f297cb3505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:32.271896 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1029/2058] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:32.281194 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df140e64-c1e1-458f-87fb-be307bf05c3b None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:32.281517 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df140e64-c1e1-458f-87fb-be307bf05c3b None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:32.281753 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df140e64-c1e1-458f-87fb-be307bf05c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:32.310333 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-df140e64-c1e1-458f-87fb-be307bf05c3b None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:32.312922 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-df140e64-c1e1-458f-87fb-be307bf05c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:32.324514 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1030/2059] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:53:32.329798 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049d69e-0e1d-449d-ac42-82f297cb3505 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:32.340541 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049d69e-0e1d-449d-ac42-82f297cb3505 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:32.350227 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f37f4-c09a-4193-bac6-b93dc96467fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:32.351366 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f37f4-c09a-4193-bac6-b93dc96467fa admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:32.351884 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f37f4-c09a-4193-bac6-b93dc96467fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:32.352513 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f37f4-c09a-4193-bac6-b93dc96467fa admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:32.353425 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f37f4-c09a-4193-bac6-b93dc96467fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:53:32.354116 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f37f4-c09a-4193-bac6-b93dc96467fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:32.390804 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f37f4-c09a-4193-bac6-b93dc96467fa admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:32.421422 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1030/2060] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:53:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:53:32.425627 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df140e64-c1e1-458f-87fb-be307bf05c3b None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:32.438389 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df140e64-c1e1-458f-87fb-be307bf05c3b None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:32.446931 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa015b-ca98-4948-a727-154c3158faf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:32.447979 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa015b-ca98-4948-a727-154c3158faf9 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:32.448471 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa015b-ca98-4948-a727-154c3158faf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:32.448953 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa015b-ca98-4948-a727-154c3158faf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:32.450588 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa015b-ca98-4948-a727-154c3158faf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:32.487939 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa015b-ca98-4948-a727-154c3158faf9 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:32.527132 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1031/2061] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:53:32 2021] POST /identity/v3/projects => generated 405 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:32.531175 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f37f4-c09a-4193-bac6-b93dc96467fa admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:32.542271 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f37f4-c09a-4193-bac6-b93dc96467fa admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:32.672105 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c562c27-1cc9-46b5-b59f-44340c3d9bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:32.673046 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c562c27-1cc9-46b5-b59f-44340c3d9bcf admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:32.676114 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c562c27-1cc9-46b5-b59f-44340c3d9bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:32.676657 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c562c27-1cc9-46b5-b59f-44340c3d9bcf admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:32.677530 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c562c27-1cc9-46b5-b59f-44340c3d9bcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:32.709148 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c562c27-1cc9-46b5-b59f-44340c3d9bcf admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:32.739159 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1031/2062] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:53:32 2021] POST /identity/v3/users => generated 303 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:32.739946 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa015b-ca98-4948-a727-154c3158faf9 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:32.751679 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa015b-ca98-4948-a727-154c3158faf9 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:32.756785 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a219b4-907f-4e89-ae3a-6fa5d97cd2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:32.757753 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a219b4-907f-4e89-ae3a-6fa5d97cd2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:32.758046 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a219b4-907f-4e89-ae3a-6fa5d97cd2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:32.758470 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a219b4-907f-4e89-ae3a-6fa5d97cd2e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:32.759278 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a219b4-907f-4e89-ae3a-6fa5d97cd2e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:32.788749 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a219b4-907f-4e89-ae3a-6fa5d97cd2e5 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:32.802726 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1032/2063] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:32 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:53:32.806712 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c562c27-1cc9-46b5-b59f-44340c3d9bcf admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:32.817509 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c562c27-1cc9-46b5-b59f-44340c3d9bcf admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:32.822137 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978d66f-92af-4fbd-8692-258ad4f64c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:32.823180 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978d66f-92af-4fbd-8692-258ad4f64c00 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:32.823468 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978d66f-92af-4fbd-8692-258ad4f64c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:32.823749 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978d66f-92af-4fbd-8692-258ad4f64c00 admin admin] PATH_INFO: `/v3/projects/e084996ddb1f4694a769c5531c95580f/users/7308bb88c8684d0c96ef3e424e01fc3b/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:32.847376 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978d66f-92af-4fbd-8692-258ad4f64c00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e084996ddb1f4694a769c5531c95580f, user_id=7308bb88c8684d0c96ef3e424e01fc3b, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:32.903412 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978d66f-92af-4fbd-8692-258ad4f64c00 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:32.924547 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1032/2064] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:32 2021] PUT /identity/v3/projects/e084996ddb1f4694a769c5531c95580f/users/7308bb88c8684d0c96ef3e424e01fc3b/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:53:32.929897 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d5935-c209-4d10-9abd-9c45344ba3b4 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:32.930757 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d5935-c209-4d10-9abd-9c45344ba3b4 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:32.931150 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d5935-c209-4d10-9abd-9c45344ba3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:32.956407 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-530d5935-c209-4d10-9abd-9c45344ba3b4 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:32.957559 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-530d5935-c209-4d10-9abd-9c45344ba3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:33.025475 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1033/2065] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:33.039072 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978d66f-92af-4fbd-8692-258ad4f64c00 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:33.040957 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-e978d66f-92af-4fbd-8692-258ad4f64c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:33.120570 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978d66f-92af-4fbd-8692-258ad4f64c00 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:33.124504 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e39af3-0900-47c6-b81e-89917b245440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:33.125069 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e39af3-0900-47c6-b81e-89917b245440 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:33.125352 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e39af3-0900-47c6-b81e-89917b245440 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:33.125628 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e39af3-0900-47c6-b81e-89917b245440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:33.135399 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e39af3-0900-47c6-b81e-89917b245440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:33.166451 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e39af3-0900-47c6-b81e-89917b245440 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:33.177284 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1033/2066] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:33 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:53:34.105119 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015702f0-6f37-4c0c-acc3-aac5cc026fde None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:34.105507 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015702f0-6f37-4c0c-acc3-aac5cc026fde None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:34.105696 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015702f0-6f37-4c0c-acc3-aac5cc026fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:34.155870 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-015702f0-6f37-4c0c-acc3-aac5cc026fde None None] MFA Rules not processed for user `7308bb88c8684d0c96ef3e424e01fc3b`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:34.157402 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-015702f0-6f37-4c0c-acc3-aac5cc026fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:34.290432 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1034/2067] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:34 2021] POST /identity/v3/auth/tokens => generated 3712 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:34.296875 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e39af3-0900-47c6-b81e-89917b245440 service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:34.306823 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e39af3-0900-47c6-b81e-89917b245440 service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:34.311976 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdef598-2601-489a-911a-84e228d45df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:34.312567 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdef598-2601-489a-911a-84e228d45df7 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:34.312962 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdef598-2601-489a-911a-84e228d45df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:34.313334 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdef598-2601-489a-911a-84e228d45df7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:34.314129 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdef598-2601-489a-911a-84e228d45df7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:34.348832 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdef598-2601-489a-911a-84e228d45df7 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:34.384036 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1034/2068] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:53:34 2021] POST /identity/v3/projects => generated 405 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:34.391806 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015702f0-6f37-4c0c-acc3-aac5cc026fde None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:34.413805 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015702f0-6f37-4c0c-acc3-aac5cc026fde None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:34.513766 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ff715-a835-440f-97a6-848ce471f8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:34.514919 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ff715-a835-440f-97a6-848ce471f8fe admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:34.515383 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ff715-a835-440f-97a6-848ce471f8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:34.515735 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ff715-a835-440f-97a6-848ce471f8fe admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:34.516581 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ff715-a835-440f-97a6-848ce471f8fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:34.554414 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ff715-a835-440f-97a6-848ce471f8fe admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:34.597659 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1035/2069] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:53:34 2021] POST /identity/v3/users => generated 309 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:34.601994 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdef598-2601-489a-911a-84e228d45df7 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:34.619601 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdef598-2601-489a-911a-84e228d45df7 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:34.625955 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba356c9-51d1-479d-9c2a-114a1e54bc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:34.626804 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba356c9-51d1-479d-9c2a-114a1e54bc13 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:34.627244 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba356c9-51d1-479d-9c2a-114a1e54bc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:34.627801 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba356c9-51d1-479d-9c2a-114a1e54bc13 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:34.628675 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba356c9-51d1-479d-9c2a-114a1e54bc13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:34.660695 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba356c9-51d1-479d-9c2a-114a1e54bc13 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:34.671778 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1035/2070] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:34 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:53:34.676211 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ff715-a835-440f-97a6-848ce471f8fe admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:34.687692 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ff715-a835-440f-97a6-848ce471f8fe admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:34.692748 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2a791-bfa6-46cd-bb1c-43d26c2e47fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:34.693561 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2a791-bfa6-46cd-bb1c-43d26c2e47fe admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:34.693842 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2a791-bfa6-46cd-bb1c-43d26c2e47fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:34.694116 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2a791-bfa6-46cd-bb1c-43d26c2e47fe admin admin] PATH_INFO: `/v3/projects/56537c0663ed4b8fbdc9de1d793ed58d/users/7d04f8e12c5c480ca9461ba995502007/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:34.716000 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2a791-bfa6-46cd-bb1c-43d26c2e47fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=56537c0663ed4b8fbdc9de1d793ed58d, user_id=7d04f8e12c5c480ca9461ba995502007, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:34.744901 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2a791-bfa6-46cd-bb1c-43d26c2e47fe admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:34.758761 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1036/2071] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:34 2021] PUT /identity/v3/projects/56537c0663ed4b8fbdc9de1d793ed58d/users/7d04f8e12c5c480ca9461ba995502007/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:34.763619 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba356c9-51d1-479d-9c2a-114a1e54bc13 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:34.773432 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba356c9-51d1-479d-9c2a-114a1e54bc13 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:34.845260 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac9ab5-27fb-4c5c-ac3d-ee33c63adb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:34.845953 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac9ab5-27fb-4c5c-ac3d-ee33c63adb12 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:34.846317 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac9ab5-27fb-4c5c-ac3d-ee33c63adb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:34.846685 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac9ab5-27fb-4c5c-ac3d-ee33c63adb12 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:34.847505 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac9ab5-27fb-4c5c-ac3d-ee33c63adb12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:34.882239 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac9ab5-27fb-4c5c-ac3d-ee33c63adb12 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:34.894768 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1036/2072] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:34 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:53:34.898742 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2a791-bfa6-46cd-bb1c-43d26c2e47fe admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:34.914588 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2a791-bfa6-46cd-bb1c-43d26c2e47fe admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:34.926006 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fabe75-aee9-4951-a0b0-28a6c6a4b2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:34.927094 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fabe75-aee9-4951-a0b0-28a6c6a4b2fa admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:34.927544 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fabe75-aee9-4951-a0b0-28a6c6a4b2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:34.927853 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fabe75-aee9-4951-a0b0-28a6c6a4b2fa admin admin] PATH_INFO: `/v3/projects/56537c0663ed4b8fbdc9de1d793ed58d/users/7d04f8e12c5c480ca9461ba995502007/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:34.929786 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fabe75-aee9-4951-a0b0-28a6c6a4b2fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=56537c0663ed4b8fbdc9de1d793ed58d, user_id=7d04f8e12c5c480ca9461ba995502007, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:34.958303 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fabe75-aee9-4951-a0b0-28a6c6a4b2fa admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:34.978910 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1037/2073] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:34 2021] PUT /identity/v3/projects/56537c0663ed4b8fbdc9de1d793ed58d/users/7d04f8e12c5c480ca9461ba995502007/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:34.983230 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac9ab5-27fb-4c5c-ac3d-ee33c63adb12 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:34.993254 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac9ab5-27fb-4c5c-ac3d-ee33c63adb12 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:35.071157 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aad756-5875-46d5-b69f-245a9dfc3fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:35.071756 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aad756-5875-46d5-b69f-245a9dfc3fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:35.072038 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aad756-5875-46d5-b69f-245a9dfc3fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:35.072314 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aad756-5875-46d5-b69f-245a9dfc3fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:35.073026 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aad756-5875-46d5-b69f-245a9dfc3fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:35.100091 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aad756-5875-46d5-b69f-245a9dfc3fc6 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:35.110851 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1037/2074] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:34 2021] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:53:35.114995 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fabe75-aee9-4951-a0b0-28a6c6a4b2fa admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:35.125926 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fabe75-aee9-4951-a0b0-28a6c6a4b2fa admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:35.130129 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d64505-2616-4ffe-b358-64b79824bd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:35.131367 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d64505-2616-4ffe-b358-64b79824bd2c admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:35.133604 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d64505-2616-4ffe-b358-64b79824bd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:35.133604 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d64505-2616-4ffe-b358-64b79824bd2c admin admin] PATH_INFO: `/v3/projects/56537c0663ed4b8fbdc9de1d793ed58d/users/7d04f8e12c5c480ca9461ba995502007/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:35.134671 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d64505-2616-4ffe-b358-64b79824bd2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=56537c0663ed4b8fbdc9de1d793ed58d, user_id=7d04f8e12c5c480ca9461ba995502007, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:35.163914 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d64505-2616-4ffe-b358-64b79824bd2c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:35.180502 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1038/2075] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:35 2021] PUT /identity/v3/projects/56537c0663ed4b8fbdc9de1d793ed58d/users/7d04f8e12c5c480ca9461ba995502007/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:35.520882 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2122b-17d0-40cd-bbf3-7e8fa4c49e2f None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:35.521390 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2122b-17d0-40cd-bbf3-7e8fa4c49e2f None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:35.521576 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2122b-17d0-40cd-bbf3-7e8fa4c49e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:35.550421 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-c9e2122b-17d0-40cd-bbf3-7e8fa4c49e2f None None] MFA Rules not processed for user `e8cf467bd7664df4a7f9d8c45f12a1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:35.552018 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-c9e2122b-17d0-40cd-bbf3-7e8fa4c49e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:35.627528 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1038/2076] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:35 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:53:36.237388 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b3f9b-767b-4909-8b94-0af62c534b10 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:36.237921 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b3f9b-767b-4909-8b94-0af62c534b10 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:36.238037 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b3f9b-767b-4909-8b94-0af62c534b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:36.307134 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-1a2b3f9b-767b-4909-8b94-0af62c534b10 None None] MFA Rules not processed for user `7d04f8e12c5c480ca9461ba995502007`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:36.317345 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-1a2b3f9b-767b-4909-8b94-0af62c534b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:36.452482 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1039/2077] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:36 2021] POST /identity/v3/auth/tokens => generated 3779 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:38.921756 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2122b-17d0-40cd-bbf3-7e8fa4c49e2f None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:38.991091 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2122b-17d0-40cd-bbf3-7e8fa4c49e2f None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:38.995047 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4240c94-ebe2-44cd-b479-4fabcb314144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:38.995832 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4240c94-ebe2-44cd-b479-4fabcb314144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:38.996136 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4240c94-ebe2-44cd-b479-4fabcb314144 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:38.996398 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4240c94-ebe2-44cd-b479-4fabcb314144 admin admin] PATH_INFO: `/v3/users/7308bb88c8684d0c96ef3e424e01fc3b` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:38.997981 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4240c94-ebe2-44cd-b479-4fabcb314144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7308bb88c8684d0c96ef3e424e01fc3b)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:39.023820 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4240c94-ebe2-44cd-b479-4fabcb314144 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:39.069477 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d4240c94-ebe2-44cd-b479-4fabcb314144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7308bb88c8684d0c96ef3e424e01fc3b'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:39.070086 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d4240c94-ebe2-44cd-b479-4fabcb314144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7308bb88c8684d0c96ef3e424e01fc3b'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:39.078355 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d4240c94-ebe2-44cd-b479-4fabcb314144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7308bb88c8684d0c96ef3e424e01fc3b'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:39.089771 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d4240c94-ebe2-44cd-b479-4fabcb314144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7308bb88c8684d0c96ef3e424e01fc3b'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:39.096664 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d4240c94-ebe2-44cd-b479-4fabcb314144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7308bb88c8684d0c96ef3e424e01fc3b'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:39.102497 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1039/2078] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:53:38 2021] DELETE /identity/v3/users/7308bb88c8684d0c96ef3e424e01fc3b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:39.375799 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b3f9b-767b-4909-8b94-0af62c534b10 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:39.386552 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b3f9b-767b-4909-8b94-0af62c534b10 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:39.450404 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce674401-8bf9-4178-832b-1b9a64f1329f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:39.451157 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce674401-8bf9-4178-832b-1b9a64f1329f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:39.451444 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce674401-8bf9-4178-832b-1b9a64f1329f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:39.451724 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce674401-8bf9-4178-832b-1b9a64f1329f admin admin] PATH_INFO: `/v3/projects/e084996ddb1f4694a769c5531c95580f` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:39.452797 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce674401-8bf9-4178-832b-1b9a64f1329f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e084996ddb1f4694a769c5531c95580f)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:39.481618 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce674401-8bf9-4178-832b-1b9a64f1329f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:39.537795 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ce674401-8bf9-4178-832b-1b9a64f1329f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e084996ddb1f4694a769c5531c95580f', 'request_id': 'req-ce674401-8bf9-4178-832b-1b9a64f1329f'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:39.544873 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ce674401-8bf9-4178-832b-1b9a64f1329f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e084996ddb1f4694a769c5531c95580f', 'request_id': 'req-ce674401-8bf9-4178-832b-1b9a64f1329f'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:39.556752 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ce674401-8bf9-4178-832b-1b9a64f1329f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e084996ddb1f4694a769c5531c95580f', 'request_id': 'req-ce674401-8bf9-4178-832b-1b9a64f1329f'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:39.566786 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ce674401-8bf9-4178-832b-1b9a64f1329f admin admin] The token cache is being invalidate because project e084996ddb1f4694a769c5531c95580f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:53:39.567071 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ce674401-8bf9-4178-832b-1b9a64f1329f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:39.567701 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ce674401-8bf9-4178-832b-1b9a64f1329f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:39.569163 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1040/2079] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:53:39 2021] DELETE /identity/v3/projects/e084996ddb1f4694a769c5531c95580f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:39.573364 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4240c94-ebe2-44cd-b479-4fabcb314144 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:39.575314 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-d4240c94-ebe2-44cd-b479-4fabcb314144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:39.587851 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4240c94-ebe2-44cd-b479-4fabcb314144 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:39.652618 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5718b-2aea-41af-b4e1-baaf789529c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:39.653705 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5718b-2aea-41af-b4e1-baaf789529c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:39.653997 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5718b-2aea-41af-b4e1-baaf789529c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:39.654281 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5718b-2aea-41af-b4e1-baaf789529c4 admin admin] PATH_INFO: `/v3/users/7d04f8e12c5c480ca9461ba995502007` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:39.655441 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5718b-2aea-41af-b4e1-baaf789529c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d04f8e12c5c480ca9461ba995502007)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:39.681074 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5718b-2aea-41af-b4e1-baaf789529c4 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:39.729892 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-70c5718b-2aea-41af-b4e1-baaf789529c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d04f8e12c5c480ca9461ba995502007'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:39.730505 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-70c5718b-2aea-41af-b4e1-baaf789529c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d04f8e12c5c480ca9461ba995502007'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:39.738437 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-70c5718b-2aea-41af-b4e1-baaf789529c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d04f8e12c5c480ca9461ba995502007'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:39.750914 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-70c5718b-2aea-41af-b4e1-baaf789529c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d04f8e12c5c480ca9461ba995502007'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:39.758126 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-70c5718b-2aea-41af-b4e1-baaf789529c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d04f8e12c5c480ca9461ba995502007'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:39.765422 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1040/2080] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:53:39 2021] DELETE /identity/v3/users/7d04f8e12c5c480ca9461ba995502007 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:40.054072 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce674401-8bf9-4178-832b-1b9a64f1329f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:40.055577 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-ce674401-8bf9-4178-832b-1b9a64f1329f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:40.068337 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce674401-8bf9-4178-832b-1b9a64f1329f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:40.135065 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82091ce3-48f7-4a33-b984-97db9f2c8e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:40.135853 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82091ce3-48f7-4a33-b984-97db9f2c8e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:40.136140 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82091ce3-48f7-4a33-b984-97db9f2c8e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:40.136419 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82091ce3-48f7-4a33-b984-97db9f2c8e4d admin admin] PATH_INFO: `/v3/projects/56537c0663ed4b8fbdc9de1d793ed58d` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:40.137561 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82091ce3-48f7-4a33-b984-97db9f2c8e4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=56537c0663ed4b8fbdc9de1d793ed58d)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:40.163702 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82091ce3-48f7-4a33-b984-97db9f2c8e4d admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:40.213446 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-82091ce3-48f7-4a33-b984-97db9f2c8e4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56537c0663ed4b8fbdc9de1d793ed58d', 'request_id': 'req-82091ce3-48f7-4a33-b984-97db9f2c8e4d'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:40.221363 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-82091ce3-48f7-4a33-b984-97db9f2c8e4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56537c0663ed4b8fbdc9de1d793ed58d', 'request_id': 'req-82091ce3-48f7-4a33-b984-97db9f2c8e4d'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:40.233875 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-82091ce3-48f7-4a33-b984-97db9f2c8e4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56537c0663ed4b8fbdc9de1d793ed58d', 'request_id': 'req-82091ce3-48f7-4a33-b984-97db9f2c8e4d'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:40.243960 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-82091ce3-48f7-4a33-b984-97db9f2c8e4d admin admin] The token cache is being invalidate because project 56537c0663ed4b8fbdc9de1d793ed58d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:53:40.244227 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-82091ce3-48f7-4a33-b984-97db9f2c8e4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:40.244834 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-82091ce3-48f7-4a33-b984-97db9f2c8e4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:40.246239 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1041/2081] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:53:40 2021] DELETE /identity/v3/projects/56537c0663ed4b8fbdc9de1d793ed58d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:40.252604 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63732635-cb83-4f53-815b-c085d67ae257 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:40.253093 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63732635-cb83-4f53-815b-c085d67ae257 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:40.253182 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63732635-cb83-4f53-815b-c085d67ae257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:40.275402 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-63732635-cb83-4f53-815b-c085d67ae257 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:40.276535 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-63732635-cb83-4f53-815b-c085d67ae257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:40.342558 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1041/2082] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:40.350300 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e832b9-6c2b-42f0-8738-4e6008f9f1eb None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:40.350532 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e832b9-6c2b-42f0-8738-4e6008f9f1eb None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:40.350867 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e832b9-6c2b-42f0-8738-4e6008f9f1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:40.374420 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-31e832b9-6c2b-42f0-8738-4e6008f9f1eb None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:40.375602 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-31e832b9-6c2b-42f0-8738-4e6008f9f1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:40.382720 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1042/2083] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:40.387007 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63732635-cb83-4f53-815b-c085d67ae257 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:40.396344 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63732635-cb83-4f53-815b-c085d67ae257 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:40.400538 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f584286-181b-4dc0-9a08-e6cf3dcfcf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:40.401117 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f584286-181b-4dc0-9a08-e6cf3dcfcf4d admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:40.401405 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f584286-181b-4dc0-9a08-e6cf3dcfcf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:40.401710 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f584286-181b-4dc0-9a08-e6cf3dcfcf4d admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:40.402427 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f584286-181b-4dc0-9a08-e6cf3dcfcf4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:53:40.403262 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f584286-181b-4dc0-9a08-e6cf3dcfcf4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:40.429030 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f584286-181b-4dc0-9a08-e6cf3dcfcf4d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:40.443958 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1042/2084] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:53:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:53:40.447702 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e832b9-6c2b-42f0-8738-4e6008f9f1eb None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:40.456811 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e832b9-6c2b-42f0-8738-4e6008f9f1eb None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:40.461023 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bc968-c18f-4a86-ba78-2548bc036663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:40.461601 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bc968-c18f-4a86-ba78-2548bc036663 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:40.461890 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bc968-c18f-4a86-ba78-2548bc036663 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:40.462171 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bc968-c18f-4a86-ba78-2548bc036663 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:40.462849 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8bc968-c18f-4a86-ba78-2548bc036663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:40.489477 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8bc968-c18f-4a86-ba78-2548bc036663 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:40.521135 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1043/2085] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:53:40 2021] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:53:40.522860 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f584286-181b-4dc0-9a08-e6cf3dcfcf4d admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:40.533268 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f584286-181b-4dc0-9a08-e6cf3dcfcf4d admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:40.597447 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c64e7e-26cd-4c69-b589-5b5b4545f20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:40.598048 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c64e7e-26cd-4c69-b589-5b5b4545f20c admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:40.598332 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c64e7e-26cd-4c69-b589-5b5b4545f20c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:40.598612 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c64e7e-26cd-4c69-b589-5b5b4545f20c admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:40.599270 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c64e7e-26cd-4c69-b589-5b5b4545f20c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:40.625083 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c64e7e-26cd-4c69-b589-5b5b4545f20c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:40.647763 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1043/2086] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:53:40 2021] POST /identity/v3/users => generated 286 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:40.651677 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bc968-c18f-4a86-ba78-2548bc036663 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:40.662170 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bc968-c18f-4a86-ba78-2548bc036663 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:40.666453 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92949d5-b630-44a4-aca7-98053485a8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:40.667091 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92949d5-b630-44a4-aca7-98053485a8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:40.667399 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92949d5-b630-44a4-aca7-98053485a8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:40.667691 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92949d5-b630-44a4-aca7-98053485a8c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:40.668410 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92949d5-b630-44a4-aca7-98053485a8c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:40.694742 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92949d5-b630-44a4-aca7-98053485a8c5 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:40.710330 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1044/2087] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:40 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:53:40.711680 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c64e7e-26cd-4c69-b589-5b5b4545f20c admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:40.721826 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c64e7e-26cd-4c69-b589-5b5b4545f20c admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:40.725955 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede41c1a-ed78-4258-9d4c-2caaca5aee90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:40.726796 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede41c1a-ed78-4258-9d4c-2caaca5aee90 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:40.727083 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede41c1a-ed78-4258-9d4c-2caaca5aee90 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:40.727359 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede41c1a-ed78-4258-9d4c-2caaca5aee90 admin admin] PATH_INFO: `/v3/projects/16e03105e4724ce5b0d4972234afadfd/users/03a0c70dacb343e1b3913d0197cf4417/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:40.747107 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede41c1a-ed78-4258-9d4c-2caaca5aee90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16e03105e4724ce5b0d4972234afadfd, user_id=03a0c70dacb343e1b3913d0197cf4417, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:40.774196 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede41c1a-ed78-4258-9d4c-2caaca5aee90 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:40.787806 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1044/2088] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:40 2021] PUT /identity/v3/projects/16e03105e4724ce5b0d4972234afadfd/users/03a0c70dacb343e1b3913d0197cf4417/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:40.797826 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb89d1a-0ce8-4dab-a73e-5e91917c895e None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:40.798143 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb89d1a-0ce8-4dab-a73e-5e91917c895e None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:40.798577 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb89d1a-0ce8-4dab-a73e-5e91917c895e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:40.837328 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-7eb89d1a-0ce8-4dab-a73e-5e91917c895e None None] MFA Rules not processed for user `03a0c70dacb343e1b3913d0197cf4417`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:40.838844 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-7eb89d1a-0ce8-4dab-a73e-5e91917c895e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:40.933604 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1045/2089] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:40 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:40.935945 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede41c1a-ed78-4258-9d4c-2caaca5aee90 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:41.009903 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede41c1a-ed78-4258-9d4c-2caaca5aee90 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:41.014800 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff852880-d468-4827-adc1-957f63b8e92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:41.015392 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff852880-d468-4827-adc1-957f63b8e92f admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:41.015678 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff852880-d468-4827-adc1-957f63b8e92f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:41.015958 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff852880-d468-4827-adc1-957f63b8e92f admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:41.016594 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff852880-d468-4827-adc1-957f63b8e92f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:41.043025 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff852880-d468-4827-adc1-957f63b8e92f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:41.070773 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1045/2090] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:53:40 2021] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:53:41.075003 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb89d1a-0ce8-4dab-a73e-5e91917c895e None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:41.085443 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb89d1a-0ce8-4dab-a73e-5e91917c895e None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:41.154954 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a234c7e-4804-4a6b-9f6d-cc960d2be9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:41.155554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a234c7e-4804-4a6b-9f6d-cc960d2be9b1 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:41.155841 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a234c7e-4804-4a6b-9f6d-cc960d2be9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:41.156123 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a234c7e-4804-4a6b-9f6d-cc960d2be9b1 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:41.156764 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a234c7e-4804-4a6b-9f6d-cc960d2be9b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:41.182983 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a234c7e-4804-4a6b-9f6d-cc960d2be9b1 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:41.206905 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1046/2091] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:53:41 2021] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:53:41.210874 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff852880-d468-4827-adc1-957f63b8e92f admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:41.221313 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff852880-d468-4827-adc1-957f63b8e92f admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:41.225609 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6193567-f8a3-46a9-a06b-95de73281532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:41.226202 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6193567-f8a3-46a9-a06b-95de73281532 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:41.226485 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6193567-f8a3-46a9-a06b-95de73281532 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:41.226800 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6193567-f8a3-46a9-a06b-95de73281532 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:41.227486 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6193567-f8a3-46a9-a06b-95de73281532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:41.254627 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6193567-f8a3-46a9-a06b-95de73281532 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:41.270110 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1046/2092] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:41 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:53:41.271617 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a234c7e-4804-4a6b-9f6d-cc960d2be9b1 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:41.286692 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a234c7e-4804-4a6b-9f6d-cc960d2be9b1 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:41.291129 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525969a-4c03-439a-901e-3bf1dd3b18b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:41.292070 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525969a-4c03-439a-901e-3bf1dd3b18b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:41.292456 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525969a-4c03-439a-901e-3bf1dd3b18b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:41.292838 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525969a-4c03-439a-901e-3bf1dd3b18b5 admin admin] PATH_INFO: `/v3/projects/3114d6ad3cff4bd48c5775f76c631941/users/09b2bcae8c634e5fb8879b979a831a9f/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:41.316702 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525969a-4c03-439a-901e-3bf1dd3b18b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3114d6ad3cff4bd48c5775f76c631941, user_id=09b2bcae8c634e5fb8879b979a831a9f, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:41.345690 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525969a-4c03-439a-901e-3bf1dd3b18b5 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:41.360439 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1047/2093] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:41 2021] PUT /identity/v3/projects/3114d6ad3cff4bd48c5775f76c631941/users/09b2bcae8c634e5fb8879b979a831a9f/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:41.364201 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6193567-f8a3-46a9-a06b-95de73281532 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:41.376428 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6193567-f8a3-46a9-a06b-95de73281532 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:41.441650 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c9a8f-f70e-47dd-bdfa-d13e34c2dba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:41.442160 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c9a8f-f70e-47dd-bdfa-d13e34c2dba3 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:41.442445 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c9a8f-f70e-47dd-bdfa-d13e34c2dba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:41.442756 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c9a8f-f70e-47dd-bdfa-d13e34c2dba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:41.443441 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c9a8f-f70e-47dd-bdfa-d13e34c2dba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:41.469650 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c9a8f-f70e-47dd-bdfa-d13e34c2dba3 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:41.479467 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1047/2094] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:41 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:53:41.484921 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525969a-4c03-439a-901e-3bf1dd3b18b5 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:41.497874 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525969a-4c03-439a-901e-3bf1dd3b18b5 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:41.502078 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e9b24-e5f2-445e-a190-80006e0d8b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:41.502906 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e9b24-e5f2-445e-a190-80006e0d8b33 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:41.503191 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e9b24-e5f2-445e-a190-80006e0d8b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:41.503468 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e9b24-e5f2-445e-a190-80006e0d8b33 admin admin] PATH_INFO: `/v3/projects/3114d6ad3cff4bd48c5775f76c631941/users/09b2bcae8c634e5fb8879b979a831a9f/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:41.505173 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e9b24-e5f2-445e-a190-80006e0d8b33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3114d6ad3cff4bd48c5775f76c631941, user_id=09b2bcae8c634e5fb8879b979a831a9f, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:41.532607 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e9b24-e5f2-445e-a190-80006e0d8b33 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:41.543186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1048/2095] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:41 2021] PUT /identity/v3/projects/3114d6ad3cff4bd48c5775f76c631941/users/09b2bcae8c634e5fb8879b979a831a9f/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:41.547985 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c9a8f-f70e-47dd-bdfa-d13e34c2dba3 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:41.557493 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c9a8f-f70e-47dd-bdfa-d13e34c2dba3 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:41.624365 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9d6ca-b9f7-4ee4-b048-dbdcb340efb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:41.624961 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9d6ca-b9f7-4ee4-b048-dbdcb340efb4 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:41.625249 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9d6ca-b9f7-4ee4-b048-dbdcb340efb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:41.625530 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9d6ca-b9f7-4ee4-b048-dbdcb340efb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:41.626234 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9d6ca-b9f7-4ee4-b048-dbdcb340efb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:41.652673 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9d6ca-b9f7-4ee4-b048-dbdcb340efb4 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:41.664057 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1048/2096] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:41 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:53:41.668434 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e9b24-e5f2-445e-a190-80006e0d8b33 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:41.678275 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e9b24-e5f2-445e-a190-80006e0d8b33 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:41.682409 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de0631-1c76-43a1-b0d5-8e7a4249d767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:41.683228 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de0631-1c76-43a1-b0d5-8e7a4249d767 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:41.683512 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de0631-1c76-43a1-b0d5-8e7a4249d767 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:41.683788 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de0631-1c76-43a1-b0d5-8e7a4249d767 admin admin] PATH_INFO: `/v3/projects/3114d6ad3cff4bd48c5775f76c631941/users/09b2bcae8c634e5fb8879b979a831a9f/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:41.685741 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de0631-1c76-43a1-b0d5-8e7a4249d767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3114d6ad3cff4bd48c5775f76c631941, user_id=09b2bcae8c634e5fb8879b979a831a9f, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:41.712578 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de0631-1c76-43a1-b0d5-8e7a4249d767 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:41.727292 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1049/2097] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:41 2021] PUT /identity/v3/projects/3114d6ad3cff4bd48c5775f76c631941/users/09b2bcae8c634e5fb8879b979a831a9f/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:41.740401 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f05033-dde5-4db0-b332-b145d40edeab None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:41.740401 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f05033-dde5-4db0-b332-b145d40edeab None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:41.740401 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f05033-dde5-4db0-b332-b145d40edeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:41.774800 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-79f05033-dde5-4db0-b332-b145d40edeab None None] MFA Rules not processed for user `09b2bcae8c634e5fb8879b979a831a9f`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:41.775949 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-79f05033-dde5-4db0-b332-b145d40edeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:41.863009 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1049/2098] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:41 2021] POST /identity/v3/auth/tokens => generated 3747 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:53:41.873450 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de0631-1c76-43a1-b0d5-8e7a4249d767 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:41.875056 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-b1de0631-1c76-43a1-b0d5-8e7a4249d767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:41.939001 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de0631-1c76-43a1-b0d5-8e7a4249d767 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:41.942607 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ed019-65fe-4ea7-bf3a-e8446a9e0549 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:41.943225 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ed019-65fe-4ea7-bf3a-e8446a9e0549 service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:41.943513 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ed019-65fe-4ea7-bf3a-e8446a9e0549 service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:41.943795 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ed019-65fe-4ea7-bf3a-e8446a9e0549 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:41.953625 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ed019-65fe-4ea7-bf3a-e8446a9e0549 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:41.979290 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ed019-65fe-4ea7-bf3a-e8446a9e0549 service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:41.992042 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1050/2099] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:41 2021] GET /identity/v3/auth/tokens => generated 3747 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:53:42.336902 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f05033-dde5-4db0-b332-b145d40edeab None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:42.407955 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f05033-dde5-4db0-b332-b145d40edeab None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:42.412269 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd42bf-68e2-417d-8699-9dfc48b57898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:42.413087 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd42bf-68e2-417d-8699-9dfc48b57898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:42.413373 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd42bf-68e2-417d-8699-9dfc48b57898 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:42.413653 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd42bf-68e2-417d-8699-9dfc48b57898 admin admin] PATH_INFO: `/v3/users/03a0c70dacb343e1b3913d0197cf4417` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:42.414770 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd42bf-68e2-417d-8699-9dfc48b57898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03a0c70dacb343e1b3913d0197cf4417)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:42.441363 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd42bf-68e2-417d-8699-9dfc48b57898 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:42.494102 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-9bdd42bf-68e2-417d-8699-9dfc48b57898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03a0c70dacb343e1b3913d0197cf4417'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:42.494695 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-9bdd42bf-68e2-417d-8699-9dfc48b57898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03a0c70dacb343e1b3913d0197cf4417'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:42.503196 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-9bdd42bf-68e2-417d-8699-9dfc48b57898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03a0c70dacb343e1b3913d0197cf4417'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:42.515123 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-9bdd42bf-68e2-417d-8699-9dfc48b57898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03a0c70dacb343e1b3913d0197cf4417'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:42.522249 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-9bdd42bf-68e2-417d-8699-9dfc48b57898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03a0c70dacb343e1b3913d0197cf4417'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:42.528249 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1050/2100] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:53:42 2021] DELETE /identity/v3/users/03a0c70dacb343e1b3913d0197cf4417 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:42.532748 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4279e36-f854-4c5b-8f7c-65cc99ef1b9c None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:42.533232 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4279e36-f854-4c5b-8f7c-65cc99ef1b9c None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:42.533326 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4279e36-f854-4c5b-8f7c-65cc99ef1b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:42.555939 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-e4279e36-f854-4c5b-8f7c-65cc99ef1b9c None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:42.557069 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-e4279e36-f854-4c5b-8f7c-65cc99ef1b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:42.625221 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1051/2101] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:42.632344 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd42bf-68e2-417d-8699-9dfc48b57898 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:42.633760 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-9bdd42bf-68e2-417d-8699-9dfc48b57898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:42.697696 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd42bf-68e2-417d-8699-9dfc48b57898 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:42.703949 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356fcfd-ae9d-4353-8248-2bacb8e02189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:42.703949 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356fcfd-ae9d-4353-8248-2bacb8e02189 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:42.703949 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356fcfd-ae9d-4353-8248-2bacb8e02189 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:42.703949 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356fcfd-ae9d-4353-8248-2bacb8e02189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:42.712725 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356fcfd-ae9d-4353-8248-2bacb8e02189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:42.737728 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356fcfd-ae9d-4353-8248-2bacb8e02189 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:42.747250 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1051/2102] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:42 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:53:43.097693 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4279e36-f854-4c5b-8f7c-65cc99ef1b9c None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:43.099145 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-e4279e36-f854-4c5b-8f7c-65cc99ef1b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:43.110926 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4279e36-f854-4c5b-8f7c-65cc99ef1b9c None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:43.115153 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7639db2-ef9e-4726-88ec-71d9073203a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:43.115927 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7639db2-ef9e-4726-88ec-71d9073203a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:43.116216 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7639db2-ef9e-4726-88ec-71d9073203a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:43.116495 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7639db2-ef9e-4726-88ec-71d9073203a4 admin admin] PATH_INFO: `/v3/projects/16e03105e4724ce5b0d4972234afadfd` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:43.117551 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7639db2-ef9e-4726-88ec-71d9073203a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16e03105e4724ce5b0d4972234afadfd)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:43.143385 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7639db2-ef9e-4726-88ec-71d9073203a4 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:43.193739 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c7639db2-ef9e-4726-88ec-71d9073203a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16e03105e4724ce5b0d4972234afadfd', 'request_id': 'req-c7639db2-ef9e-4726-88ec-71d9073203a4'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:43.202233 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c7639db2-ef9e-4726-88ec-71d9073203a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16e03105e4724ce5b0d4972234afadfd', 'request_id': 'req-c7639db2-ef9e-4726-88ec-71d9073203a4'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:43.213289 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c7639db2-ef9e-4726-88ec-71d9073203a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16e03105e4724ce5b0d4972234afadfd', 'request_id': 'req-c7639db2-ef9e-4726-88ec-71d9073203a4'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:43.223463 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c7639db2-ef9e-4726-88ec-71d9073203a4 admin admin] The token cache is being invalidate because project 16e03105e4724ce5b0d4972234afadfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:53:43.223749 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c7639db2-ef9e-4726-88ec-71d9073203a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:43.224343 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c7639db2-ef9e-4726-88ec-71d9073203a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:43.225754 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1052/2103] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:53:43 2021] DELETE /identity/v3/projects/16e03105e4724ce5b0d4972234afadfd => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:43.229674 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356fcfd-ae9d-4353-8248-2bacb8e02189 service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:43.239793 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356fcfd-ae9d-4353-8248-2bacb8e02189 service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:43.302150 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2b603-3e9c-41fc-91c1-796c3ce23c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:43.302977 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2b603-3e9c-41fc-91c1-796c3ce23c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:43.303267 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2b603-3e9c-41fc-91c1-796c3ce23c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:43.303549 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2b603-3e9c-41fc-91c1-796c3ce23c49 admin admin] PATH_INFO: `/v3/users/09b2bcae8c634e5fb8879b979a831a9f` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:43.304645 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2b603-3e9c-41fc-91c1-796c3ce23c49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b2bcae8c634e5fb8879b979a831a9f)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:43.331774 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2b603-3e9c-41fc-91c1-796c3ce23c49 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:43.382181 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-c8d2b603-3e9c-41fc-91c1-796c3ce23c49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b2bcae8c634e5fb8879b979a831a9f'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:43.382875 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-c8d2b603-3e9c-41fc-91c1-796c3ce23c49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b2bcae8c634e5fb8879b979a831a9f'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:43.391325 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-c8d2b603-3e9c-41fc-91c1-796c3ce23c49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b2bcae8c634e5fb8879b979a831a9f'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:43.403140 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-c8d2b603-3e9c-41fc-91c1-796c3ce23c49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b2bcae8c634e5fb8879b979a831a9f'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:43.410672 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-c8d2b603-3e9c-41fc-91c1-796c3ce23c49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b2bcae8c634e5fb8879b979a831a9f'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:43.416811 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1052/2104] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:53:43 2021] DELETE /identity/v3/users/09b2bcae8c634e5fb8879b979a831a9f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:43.792763 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7639db2-ef9e-4726-88ec-71d9073203a4 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:43.794885 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c7639db2-ef9e-4726-88ec-71d9073203a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:43.808567 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7639db2-ef9e-4726-88ec-71d9073203a4 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:43.940369 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14737ea9-641d-4b5f-a02a-2b002f4509a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:43.941274 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14737ea9-641d-4b5f-a02a-2b002f4509a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:43.941664 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14737ea9-641d-4b5f-a02a-2b002f4509a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:43.942067 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14737ea9-641d-4b5f-a02a-2b002f4509a8 admin admin] PATH_INFO: `/v3/projects/3114d6ad3cff4bd48c5775f76c631941` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:43.943315 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14737ea9-641d-4b5f-a02a-2b002f4509a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3114d6ad3cff4bd48c5775f76c631941)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:43.970644 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14737ea9-641d-4b5f-a02a-2b002f4509a8 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:44.023207 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-14737ea9-641d-4b5f-a02a-2b002f4509a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3114d6ad3cff4bd48c5775f76c631941', 'request_id': 'req-14737ea9-641d-4b5f-a02a-2b002f4509a8'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:44.030928 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-14737ea9-641d-4b5f-a02a-2b002f4509a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3114d6ad3cff4bd48c5775f76c631941', 'request_id': 'req-14737ea9-641d-4b5f-a02a-2b002f4509a8'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:44.045370 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-14737ea9-641d-4b5f-a02a-2b002f4509a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3114d6ad3cff4bd48c5775f76c631941', 'request_id': 'req-14737ea9-641d-4b5f-a02a-2b002f4509a8'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:44.056305 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-14737ea9-641d-4b5f-a02a-2b002f4509a8 admin admin] The token cache is being invalidate because project 3114d6ad3cff4bd48c5775f76c631941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:53:44.056741 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-14737ea9-641d-4b5f-a02a-2b002f4509a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:44.057460 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-14737ea9-641d-4b5f-a02a-2b002f4509a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:44.060137 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1053/2105] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:53:43 2021] DELETE /identity/v3/projects/3114d6ad3cff4bd48c5775f76c631941 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:44.065533 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393f49e-123f-435f-bf42-44ede83ccb96 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:44.065829 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393f49e-123f-435f-bf42-44ede83ccb96 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:44.066140 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393f49e-123f-435f-bf42-44ede83ccb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:44.089677 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-4393f49e-123f-435f-bf42-44ede83ccb96 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:44.091718 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-4393f49e-123f-435f-bf42-44ede83ccb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:44.162226 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1053/2106] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:53:44.171579 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c5cdf-1c84-4753-871c-bc574f2108c5 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:44.171873 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c5cdf-1c84-4753-871c-bc574f2108c5 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:44.172158 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c5cdf-1c84-4753-871c-bc574f2108c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:44.285316 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-c28c5cdf-1c84-4753-871c-bc574f2108c5 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:44.286586 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c28c5cdf-1c84-4753-871c-bc574f2108c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:44.295975 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1054/2107] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:44.300096 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393f49e-123f-435f-bf42-44ede83ccb96 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:44.309766 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393f49e-123f-435f-bf42-44ede83ccb96 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:44.314549 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a7086-22ca-4c8d-bbec-134a691fb05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:44.315571 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a7086-22ca-4c8d-bbec-134a691fb05e admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:44.315847 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a7086-22ca-4c8d-bbec-134a691fb05e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:44.316218 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a7086-22ca-4c8d-bbec-134a691fb05e admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:44.316947 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a7086-22ca-4c8d-bbec-134a691fb05e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:53:44.317244 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a7086-22ca-4c8d-bbec-134a691fb05e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:44.343599 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a7086-22ca-4c8d-bbec-134a691fb05e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:44.358725 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1054/2108] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:53:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:53:44.363013 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c5cdf-1c84-4753-871c-bc574f2108c5 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:44.371859 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c5cdf-1c84-4753-871c-bc574f2108c5 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:44.376108 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a1403-8416-4fcf-85db-1a918d9edfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:44.376705 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a1403-8416-4fcf-85db-1a918d9edfe0 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:44.376987 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a1403-8416-4fcf-85db-1a918d9edfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:44.377267 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a1403-8416-4fcf-85db-1a918d9edfe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:44.377889 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a1403-8416-4fcf-85db-1a918d9edfe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:44.404126 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a1403-8416-4fcf-85db-1a918d9edfe0 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:44.433635 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1055/2109] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:53:44 2021] POST /identity/v3/projects => generated 387 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:53:44.437715 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a7086-22ca-4c8d-bbec-134a691fb05e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:44.447749 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a7086-22ca-4c8d-bbec-134a691fb05e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:44.510406 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c43822-a597-4f58-a18b-6a83ec076968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:44.511047 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c43822-a597-4f58-a18b-6a83ec076968 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:44.511377 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c43822-a597-4f58-a18b-6a83ec076968 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:44.511660 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c43822-a597-4f58-a18b-6a83ec076968 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:44.512853 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c43822-a597-4f58-a18b-6a83ec076968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:44.539047 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c43822-a597-4f58-a18b-6a83ec076968 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:44.559406 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1055/2110] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:53:44 2021] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:44.563427 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a1403-8416-4fcf-85db-1a918d9edfe0 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:44.573843 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a1403-8416-4fcf-85db-1a918d9edfe0 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:44.579011 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b13fd7-e0e4-4dd7-8732-7c8d395f943d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:44.579599 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b13fd7-e0e4-4dd7-8732-7c8d395f943d admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:44.579885 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b13fd7-e0e4-4dd7-8732-7c8d395f943d admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:44.580680 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b13fd7-e0e4-4dd7-8732-7c8d395f943d admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:44.580842 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b13fd7-e0e4-4dd7-8732-7c8d395f943d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:44.607805 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b13fd7-e0e4-4dd7-8732-7c8d395f943d admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:44.619131 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1056/2111] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:44 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:53:44.623921 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c43822-a597-4f58-a18b-6a83ec076968 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:44.634787 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c43822-a597-4f58-a18b-6a83ec076968 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:44.641888 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c4feb-1ca4-4819-b630-02852592366a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:44.642973 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c4feb-1ca4-4819-b630-02852592366a admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:44.643605 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c4feb-1ca4-4819-b630-02852592366a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:44.644039 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c4feb-1ca4-4819-b630-02852592366a admin admin] PATH_INFO: `/v3/projects/d9e0141278cc4a94a54d4bb61c3a114e/users/9ce084d5b3dc4914a240d7ce70d44523/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:44.666762 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c4feb-1ca4-4819-b630-02852592366a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e0141278cc4a94a54d4bb61c3a114e, user_id=9ce084d5b3dc4914a240d7ce70d44523, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:44.694176 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c4feb-1ca4-4819-b630-02852592366a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:44.709297 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1056/2112] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:44 2021] PUT /identity/v3/projects/d9e0141278cc4a94a54d4bb61c3a114e/users/9ce084d5b3dc4914a240d7ce70d44523/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:44.719472 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45daab5-7c82-473e-a60d-0d50186212b9 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:44.719759 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45daab5-7c82-473e-a60d-0d50186212b9 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:44.720040 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45daab5-7c82-473e-a60d-0d50186212b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:44.761544 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-e45daab5-7c82-473e-a60d-0d50186212b9 None None] MFA Rules not processed for user `9ce084d5b3dc4914a240d7ce70d44523`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:44.762892 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-e45daab5-7c82-473e-a60d-0d50186212b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:44.871452 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1057/2113] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:44 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:53:44.876414 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c4feb-1ca4-4819-b630-02852592366a admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:44.961428 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c4feb-1ca4-4819-b630-02852592366a admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:44.971418 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6910eb9-7864-48c2-8a1f-c575339c6aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:44.972169 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6910eb9-7864-48c2-8a1f-c575339c6aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:44.972568 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6910eb9-7864-48c2-8a1f-c575339c6aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:44.973398 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6910eb9-7864-48c2-8a1f-c575339c6aa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:44.974043 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6910eb9-7864-48c2-8a1f-c575339c6aa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:45.013080 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6910eb9-7864-48c2-8a1f-c575339c6aa4 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:45.046385 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1057/2114] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:53:44 2021] POST /identity/v3/projects => generated 387 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:45.047764 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45daab5-7c82-473e-a60d-0d50186212b9 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:45.059848 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45daab5-7c82-473e-a60d-0d50186212b9 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:45.145818 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adf845-0c97-445c-8ac9-f596cb34330a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:45.147151 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adf845-0c97-445c-8ac9-f596cb34330a admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:45.147151 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adf845-0c97-445c-8ac9-f596cb34330a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:45.147151 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adf845-0c97-445c-8ac9-f596cb34330a admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:45.147672 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1adf845-0c97-445c-8ac9-f596cb34330a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:45.176760 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1adf845-0c97-445c-8ac9-f596cb34330a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:45.204421 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1058/2115] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:53:45 2021] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:45.208340 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6910eb9-7864-48c2-8a1f-c575339c6aa4 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:45.222039 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6910eb9-7864-48c2-8a1f-c575339c6aa4 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:45.227983 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a646bb-88ee-4e8b-b382-11020bcdf5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:45.228717 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a646bb-88ee-4e8b-b382-11020bcdf5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:45.228924 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a646bb-88ee-4e8b-b382-11020bcdf5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:45.229359 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a646bb-88ee-4e8b-b382-11020bcdf5b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:45.230126 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a646bb-88ee-4e8b-b382-11020bcdf5b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:45.262306 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a646bb-88ee-4e8b-b382-11020bcdf5b8 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:45.275482 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1058/2116] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:45 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:53:45.280372 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adf845-0c97-445c-8ac9-f596cb34330a admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:45.290056 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adf845-0c97-445c-8ac9-f596cb34330a admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:45.295645 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad45c4-41c6-4dff-95a0-fa238229eec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:45.296400 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad45c4-41c6-4dff-95a0-fa238229eec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:45.296688 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad45c4-41c6-4dff-95a0-fa238229eec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:45.296967 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad45c4-41c6-4dff-95a0-fa238229eec9 admin admin] PATH_INFO: `/v3/projects/8653b01b953b4782b7ac34e4081bfdf3/users/9399a34ded7e4bffb48ea8a8e92ed3a6/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:45.332205 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad45c4-41c6-4dff-95a0-fa238229eec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8653b01b953b4782b7ac34e4081bfdf3, user_id=9399a34ded7e4bffb48ea8a8e92ed3a6, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:45.370856 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad45c4-41c6-4dff-95a0-fa238229eec9 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:45.390706 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1059/2117] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:45 2021] PUT /identity/v3/projects/8653b01b953b4782b7ac34e4081bfdf3/users/9399a34ded7e4bffb48ea8a8e92ed3a6/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:53:45.400686 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1138210-c8f8-4342-a3d7-878dc558821d None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:45.400686 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1138210-c8f8-4342-a3d7-878dc558821d None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:45.400686 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1138210-c8f8-4342-a3d7-878dc558821d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:45.457877 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-a1138210-c8f8-4342-a3d7-878dc558821d None None] MFA Rules not processed for user `9399a34ded7e4bffb48ea8a8e92ed3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:45.459089 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-a1138210-c8f8-4342-a3d7-878dc558821d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:45.537996 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1059/2118] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:45 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:45.544434 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad45c4-41c6-4dff-95a0-fa238229eec9 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:45.627022 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad45c4-41c6-4dff-95a0-fa238229eec9 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:45.631445 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6cf13-b1dc-49e2-a3fa-b4ab7a7cf405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:45.632052 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6cf13-b1dc-49e2-a3fa-b4ab7a7cf405 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:45.632328 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6cf13-b1dc-49e2-a3fa-b4ab7a7cf405 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:45.632611 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6cf13-b1dc-49e2-a3fa-b4ab7a7cf405 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:45.633267 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b6cf13-b1dc-49e2-a3fa-b4ab7a7cf405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:45.659987 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b6cf13-b1dc-49e2-a3fa-b4ab7a7cf405 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:45.687613 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1060/2119] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:53:45 2021] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:53:45.691731 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1138210-c8f8-4342-a3d7-878dc558821d None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:45.702789 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1138210-c8f8-4342-a3d7-878dc558821d None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:45.771487 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c70008-290c-443c-9978-579a32c69313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:45.772120 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c70008-290c-443c-9978-579a32c69313 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:45.772404 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c70008-290c-443c-9978-579a32c69313 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:45.772681 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c70008-290c-443c-9978-579a32c69313 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:45.773324 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c70008-290c-443c-9978-579a32c69313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:45.799037 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c70008-290c-443c-9978-579a32c69313 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:45.826708 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1060/2120] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:53:45 2021] POST /identity/v3/users => generated 300 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:53:45.828319 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6cf13-b1dc-49e2-a3fa-b4ab7a7cf405 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:45.839697 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6cf13-b1dc-49e2-a3fa-b4ab7a7cf405 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:45.846340 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b73b99-9243-4b10-a606-7ebb093f4a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:45.847613 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b73b99-9243-4b10-a606-7ebb093f4a9f admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:45.847964 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b73b99-9243-4b10-a606-7ebb093f4a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:45.848354 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b73b99-9243-4b10-a606-7ebb093f4a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:45.849210 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b73b99-9243-4b10-a606-7ebb093f4a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:45.909588 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b73b99-9243-4b10-a606-7ebb093f4a9f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:45.930703 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1061/2121] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:45 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:53:45.931853 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c70008-290c-443c-9978-579a32c69313 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:45.955056 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c70008-290c-443c-9978-579a32c69313 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:45.969880 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707bf63-1422-46d6-8358-e68463e14239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:45.970139 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707bf63-1422-46d6-8358-e68463e14239 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:45.970459 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707bf63-1422-46d6-8358-e68463e14239 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:45.971180 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707bf63-1422-46d6-8358-e68463e14239 admin admin] PATH_INFO: `/v3/projects/5951ef3032e24aa78ce64a56afe5fbbe/users/1df8c0328cd0478eb3c4418d0193987e/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:45.995475 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707bf63-1422-46d6-8358-e68463e14239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5951ef3032e24aa78ce64a56afe5fbbe, user_id=1df8c0328cd0478eb3c4418d0193987e, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:46.024827 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707bf63-1422-46d6-8358-e68463e14239 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:46.045341 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1061/2122] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:45 2021] PUT /identity/v3/projects/5951ef3032e24aa78ce64a56afe5fbbe/users/1df8c0328cd0478eb3c4418d0193987e/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:46.050241 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b73b99-9243-4b10-a606-7ebb093f4a9f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:46.061366 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b73b99-9243-4b10-a606-7ebb093f4a9f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:46.161016 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d7625-54a1-4e03-96f0-3c2af68e37f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:46.161651 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d7625-54a1-4e03-96f0-3c2af68e37f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:46.161939 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d7625-54a1-4e03-96f0-3c2af68e37f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:46.162221 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d7625-54a1-4e03-96f0-3c2af68e37f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:46.162940 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d7625-54a1-4e03-96f0-3c2af68e37f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:46.196430 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d7625-54a1-4e03-96f0-3c2af68e37f2 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:46.226712 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1062/2123] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:46 2021] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:53:46.226902 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707bf63-1422-46d6-8358-e68463e14239 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:46.243088 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707bf63-1422-46d6-8358-e68463e14239 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:46.256426 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68723d-5841-433d-9fb8-0cdd8ba89bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:46.262641 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68723d-5841-433d-9fb8-0cdd8ba89bef admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:46.267782 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68723d-5841-433d-9fb8-0cdd8ba89bef admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:46.268197 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68723d-5841-433d-9fb8-0cdd8ba89bef admin admin] PATH_INFO: `/v3/projects/5951ef3032e24aa78ce64a56afe5fbbe/users/1df8c0328cd0478eb3c4418d0193987e/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:46.274094 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68723d-5841-433d-9fb8-0cdd8ba89bef admin admin] RBAC: Authorizing `identity:create_grant(project_id=5951ef3032e24aa78ce64a56afe5fbbe, user_id=1df8c0328cd0478eb3c4418d0193987e, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:46.336895 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68723d-5841-433d-9fb8-0cdd8ba89bef admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:46.353490 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1062/2124] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:46 2021] PUT /identity/v3/projects/5951ef3032e24aa78ce64a56afe5fbbe/users/1df8c0328cd0478eb3c4418d0193987e/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:46.354358 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d7625-54a1-4e03-96f0-3c2af68e37f2 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:46.366158 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d7625-54a1-4e03-96f0-3c2af68e37f2 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:46.448881 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594de39f-b433-49eb-9539-0107bda86111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:46.450942 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594de39f-b433-49eb-9539-0107bda86111 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:46.450942 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594de39f-b433-49eb-9539-0107bda86111 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:46.450942 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594de39f-b433-49eb-9539-0107bda86111 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:46.451280 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594de39f-b433-49eb-9539-0107bda86111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:46.479293 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594de39f-b433-49eb-9539-0107bda86111 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:46.494510 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1063/2125] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:46 2021] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:53:46.495146 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68723d-5841-433d-9fb8-0cdd8ba89bef admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:46.519950 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68723d-5841-433d-9fb8-0cdd8ba89bef admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:46.538353 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687baf05-d9ef-48fd-ae8c-f8bba22f1872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:46.539434 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687baf05-d9ef-48fd-ae8c-f8bba22f1872 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:46.539884 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687baf05-d9ef-48fd-ae8c-f8bba22f1872 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:46.541681 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687baf05-d9ef-48fd-ae8c-f8bba22f1872 admin admin] PATH_INFO: `/v3/projects/5951ef3032e24aa78ce64a56afe5fbbe/users/1df8c0328cd0478eb3c4418d0193987e/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:46.544790 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687baf05-d9ef-48fd-ae8c-f8bba22f1872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5951ef3032e24aa78ce64a56afe5fbbe, user_id=1df8c0328cd0478eb3c4418d0193987e, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:46.588921 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687baf05-d9ef-48fd-ae8c-f8bba22f1872 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:46.608110 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1063/2126] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:46 2021] PUT /identity/v3/projects/5951ef3032e24aa78ce64a56afe5fbbe/users/1df8c0328cd0478eb3c4418d0193987e/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:46.619053 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a9689-9f2d-4fc7-8606-301f43df0cb0 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:46.619509 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a9689-9f2d-4fc7-8606-301f43df0cb0 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:46.619870 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a9689-9f2d-4fc7-8606-301f43df0cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:46.664665 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-064a9689-9f2d-4fc7-8606-301f43df0cb0 None None] MFA Rules not processed for user `1df8c0328cd0478eb3c4418d0193987e`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:46.666616 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-064a9689-9f2d-4fc7-8606-301f43df0cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:46.786902 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1064/2127] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:46 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:46.795481 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687baf05-d9ef-48fd-ae8c-f8bba22f1872 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:46.797336 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-687baf05-d9ef-48fd-ae8c-f8bba22f1872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:46.879851 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687baf05-d9ef-48fd-ae8c-f8bba22f1872 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:46.883831 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6870c-5ce6-460b-a7a2-a3429f8e327c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:46.884497 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6870c-5ce6-460b-a7a2-a3429f8e327c service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:46.884860 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6870c-5ce6-460b-a7a2-a3429f8e327c service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:46.885214 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6870c-5ce6-460b-a7a2-a3429f8e327c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:46.909071 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6870c-5ce6-460b-a7a2-a3429f8e327c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:46.966396 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6870c-5ce6-460b-a7a2-a3429f8e327c service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:46.983426 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1064/2128] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:46 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:53:47.762530 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a9689-9f2d-4fc7-8606-301f43df0cb0 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:47.764158 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-064a9689-9f2d-4fc7-8606-301f43df0cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:47.776202 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a9689-9f2d-4fc7-8606-301f43df0cb0 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:47.779827 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13caed0-6ee1-471a-8930-8a2edd5eb9a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:47.780472 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13caed0-6ee1-471a-8930-8a2edd5eb9a3 service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:47.780991 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13caed0-6ee1-471a-8930-8a2edd5eb9a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:47.781342 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13caed0-6ee1-471a-8930-8a2edd5eb9a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:47.883203 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13caed0-6ee1-471a-8930-8a2edd5eb9a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:47.917746 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13caed0-6ee1-471a-8930-8a2edd5eb9a3 service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:47.927870 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1065/2129] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:47 2021] GET /identity/v3/auth/tokens => generated 3694 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:53:49.333682 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6870c-5ce6-460b-a7a2-a3429f8e327c service cinder] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:49.335055 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-8ec6870c-5ce6-460b-a7a2-a3429f8e327c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:49.406768 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6870c-5ce6-460b-a7a2-a3429f8e327c service cinder] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:49.412618 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eade9c5-9642-4656-a2ed-1624b4054b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:49.413527 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eade9c5-9642-4656-a2ed-1624b4054b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:49.413880 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eade9c5-9642-4656-a2ed-1624b4054b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:49.414226 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eade9c5-9642-4656-a2ed-1624b4054b2e admin admin] PATH_INFO: `/v3/users/a33a26a04b6b4e9e85b92b6d06bb7219` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:49.415889 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eade9c5-9642-4656-a2ed-1624b4054b2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a33a26a04b6b4e9e85b92b6d06bb7219)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:49.445671 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eade9c5-9642-4656-a2ed-1624b4054b2e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:49.508396 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-7eade9c5-9642-4656-a2ed-1624b4054b2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a33a26a04b6b4e9e85b92b6d06bb7219'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:49.509475 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-7eade9c5-9642-4656-a2ed-1624b4054b2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a33a26a04b6b4e9e85b92b6d06bb7219'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:49.519128 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-7eade9c5-9642-4656-a2ed-1624b4054b2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a33a26a04b6b4e9e85b92b6d06bb7219'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:49.533074 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-7eade9c5-9642-4656-a2ed-1624b4054b2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a33a26a04b6b4e9e85b92b6d06bb7219'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:49.540611 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-7eade9c5-9642-4656-a2ed-1624b4054b2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a33a26a04b6b4e9e85b92b6d06bb7219'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:49.551772 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1065/2130] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:53:49 2021] DELETE /identity/v3/users/a33a26a04b6b4e9e85b92b6d06bb7219 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:49.825574 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13caed0-6ee1-471a-8930-8a2edd5eb9a3 service cinder] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:49.836814 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13caed0-6ee1-471a-8930-8a2edd5eb9a3 service cinder] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:49.907007 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570ed2f-538e-4efa-bc9b-2b4146ee38b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:49.908291 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570ed2f-538e-4efa-bc9b-2b4146ee38b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:49.908402 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570ed2f-538e-4efa-bc9b-2b4146ee38b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:49.908700 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570ed2f-538e-4efa-bc9b-2b4146ee38b8 admin admin] PATH_INFO: `/v3/projects/3da5bb1985d541ab9ef7006ba04bc019` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:49.909912 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570ed2f-538e-4efa-bc9b-2b4146ee38b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3da5bb1985d541ab9ef7006ba04bc019)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:49.937029 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570ed2f-538e-4efa-bc9b-2b4146ee38b8 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:49.988348 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-b570ed2f-538e-4efa-bc9b-2b4146ee38b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3da5bb1985d541ab9ef7006ba04bc019', 'request_id': 'req-b570ed2f-538e-4efa-bc9b-2b4146ee38b8'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:49.995254 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-b570ed2f-538e-4efa-bc9b-2b4146ee38b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3da5bb1985d541ab9ef7006ba04bc019', 'request_id': 'req-b570ed2f-538e-4efa-bc9b-2b4146ee38b8'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:50.007989 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-b570ed2f-538e-4efa-bc9b-2b4146ee38b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3da5bb1985d541ab9ef7006ba04bc019', 'request_id': 'req-b570ed2f-538e-4efa-bc9b-2b4146ee38b8'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:50.019099 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-b570ed2f-538e-4efa-bc9b-2b4146ee38b8 admin admin] The token cache is being invalidate because project 3da5bb1985d541ab9ef7006ba04bc019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:53:50.019389 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-b570ed2f-538e-4efa-bc9b-2b4146ee38b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:50.020056 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-b570ed2f-538e-4efa-bc9b-2b4146ee38b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:50.021572 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1066/2131] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:53:49 2021] DELETE /identity/v3/projects/3da5bb1985d541ab9ef7006ba04bc019 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:50.025551 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eade9c5-9642-4656-a2ed-1624b4054b2e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:50.026960 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-7eade9c5-9642-4656-a2ed-1624b4054b2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:50.039071 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eade9c5-9642-4656-a2ed-1624b4054b2e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:50.105528 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d4dc1-6f7a-4398-a3c9-57882859538a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:50.106395 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d4dc1-6f7a-4398-a3c9-57882859538a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:50.106715 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d4dc1-6f7a-4398-a3c9-57882859538a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:50.107003 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d4dc1-6f7a-4398-a3c9-57882859538a admin admin] PATH_INFO: `/v3/users/8458899854994a7697fb52b486df2f8c` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:50.108118 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d4dc1-6f7a-4398-a3c9-57882859538a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8458899854994a7697fb52b486df2f8c)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:50.134708 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d4dc1-6f7a-4398-a3c9-57882859538a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:50.181837 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-138d4dc1-6f7a-4398-a3c9-57882859538a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8458899854994a7697fb52b486df2f8c'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:50.182516 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-138d4dc1-6f7a-4398-a3c9-57882859538a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8458899854994a7697fb52b486df2f8c'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:50.190765 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-138d4dc1-6f7a-4398-a3c9-57882859538a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8458899854994a7697fb52b486df2f8c'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:50.203374 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-138d4dc1-6f7a-4398-a3c9-57882859538a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8458899854994a7697fb52b486df2f8c'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:50.210754 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-138d4dc1-6f7a-4398-a3c9-57882859538a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8458899854994a7697fb52b486df2f8c'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:50.219589 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1066/2132] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:53:50 2021] DELETE /identity/v3/users/8458899854994a7697fb52b486df2f8c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:53:50.457247 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570ed2f-538e-4efa-bc9b-2b4146ee38b8 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:50.460129 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-b570ed2f-538e-4efa-bc9b-2b4146ee38b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:50.471979 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570ed2f-538e-4efa-bc9b-2b4146ee38b8 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:50.534029 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c488243-6b98-4861-b96c-e2736990ddd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:50.534852 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c488243-6b98-4861-b96c-e2736990ddd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:50.535143 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c488243-6b98-4861-b96c-e2736990ddd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:50.535424 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c488243-6b98-4861-b96c-e2736990ddd1 admin admin] PATH_INFO: `/v3/projects/d9968be3d4a745cab454719e27709fbc` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:50.536495 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c488243-6b98-4861-b96c-e2736990ddd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9968be3d4a745cab454719e27709fbc)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:50.563359 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c488243-6b98-4861-b96c-e2736990ddd1 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:50.616541 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4c488243-6b98-4861-b96c-e2736990ddd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9968be3d4a745cab454719e27709fbc', 'request_id': 'req-4c488243-6b98-4861-b96c-e2736990ddd1'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:50.628931 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4c488243-6b98-4861-b96c-e2736990ddd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9968be3d4a745cab454719e27709fbc', 'request_id': 'req-4c488243-6b98-4861-b96c-e2736990ddd1'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:50.641173 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4c488243-6b98-4861-b96c-e2736990ddd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9968be3d4a745cab454719e27709fbc', 'request_id': 'req-4c488243-6b98-4861-b96c-e2736990ddd1'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:50.651186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4c488243-6b98-4861-b96c-e2736990ddd1 admin admin] The token cache is being invalidate because project d9968be3d4a745cab454719e27709fbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:53:50.651717 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4c488243-6b98-4861-b96c-e2736990ddd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:50.652577 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4c488243-6b98-4861-b96c-e2736990ddd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:50.654683 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1067/2133] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:53:50 2021] DELETE /identity/v3/projects/d9968be3d4a745cab454719e27709fbc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:50.663044 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740abf2-db25-43e5-a6d1-f465ae16d3c4 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:50.663517 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740abf2-db25-43e5-a6d1-f465ae16d3c4 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:50.663620 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740abf2-db25-43e5-a6d1-f465ae16d3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:50.692140 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-8740abf2-db25-43e5-a6d1-f465ae16d3c4 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:50.693787 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-8740abf2-db25-43e5-a6d1-f465ae16d3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:50.767976 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1067/2134] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:50.776088 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e717f6-b7c6-43b2-a3b8-cdbeea95bbe4 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:50.776404 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e717f6-b7c6-43b2-a3b8-cdbeea95bbe4 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:50.776683 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e717f6-b7c6-43b2-a3b8-cdbeea95bbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:50.799822 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-59e717f6-b7c6-43b2-a3b8-cdbeea95bbe4 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:50.800975 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-59e717f6-b7c6-43b2-a3b8-cdbeea95bbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:50.808450 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1068/2135] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:50.813803 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740abf2-db25-43e5-a6d1-f465ae16d3c4 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:50.825155 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740abf2-db25-43e5-a6d1-f465ae16d3c4 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:50.829873 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23269d66-fc3f-4d4c-922f-0c50afb2b72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:50.830558 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23269d66-fc3f-4d4c-922f-0c50afb2b72b admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:50.831122 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23269d66-fc3f-4d4c-922f-0c50afb2b72b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:50.831480 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23269d66-fc3f-4d4c-922f-0c50afb2b72b admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:50.832274 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23269d66-fc3f-4d4c-922f-0c50afb2b72b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:53:50.832641 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23269d66-fc3f-4d4c-922f-0c50afb2b72b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:50.862094 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23269d66-fc3f-4d4c-922f-0c50afb2b72b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:50.882578 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1068/2136] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:53:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:53:50.883413 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e717f6-b7c6-43b2-a3b8-cdbeea95bbe4 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:50.893506 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e717f6-b7c6-43b2-a3b8-cdbeea95bbe4 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:50.897884 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292779ea-bbbb-476e-a362-5adcaf1a2baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:50.898476 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292779ea-bbbb-476e-a362-5adcaf1a2baa admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:50.898796 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292779ea-bbbb-476e-a362-5adcaf1a2baa admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:50.899072 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292779ea-bbbb-476e-a362-5adcaf1a2baa admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:50.899730 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292779ea-bbbb-476e-a362-5adcaf1a2baa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:50.926428 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292779ea-bbbb-476e-a362-5adcaf1a2baa admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:50.958547 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1069/2137] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:53:50 2021] POST /identity/v3/projects => generated 379 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:53:50.960041 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23269d66-fc3f-4d4c-922f-0c50afb2b72b admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:50.972609 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23269d66-fc3f-4d4c-922f-0c50afb2b72b admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:51.059780 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96693b-89fd-4ff7-9c3f-f442bc326d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:51.060474 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96693b-89fd-4ff7-9c3f-f442bc326d2e admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:51.060747 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96693b-89fd-4ff7-9c3f-f442bc326d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:51.061166 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96693b-89fd-4ff7-9c3f-f442bc326d2e admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:51.061812 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96693b-89fd-4ff7-9c3f-f442bc326d2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:51.098367 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96693b-89fd-4ff7-9c3f-f442bc326d2e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:51.130056 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1069/2138] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:53:50 2021] POST /identity/v3/users => generated 290 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:53:51.134370 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292779ea-bbbb-476e-a362-5adcaf1a2baa admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:51.148972 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292779ea-bbbb-476e-a362-5adcaf1a2baa admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:51.156076 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37639237-02ec-4231-9ada-ca77d40d8819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:51.156904 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37639237-02ec-4231-9ada-ca77d40d8819 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:51.157376 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37639237-02ec-4231-9ada-ca77d40d8819 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:51.157800 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37639237-02ec-4231-9ada-ca77d40d8819 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:51.158637 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37639237-02ec-4231-9ada-ca77d40d8819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:51.195548 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37639237-02ec-4231-9ada-ca77d40d8819 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:51.207458 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1070/2139] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:53:51 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:53:51.212141 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96693b-89fd-4ff7-9c3f-f442bc326d2e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:51.228586 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96693b-89fd-4ff7-9c3f-f442bc326d2e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:51.234129 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed005a-c694-4ceb-a2f7-548c432a423b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:51.235682 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed005a-c694-4ceb-a2f7-548c432a423b admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:51.236445 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed005a-c694-4ceb-a2f7-548c432a423b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:51.236736 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed005a-c694-4ceb-a2f7-548c432a423b admin admin] PATH_INFO: `/v3/projects/f6605294a2f54d1b8e2be6b90dc68f7c/users/df2ec396a09f497fa5761cef615b262d/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:51.262455 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed005a-c694-4ceb-a2f7-548c432a423b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6605294a2f54d1b8e2be6b90dc68f7c, user_id=df2ec396a09f497fa5761cef615b262d, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:51.297089 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed005a-c694-4ceb-a2f7-548c432a423b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:51.312815 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1070/2140] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:53:51 2021] PUT /identity/v3/projects/f6605294a2f54d1b8e2be6b90dc68f7c/users/df2ec396a09f497fa5761cef615b262d/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:51.319428 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1ac9f-2973-4a47-ac76-f9e2a1f2cf48 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:51.319893 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1ac9f-2973-4a47-ac76-f9e2a1f2cf48 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:51.320603 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1ac9f-2973-4a47-ac76-f9e2a1f2cf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:51.344826 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-61d1ac9f-2973-4a47-ac76-f9e2a1f2cf48 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:51.346004 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-61d1ac9f-2973-4a47-ac76-f9e2a1f2cf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:51.429996 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1071/2141] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:51.450835 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed005a-c694-4ceb-a2f7-548c432a423b admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:51.452762 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-e4ed005a-c694-4ceb-a2f7-548c432a423b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:51.529045 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed005a-c694-4ceb-a2f7-548c432a423b admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:51.533935 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3793072-563a-4708-8ec2-424b6a5f7275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:51.534603 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3793072-563a-4708-8ec2-424b6a5f7275 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:51.534917 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3793072-563a-4708-8ec2-424b6a5f7275 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:51.535202 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3793072-563a-4708-8ec2-424b6a5f7275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:51.545281 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3793072-563a-4708-8ec2-424b6a5f7275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:51.577063 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3793072-563a-4708-8ec2-424b6a5f7275 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:51.587114 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1071/2142] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:51 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:53:54.092984 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1ac9f-2973-4a47-ac76-f9e2a1f2cf48 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:54.094275 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-61d1ac9f-2973-4a47-ac76-f9e2a1f2cf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:54.274858 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1ac9f-2973-4a47-ac76-f9e2a1f2cf48 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:54.283257 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fec69-db5f-40c5-9460-b315941064c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:54.284163 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fec69-db5f-40c5-9460-b315941064c3 service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:54.284525 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fec69-db5f-40c5-9460-b315941064c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:54.284845 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fec69-db5f-40c5-9460-b315941064c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:54.287986 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-bb3fec69-db5f-40c5-9460-b315941064c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:54.461114 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3fec69-db5f-40c5-9460-b315941064c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:54.495385 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3fec69-db5f-40c5-9460-b315941064c3 service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:54.505503 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1072/2143] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:54 2021] GET /identity/v3/auth/tokens => generated 3694 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:53:58.108071 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3793072-563a-4708-8ec2-424b6a5f7275 service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:58.109580 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-e3793072-563a-4708-8ec2-424b6a5f7275 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:58.138241 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3793072-563a-4708-8ec2-424b6a5f7275 service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:58.150260 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9d35b-7834-4cb9-bb7b-d2d3809c4940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:58.158309 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9d35b-7834-4cb9-bb7b-d2d3809c4940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:58.158582 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9d35b-7834-4cb9-bb7b-d2d3809c4940 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:58.162144 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9d35b-7834-4cb9-bb7b-d2d3809c4940 admin admin] PATH_INFO: `/v3/users/9ce084d5b3dc4914a240d7ce70d44523` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:58.165538 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9d35b-7834-4cb9-bb7b-d2d3809c4940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ce084d5b3dc4914a240d7ce70d44523)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:58.266079 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9d35b-7834-4cb9-bb7b-d2d3809c4940 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:58.349088 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-20a9d35b-7834-4cb9-bb7b-d2d3809c4940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ce084d5b3dc4914a240d7ce70d44523'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:58.350427 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-20a9d35b-7834-4cb9-bb7b-d2d3809c4940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ce084d5b3dc4914a240d7ce70d44523'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:58.374590 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-20a9d35b-7834-4cb9-bb7b-d2d3809c4940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ce084d5b3dc4914a240d7ce70d44523'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:58.443964 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-20a9d35b-7834-4cb9-bb7b-d2d3809c4940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ce084d5b3dc4914a240d7ce70d44523'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:58.456972 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-20a9d35b-7834-4cb9-bb7b-d2d3809c4940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ce084d5b3dc4914a240d7ce70d44523'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:53:58.465192 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1072/2144] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:53:58 2021] DELETE /identity/v3/users/9ce084d5b3dc4914a240d7ce70d44523 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:53:58.469717 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac60d2-8b51-4bc3-bd56-17337e64342c None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:58.470587 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac60d2-8b51-4bc3-bd56-17337e64342c None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:58.471318 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac60d2-8b51-4bc3-bd56-17337e64342c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:58.509930 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-2bac60d2-8b51-4bc3-bd56-17337e64342c None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:58.511991 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-2bac60d2-8b51-4bc3-bd56-17337e64342c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:58.685468 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1073/2145] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:53:58.723845 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9d35b-7834-4cb9-bb7b-d2d3809c4940 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:53:58.725600 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-20a9d35b-7834-4cb9-bb7b-d2d3809c4940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:58.870142 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9d35b-7834-4cb9-bb7b-d2d3809c4940 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:53:58.879994 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81feda3d-c071-4866-bfb2-41033cdcf5e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:53:58.881523 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81feda3d-c071-4866-bfb2-41033cdcf5e5 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:58.882450 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81feda3d-c071-4866-bfb2-41033cdcf5e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:58.884240 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81feda3d-c071-4866-bfb2-41033cdcf5e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:58.915321 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81feda3d-c071-4866-bfb2-41033cdcf5e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:53:58.961266 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568816a8-c376-4d04-9966-cf9d7c795771 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:53:58.961686 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568816a8-c376-4d04-9966-cf9d7c795771 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:53:58.962106 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568816a8-c376-4d04-9966-cf9d7c795771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:53:58.971370 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81feda3d-c071-4866-bfb2-41033cdcf5e5 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:53:58.984187 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1073/2146] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:53:58 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:53:59.043238 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-568816a8-c376-4d04-9966-cf9d7c795771 None None] MFA Rules not processed for user `2a6e346d5ebb470eb4258fd097d197eb`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:53:59.044428 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-568816a8-c376-4d04-9966-cf9d7c795771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:53:59.158895 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1074/2147] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:53:58 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:00.255030 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81feda3d-c071-4866-bfb2-41033cdcf5e5 service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:00.256949 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-81feda3d-c071-4866-bfb2-41033cdcf5e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:00.275058 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81feda3d-c071-4866-bfb2-41033cdcf5e5 service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:00.280640 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cc294-40d3-48ce-b767-fcf0ee272148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:00.283408 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cc294-40d3-48ce-b767-fcf0ee272148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:00.283939 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cc294-40d3-48ce-b767-fcf0ee272148 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:00.284383 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cc294-40d3-48ce-b767-fcf0ee272148 admin admin] PATH_INFO: `/v3/projects/d9e0141278cc4a94a54d4bb61c3a114e` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:00.304567 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cc294-40d3-48ce-b767-fcf0ee272148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9e0141278cc4a94a54d4bb61c3a114e)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:00.350991 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cc294-40d3-48ce-b767-fcf0ee272148 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:00.428775 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-1f7cc294-40d3-48ce-b767-fcf0ee272148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9e0141278cc4a94a54d4bb61c3a114e', 'request_id': 'req-1f7cc294-40d3-48ce-b767-fcf0ee272148'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:00.438680 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-1f7cc294-40d3-48ce-b767-fcf0ee272148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9e0141278cc4a94a54d4bb61c3a114e', 'request_id': 'req-1f7cc294-40d3-48ce-b767-fcf0ee272148'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:00.446854 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-1f7cc294-40d3-48ce-b767-fcf0ee272148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9e0141278cc4a94a54d4bb61c3a114e', 'request_id': 'req-1f7cc294-40d3-48ce-b767-fcf0ee272148'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:00.467803 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-1f7cc294-40d3-48ce-b767-fcf0ee272148 admin admin] The token cache is being invalidate because project d9e0141278cc4a94a54d4bb61c3a114e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:54:00.468161 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-1f7cc294-40d3-48ce-b767-fcf0ee272148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:00.468724 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-1f7cc294-40d3-48ce-b767-fcf0ee272148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:00.470689 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1074/2148] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:54:00 2021] DELETE /identity/v3/projects/d9e0141278cc4a94a54d4bb61c3a114e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:00.474468 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568816a8-c376-4d04-9966-cf9d7c795771 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:00.490065 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568816a8-c376-4d04-9966-cf9d7c795771 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:00.630039 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f663b0a-ce83-4e97-aa10-6a26ead1acdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:00.631263 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f663b0a-ce83-4e97-aa10-6a26ead1acdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:00.631706 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f663b0a-ce83-4e97-aa10-6a26ead1acdf admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:00.632315 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f663b0a-ce83-4e97-aa10-6a26ead1acdf admin admin] PATH_INFO: `/v3/users/9399a34ded7e4bffb48ea8a8e92ed3a6` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:00.633602 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f663b0a-ce83-4e97-aa10-6a26ead1acdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9399a34ded7e4bffb48ea8a8e92ed3a6)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:00.678802 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f663b0a-ce83-4e97-aa10-6a26ead1acdf admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:00.772878 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443421cf-b2ab-4428-b9c4-18ad05f29252 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:00.773177 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443421cf-b2ab-4428-b9c4-18ad05f29252 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:00.773459 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443421cf-b2ab-4428-b9c4-18ad05f29252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:00.776046 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-7f663b0a-ce83-4e97-aa10-6a26ead1acdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9399a34ded7e4bffb48ea8a8e92ed3a6'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:00.806509 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-7f663b0a-ce83-4e97-aa10-6a26ead1acdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9399a34ded7e4bffb48ea8a8e92ed3a6'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:00.811195 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-7f663b0a-ce83-4e97-aa10-6a26ead1acdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9399a34ded7e4bffb48ea8a8e92ed3a6'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:00.835449 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-7f663b0a-ce83-4e97-aa10-6a26ead1acdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9399a34ded7e4bffb48ea8a8e92ed3a6'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:00.849505 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-7f663b0a-ce83-4e97-aa10-6a26ead1acdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9399a34ded7e4bffb48ea8a8e92ed3a6'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:00.860195 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-443421cf-b2ab-4428-b9c4-18ad05f29252 None None] MFA Rules not processed for user `df2ec396a09f497fa5761cef615b262d`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:00.861383 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-443421cf-b2ab-4428-b9c4-18ad05f29252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:00.865481 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1075/2149] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:54:00 2021] DELETE /identity/v3/users/9399a34ded7e4bffb48ea8a8e92ed3a6 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:54:01.046948 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1075/2150] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:00 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:54:01.051671 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f663b0a-ce83-4e97-aa10-6a26ead1acdf admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:01.053064 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-7f663b0a-ce83-4e97-aa10-6a26ead1acdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:01.234798 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f663b0a-ce83-4e97-aa10-6a26ead1acdf admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:01.242115 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b8473-fde0-4bfa-b9d3-959621316c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:01.243014 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b8473-fde0-4bfa-b9d3-959621316c3f admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:01.243448 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b8473-fde0-4bfa-b9d3-959621316c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:01.243908 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b8473-fde0-4bfa-b9d3-959621316c3f admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:01.244752 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b8473-fde0-4bfa-b9d3-959621316c3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:01.277769 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b8473-fde0-4bfa-b9d3-959621316c3f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:01.319616 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1076/2151] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:54:01 2021] POST /identity/v3/projects => generated 377 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:54:01.321176 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443421cf-b2ab-4428-b9c4-18ad05f29252 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:01.336590 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443421cf-b2ab-4428-b9c4-18ad05f29252 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:01.472978 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f007e96-6838-4314-8b5c-35c46fe67757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:01.473831 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f007e96-6838-4314-8b5c-35c46fe67757 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:01.474967 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f007e96-6838-4314-8b5c-35c46fe67757 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:01.475847 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f007e96-6838-4314-8b5c-35c46fe67757 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:01.476779 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f007e96-6838-4314-8b5c-35c46fe67757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:01.517170 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f007e96-6838-4314-8b5c-35c46fe67757 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:01.539103 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1076/2152] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:54:01 2021] POST /identity/v3/users => generated 295 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:54:01.543071 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b8473-fde0-4bfa-b9d3-959621316c3f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:01.553378 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b8473-fde0-4bfa-b9d3-959621316c3f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:01.558462 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d8c67-d319-4398-a22e-69931a9313d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:01.559423 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d8c67-d319-4398-a22e-69931a9313d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:01.559984 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d8c67-d319-4398-a22e-69931a9313d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:01.560565 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d8c67-d319-4398-a22e-69931a9313d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:01.561253 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d8c67-d319-4398-a22e-69931a9313d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:01.588942 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d8c67-d319-4398-a22e-69931a9313d0 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:01.605642 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1077/2153] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:54:01 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:54:01.606374 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f007e96-6838-4314-8b5c-35c46fe67757 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:01.640562 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f007e96-6838-4314-8b5c-35c46fe67757 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:01.663763 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb4cd9-a66e-4f5e-bf17-cbb0104e694f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:01.666638 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb4cd9-a66e-4f5e-bf17-cbb0104e694f admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:01.668966 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb4cd9-a66e-4f5e-bf17-cbb0104e694f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:01.669404 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb4cd9-a66e-4f5e-bf17-cbb0104e694f admin admin] PATH_INFO: `/v3/projects/2984268e625e45eba50ad075c215b31a/users/9b82fa253446493f84cb0d9768ed1573/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:01.707433 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb4cd9-a66e-4f5e-bf17-cbb0104e694f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2984268e625e45eba50ad075c215b31a, user_id=9b82fa253446493f84cb0d9768ed1573, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:01.753541 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb4cd9-a66e-4f5e-bf17-cbb0104e694f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:01.773995 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1077/2154] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:54:01 2021] PUT /identity/v3/projects/2984268e625e45eba50ad075c215b31a/users/9b82fa253446493f84cb0d9768ed1573/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:54:01.779050 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d8c67-d319-4398-a22e-69931a9313d0 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:01.789339 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d8c67-d319-4398-a22e-69931a9313d0 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:01.870084 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f3703-e76f-4f40-914b-2f51bef599b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:01.871192 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f3703-e76f-4f40-914b-2f51bef599b1 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:01.871726 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f3703-e76f-4f40-914b-2f51bef599b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:01.872155 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f3703-e76f-4f40-914b-2f51bef599b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:01.873026 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f3703-e76f-4f40-914b-2f51bef599b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:01.903342 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f3703-e76f-4f40-914b-2f51bef599b1 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:01.917973 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb4cd9-a66e-4f5e-bf17-cbb0104e694f admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:01.919866 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-0dbb4cd9-a66e-4f5e-bf17-cbb0104e694f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:01.926509 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1078/2155] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:54:01 2021] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:54:01.927712 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f3703-e76f-4f40-914b-2f51bef599b1 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:01.951116 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f3703-e76f-4f40-914b-2f51bef599b1 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:01.953255 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb4cd9-a66e-4f5e-bf17-cbb0104e694f admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:01.958465 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a68df8-81ec-44f2-b834-0e45e7c4438d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:01.959644 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a68df8-81ec-44f2-b834-0e45e7c4438d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:01.960058 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a68df8-81ec-44f2-b834-0e45e7c4438d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:01.960597 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a68df8-81ec-44f2-b834-0e45e7c4438d admin admin] PATH_INFO: `/v3/projects/8653b01b953b4782b7ac34e4081bfdf3` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:01.960976 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f54ee-0560-450a-bce6-4096a82b8d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:01.961811 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f54ee-0560-450a-bce6-4096a82b8d8f admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:01.962103 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f54ee-0560-450a-bce6-4096a82b8d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:01.962387 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f54ee-0560-450a-bce6-4096a82b8d8f admin admin] PATH_INFO: `/v3/projects/2984268e625e45eba50ad075c215b31a/users/9b82fa253446493f84cb0d9768ed1573/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:01.962617 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a68df8-81ec-44f2-b834-0e45e7c4438d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8653b01b953b4782b7ac34e4081bfdf3)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:01.969165 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f54ee-0560-450a-bce6-4096a82b8d8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2984268e625e45eba50ad075c215b31a, user_id=9b82fa253446493f84cb0d9768ed1573, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:01.998366 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f54ee-0560-450a-bce6-4096a82b8d8f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:02.019531 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a68df8-81ec-44f2-b834-0e45e7c4438d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:02.022050 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1079/2156] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:54:01 2021] PUT /identity/v3/projects/2984268e625e45eba50ad075c215b31a/users/9b82fa253446493f84cb0d9768ed1573/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:02.023007 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f54ee-0560-450a-bce6-4096a82b8d8f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:02.100123 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-74a68df8-81ec-44f2-b834-0e45e7c4438d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8653b01b953b4782b7ac34e4081bfdf3', 'request_id': 'req-74a68df8-81ec-44f2-b834-0e45e7c4438d'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:02.110022 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-74a68df8-81ec-44f2-b834-0e45e7c4438d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8653b01b953b4782b7ac34e4081bfdf3', 'request_id': 'req-74a68df8-81ec-44f2-b834-0e45e7c4438d'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:02.126404 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-74a68df8-81ec-44f2-b834-0e45e7c4438d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8653b01b953b4782b7ac34e4081bfdf3', 'request_id': 'req-74a68df8-81ec-44f2-b834-0e45e7c4438d'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:02.139670 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f54ee-0560-450a-bce6-4096a82b8d8f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:02.173224 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-74a68df8-81ec-44f2-b834-0e45e7c4438d admin admin] The token cache is being invalidate because project 8653b01b953b4782b7ac34e4081bfdf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:54:02.173809 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-74a68df8-81ec-44f2-b834-0e45e7c4438d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:02.174647 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-74a68df8-81ec-44f2-b834-0e45e7c4438d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:02.176373 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1078/2157] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:54:01 2021] DELETE /identity/v3/projects/8653b01b953b4782b7ac34e4081bfdf3 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:54:02.180271 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a68df8-81ec-44f2-b834-0e45e7c4438d admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:02.181782 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-74a68df8-81ec-44f2-b834-0e45e7c4438d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:02.243577 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e452b9-a894-483e-a4e6-6dc4731b1248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:02.244476 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e452b9-a894-483e-a4e6-6dc4731b1248 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:02.244975 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e452b9-a894-483e-a4e6-6dc4731b1248 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:02.245975 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e452b9-a894-483e-a4e6-6dc4731b1248 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:02.248093 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e452b9-a894-483e-a4e6-6dc4731b1248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:02.281463 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e452b9-a894-483e-a4e6-6dc4731b1248 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:02.296154 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a68df8-81ec-44f2-b834-0e45e7c4438d admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:02.302767 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc57c8-e0aa-4dfe-84bf-ee5084a2f4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:02.303063 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1080/2158] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:54:02 2021] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:54:02.304004 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc57c8-e0aa-4dfe-84bf-ee5084a2f4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:02.304365 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc57c8-e0aa-4dfe-84bf-ee5084a2f4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:02.304851 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc57c8-e0aa-4dfe-84bf-ee5084a2f4fa admin admin] PATH_INFO: `/v3/users/1df8c0328cd0478eb3c4418d0193987e` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:02.306059 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc57c8-e0aa-4dfe-84bf-ee5084a2f4fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1df8c0328cd0478eb3c4418d0193987e)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:02.306755 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e452b9-a894-483e-a4e6-6dc4731b1248 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:02.309067 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-39e452b9-a894-483e-a4e6-6dc4731b1248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:02.321744 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e452b9-a894-483e-a4e6-6dc4731b1248 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:02.329837 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd40cc6-2096-431f-86e1-221a925a7862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:02.330993 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd40cc6-2096-431f-86e1-221a925a7862 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:02.331433 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd40cc6-2096-431f-86e1-221a925a7862 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:02.331866 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd40cc6-2096-431f-86e1-221a925a7862 admin admin] PATH_INFO: `/v3/projects/2984268e625e45eba50ad075c215b31a/users/9b82fa253446493f84cb0d9768ed1573/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:02.334277 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd40cc6-2096-431f-86e1-221a925a7862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2984268e625e45eba50ad075c215b31a, user_id=9b82fa253446493f84cb0d9768ed1573, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:02.343568 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc57c8-e0aa-4dfe-84bf-ee5084a2f4fa admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:02.374833 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd40cc6-2096-431f-86e1-221a925a7862 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:02.395822 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1081/2159] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:54:02 2021] PUT /identity/v3/projects/2984268e625e45eba50ad075c215b31a/users/9b82fa253446493f84cb0d9768ed1573/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:02.426379 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-e4bc57c8-e0aa-4dfe-84bf-ee5084a2f4fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1df8c0328cd0478eb3c4418d0193987e'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:02.427064 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-e4bc57c8-e0aa-4dfe-84bf-ee5084a2f4fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1df8c0328cd0478eb3c4418d0193987e'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:02.436205 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-e4bc57c8-e0aa-4dfe-84bf-ee5084a2f4fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1df8c0328cd0478eb3c4418d0193987e'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:02.452895 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-e4bc57c8-e0aa-4dfe-84bf-ee5084a2f4fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1df8c0328cd0478eb3c4418d0193987e'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:02.462116 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-e4bc57c8-e0aa-4dfe-84bf-ee5084a2f4fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1df8c0328cd0478eb3c4418d0193987e'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:02.469300 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1079/2160] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:54:02 2021] DELETE /identity/v3/users/1df8c0328cd0478eb3c4418d0193987e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:54:03.034347 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd40cc6-2096-431f-86e1-221a925a7862 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:03.035961 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-5bd40cc6-2096-431f-86e1-221a925a7862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:03.144560 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd40cc6-2096-431f-86e1-221a925a7862 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:03.243811 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404d716-63bf-4b95-9834-42fe60741ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:03.245410 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404d716-63bf-4b95-9834-42fe60741ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:03.246247 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404d716-63bf-4b95-9834-42fe60741ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:03.246532 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404d716-63bf-4b95-9834-42fe60741ecb admin admin] PATH_INFO: `/v3/projects/5951ef3032e24aa78ce64a56afe5fbbe` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:03.247790 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404d716-63bf-4b95-9834-42fe60741ecb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5951ef3032e24aa78ce64a56afe5fbbe)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:03.281947 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404d716-63bf-4b95-9834-42fe60741ecb admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:03.357882 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-9404d716-63bf-4b95-9834-42fe60741ecb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5951ef3032e24aa78ce64a56afe5fbbe', 'request_id': 'req-9404d716-63bf-4b95-9834-42fe60741ecb'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:03.367705 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-9404d716-63bf-4b95-9834-42fe60741ecb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5951ef3032e24aa78ce64a56afe5fbbe', 'request_id': 'req-9404d716-63bf-4b95-9834-42fe60741ecb'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:03.391533 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-9404d716-63bf-4b95-9834-42fe60741ecb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5951ef3032e24aa78ce64a56afe5fbbe', 'request_id': 'req-9404d716-63bf-4b95-9834-42fe60741ecb'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:03.425808 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-9404d716-63bf-4b95-9834-42fe60741ecb admin admin] The token cache is being invalidate because project 5951ef3032e24aa78ce64a56afe5fbbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:54:03.426680 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-9404d716-63bf-4b95-9834-42fe60741ecb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:03.429171 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-9404d716-63bf-4b95-9834-42fe60741ecb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:03.430809 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1082/2161] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:54:03 2021] DELETE /identity/v3/projects/5951ef3032e24aa78ce64a56afe5fbbe => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:03.440361 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef4f9f-c732-4ebf-bc4c-b74d34983123 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:03.440828 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef4f9f-c732-4ebf-bc4c-b74d34983123 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:03.441127 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef4f9f-c732-4ebf-bc4c-b74d34983123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:03.483646 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-01ef4f9f-c732-4ebf-bc4c-b74d34983123 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:03.488454 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-01ef4f9f-c732-4ebf-bc4c-b74d34983123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:03.645047 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1080/2162] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:03.654765 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c8f3e-0e07-4dbe-9a95-7865d8a74a12 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:03.655079 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c8f3e-0e07-4dbe-9a95-7865d8a74a12 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:03.655509 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c8f3e-0e07-4dbe-9a95-7865d8a74a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:03.699475 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-ea3c8f3e-0e07-4dbe-9a95-7865d8a74a12 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:03.700455 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-ea3c8f3e-0e07-4dbe-9a95-7865d8a74a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:03.728502 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1083/2163] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:03.733250 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef4f9f-c732-4ebf-bc4c-b74d34983123 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:03.750497 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef4f9f-c732-4ebf-bc4c-b74d34983123 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:03.757675 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc99bd-72a5-4742-9030-c7a636a62d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:03.758872 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc99bd-72a5-4742-9030-c7a636a62d48 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:03.759485 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc99bd-72a5-4742-9030-c7a636a62d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:03.759958 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc99bd-72a5-4742-9030-c7a636a62d48 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:03.761013 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc99bd-72a5-4742-9030-c7a636a62d48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:54:03.761656 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc99bd-72a5-4742-9030-c7a636a62d48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:03.809728 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc99bd-72a5-4742-9030-c7a636a62d48 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:03.843214 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1081/2164] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:54:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:54:03.844439 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c8f3e-0e07-4dbe-9a95-7865d8a74a12 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:03.854621 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c8f3e-0e07-4dbe-9a95-7865d8a74a12 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:03.873471 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8642e2-ed43-4806-8946-ca356e5d2389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:03.874180 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8642e2-ed43-4806-8946-ca356e5d2389 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:03.874570 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8642e2-ed43-4806-8946-ca356e5d2389 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:03.874981 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8642e2-ed43-4806-8946-ca356e5d2389 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:03.875716 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8642e2-ed43-4806-8946-ca356e5d2389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:03.935576 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8642e2-ed43-4806-8946-ca356e5d2389 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:04.001095 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1084/2165] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:54:03 2021] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:54:04.006963 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc99bd-72a5-4742-9030-c7a636a62d48 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:04.020235 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc99bd-72a5-4742-9030-c7a636a62d48 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:04.129700 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965c905-281e-438b-a942-444d9ae71ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:04.131354 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965c905-281e-438b-a942-444d9ae71ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:04.132650 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965c905-281e-438b-a942-444d9ae71ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:04.133930 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965c905-281e-438b-a942-444d9ae71ea2 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:04.136150 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965c905-281e-438b-a942-444d9ae71ea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:04.193037 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965c905-281e-438b-a942-444d9ae71ea2 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:04.215607 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1082/2166] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:54:04 2021] POST /identity/v3/users => generated 291 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:54:04.219598 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8642e2-ed43-4806-8946-ca356e5d2389 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:04.230335 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8642e2-ed43-4806-8946-ca356e5d2389 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:04.235215 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902bb2e-701a-404f-b1ed-bd3047dde76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:04.235893 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902bb2e-701a-404f-b1ed-bd3047dde76a admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:04.236253 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902bb2e-701a-404f-b1ed-bd3047dde76a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:04.236609 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902bb2e-701a-404f-b1ed-bd3047dde76a admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:04.237379 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902bb2e-701a-404f-b1ed-bd3047dde76a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:04.264608 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902bb2e-701a-404f-b1ed-bd3047dde76a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:04.275129 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1085/2167] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:54:04 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:54:04.279892 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965c905-281e-438b-a942-444d9ae71ea2 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:04.290255 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965c905-281e-438b-a942-444d9ae71ea2 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:04.295757 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1e440-de3b-46ec-8452-3da442e17cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:04.296673 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1e440-de3b-46ec-8452-3da442e17cb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:04.297038 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1e440-de3b-46ec-8452-3da442e17cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:04.297398 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1e440-de3b-46ec-8452-3da442e17cb7 admin admin] PATH_INFO: `/v3/projects/43eddfc453f24d2dbf472d1a4e6115f4/users/9d209b901a714770901b4002a5df5f6c/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:04.319155 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1e440-de3b-46ec-8452-3da442e17cb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43eddfc453f24d2dbf472d1a4e6115f4, user_id=9d209b901a714770901b4002a5df5f6c, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:04.350453 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1e440-de3b-46ec-8452-3da442e17cb7 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:04.366033 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1083/2168] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:54:04 2021] PUT /identity/v3/projects/43eddfc453f24d2dbf472d1a4e6115f4/users/9d209b901a714770901b4002a5df5f6c/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:54:04.379102 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23fbe1-575a-4435-9cee-03789bc10a11 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:04.379540 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23fbe1-575a-4435-9cee-03789bc10a11 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:04.379982 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23fbe1-575a-4435-9cee-03789bc10a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:04.427690 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-ed23fbe1-575a-4435-9cee-03789bc10a11 None None] MFA Rules not processed for user `9d209b901a714770901b4002a5df5f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:04.429007 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-ed23fbe1-575a-4435-9cee-03789bc10a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:04.505775 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1086/2169] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:04 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:04.506893 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1e440-de3b-46ec-8452-3da442e17cb7 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:04.591779 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1e440-de3b-46ec-8452-3da442e17cb7 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:04.596482 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13a0f2-0a95-4a0e-896a-fc28801433ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:04.597365 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13a0f2-0a95-4a0e-896a-fc28801433ab admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:04.597757 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13a0f2-0a95-4a0e-896a-fc28801433ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:04.598298 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13a0f2-0a95-4a0e-896a-fc28801433ab admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:04.599313 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13a0f2-0a95-4a0e-896a-fc28801433ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:04.629469 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13a0f2-0a95-4a0e-896a-fc28801433ab admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:04.679272 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1084/2170] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:54:04 2021] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:54:04.680058 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23fbe1-575a-4435-9cee-03789bc10a11 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:04.692080 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23fbe1-575a-4435-9cee-03789bc10a11 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:04.760267 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7690e-50a3-49b0-bdda-8b044eb18f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:04.761445 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7690e-50a3-49b0-bdda-8b044eb18f73 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:04.761783 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7690e-50a3-49b0-bdda-8b044eb18f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:04.762134 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7690e-50a3-49b0-bdda-8b044eb18f73 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:04.762889 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7690e-50a3-49b0-bdda-8b044eb18f73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:04.790104 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7690e-50a3-49b0-bdda-8b044eb18f73 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:04.815985 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1087/2171] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:54:04 2021] POST /identity/v3/users => generated 297 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:54:04.820293 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13a0f2-0a95-4a0e-896a-fc28801433ab admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:04.834766 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13a0f2-0a95-4a0e-896a-fc28801433ab admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:04.840584 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb1fe0-e6eb-47e0-9799-323c88baa553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:04.841680 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb1fe0-e6eb-47e0-9799-323c88baa553 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:04.841826 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb1fe0-e6eb-47e0-9799-323c88baa553 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:04.842099 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb1fe0-e6eb-47e0-9799-323c88baa553 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:04.843276 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb1fe0-e6eb-47e0-9799-323c88baa553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:04.884384 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb1fe0-e6eb-47e0-9799-323c88baa553 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:04.900477 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1085/2172] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:54:04 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:54:04.905249 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7690e-50a3-49b0-bdda-8b044eb18f73 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:04.918295 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7690e-50a3-49b0-bdda-8b044eb18f73 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:04.930237 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08737c03-bc7c-4373-8c06-a3cbb61dfc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:04.931534 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08737c03-bc7c-4373-8c06-a3cbb61dfc03 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:04.931929 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08737c03-bc7c-4373-8c06-a3cbb61dfc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:04.932330 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08737c03-bc7c-4373-8c06-a3cbb61dfc03 admin admin] PATH_INFO: `/v3/projects/3e1200c869784529a343842913d27128/users/502ad6645e3b4b78b8ac19b71a99d5d3/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:04.979056 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08737c03-bc7c-4373-8c06-a3cbb61dfc03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e1200c869784529a343842913d27128, user_id=502ad6645e3b4b78b8ac19b71a99d5d3, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:05.012980 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08737c03-bc7c-4373-8c06-a3cbb61dfc03 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:05.034030 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1088/2173] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:54:04 2021] PUT /identity/v3/projects/3e1200c869784529a343842913d27128/users/502ad6645e3b4b78b8ac19b71a99d5d3/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:05.037698 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb1fe0-e6eb-47e0-9799-323c88baa553 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:05.061897 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb1fe0-e6eb-47e0-9799-323c88baa553 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:05.161800 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b5e5d-0ffa-4314-b334-88b6bc024faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:05.162648 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b5e5d-0ffa-4314-b334-88b6bc024faa admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:05.163026 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b5e5d-0ffa-4314-b334-88b6bc024faa admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:05.163411 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b5e5d-0ffa-4314-b334-88b6bc024faa admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:05.164345 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b5e5d-0ffa-4314-b334-88b6bc024faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:05.219913 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b5e5d-0ffa-4314-b334-88b6bc024faa admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:05.246749 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1086/2174] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:54:05 2021] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:54:05.250885 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08737c03-bc7c-4373-8c06-a3cbb61dfc03 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:05.261744 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08737c03-bc7c-4373-8c06-a3cbb61dfc03 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:05.266483 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a56fa-efa7-43bf-9aa4-fb54f83949b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:05.267283 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a56fa-efa7-43bf-9aa4-fb54f83949b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:05.267570 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a56fa-efa7-43bf-9aa4-fb54f83949b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:05.267855 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a56fa-efa7-43bf-9aa4-fb54f83949b1 admin admin] PATH_INFO: `/v3/projects/3e1200c869784529a343842913d27128/users/502ad6645e3b4b78b8ac19b71a99d5d3/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:05.269640 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a56fa-efa7-43bf-9aa4-fb54f83949b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e1200c869784529a343842913d27128, user_id=502ad6645e3b4b78b8ac19b71a99d5d3, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:05.298941 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a56fa-efa7-43bf-9aa4-fb54f83949b1 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:05.316329 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1089/2175] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:54:05 2021] PUT /identity/v3/projects/3e1200c869784529a343842913d27128/users/502ad6645e3b4b78b8ac19b71a99d5d3/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:54:05.318748 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b5e5d-0ffa-4314-b334-88b6bc024faa admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:05.328918 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b5e5d-0ffa-4314-b334-88b6bc024faa admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:05.407470 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277f1d3-1dd0-4b8e-8f6a-ed68f441f1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:05.408221 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277f1d3-1dd0-4b8e-8f6a-ed68f441f1ba admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:05.408607 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277f1d3-1dd0-4b8e-8f6a-ed68f441f1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:05.408979 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277f1d3-1dd0-4b8e-8f6a-ed68f441f1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:05.409778 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277f1d3-1dd0-4b8e-8f6a-ed68f441f1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:05.439024 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277f1d3-1dd0-4b8e-8f6a-ed68f441f1ba admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:05.452463 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1087/2176] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:54:05 2021] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:54:05.456200 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a56fa-efa7-43bf-9aa4-fb54f83949b1 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:05.467213 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a56fa-efa7-43bf-9aa4-fb54f83949b1 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:05.472552 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803af1a-34bd-4cd3-81d7-57aa5ec7047f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:05.473490 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803af1a-34bd-4cd3-81d7-57aa5ec7047f admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:05.474005 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803af1a-34bd-4cd3-81d7-57aa5ec7047f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:05.474493 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803af1a-34bd-4cd3-81d7-57aa5ec7047f admin admin] PATH_INFO: `/v3/projects/3e1200c869784529a343842913d27128/users/502ad6645e3b4b78b8ac19b71a99d5d3/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:05.477335 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803af1a-34bd-4cd3-81d7-57aa5ec7047f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e1200c869784529a343842913d27128, user_id=502ad6645e3b4b78b8ac19b71a99d5d3, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:05.537210 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803af1a-34bd-4cd3-81d7-57aa5ec7047f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:05.555945 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1090/2177] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:54:05 2021] PUT /identity/v3/projects/3e1200c869784529a343842913d27128/users/502ad6645e3b4b78b8ac19b71a99d5d3/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:05.565954 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8c523-b994-4858-b747-20dc287dc662 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:05.566479 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8c523-b994-4858-b747-20dc287dc662 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:05.566590 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8c523-b994-4858-b747-20dc287dc662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:05.608215 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-3ba8c523-b994-4858-b747-20dc287dc662 None None] MFA Rules not processed for user `502ad6645e3b4b78b8ac19b71a99d5d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:05.609577 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-3ba8c523-b994-4858-b747-20dc287dc662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:05.769359 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1088/2178] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:05 2021] POST /identity/v3/auth/tokens => generated 3755 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:05.780200 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803af1a-34bd-4cd3-81d7-57aa5ec7047f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:05.781889 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-6803af1a-34bd-4cd3-81d7-57aa5ec7047f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:05.958477 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803af1a-34bd-4cd3-81d7-57aa5ec7047f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:05.966643 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46581b85-f42c-4eb1-8c30-d6996425778c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:05.967526 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46581b85-f42c-4eb1-8c30-d6996425778c service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:05.967965 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46581b85-f42c-4eb1-8c30-d6996425778c service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:05.968392 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46581b85-f42c-4eb1-8c30-d6996425778c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:05.982644 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46581b85-f42c-4eb1-8c30-d6996425778c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:06.064082 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46581b85-f42c-4eb1-8c30-d6996425778c service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:06.099903 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1091/2179] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:54:05 2021] GET /identity/v3/auth/tokens => generated 3755 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:54:06.241104 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8c523-b994-4858-b747-20dc287dc662 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:06.251882 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8c523-b994-4858-b747-20dc287dc662 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:06.263722 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1cc46-28b6-4000-8db5-7d55a55cda70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:06.266382 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1cc46-28b6-4000-8db5-7d55a55cda70 service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:06.266890 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1cc46-28b6-4000-8db5-7d55a55cda70 service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:06.267317 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1cc46-28b6-4000-8db5-7d55a55cda70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:06.408793 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1cc46-28b6-4000-8db5-7d55a55cda70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:06.465795 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1cc46-28b6-4000-8db5-7d55a55cda70 service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:06.484196 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1089/2180] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:54:06 2021] GET /identity/v3/auth/tokens => generated 3688 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:54:11.169600 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46581b85-f42c-4eb1-8c30-d6996425778c service cinder] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:11.252227 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46581b85-f42c-4eb1-8c30-d6996425778c service cinder] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:11.256742 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e87e4-7a38-4632-99e4-7aaf38ccabaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:11.258009 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e87e4-7a38-4632-99e4-7aaf38ccabaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:11.258009 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e87e4-7a38-4632-99e4-7aaf38ccabaa admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:11.258265 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e87e4-7a38-4632-99e4-7aaf38ccabaa admin admin] PATH_INFO: `/v3/users/9d209b901a714770901b4002a5df5f6c` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:11.259449 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e87e4-7a38-4632-99e4-7aaf38ccabaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d209b901a714770901b4002a5df5f6c)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:11.288623 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e87e4-7a38-4632-99e4-7aaf38ccabaa admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:11.343177 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-217e87e4-7a38-4632-99e4-7aaf38ccabaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d209b901a714770901b4002a5df5f6c'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:11.355598 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-217e87e4-7a38-4632-99e4-7aaf38ccabaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d209b901a714770901b4002a5df5f6c'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:11.356271 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-217e87e4-7a38-4632-99e4-7aaf38ccabaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d209b901a714770901b4002a5df5f6c'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:11.363838 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-217e87e4-7a38-4632-99e4-7aaf38ccabaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d209b901a714770901b4002a5df5f6c'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:11.372960 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-217e87e4-7a38-4632-99e4-7aaf38ccabaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d209b901a714770901b4002a5df5f6c'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:11.380155 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1092/2181] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:54:11 2021] DELETE /identity/v3/users/9d209b901a714770901b4002a5df5f6c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:11.384833 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe81cd-6357-4c5c-92db-b9e5c87cdd4d None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:11.385364 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe81cd-6357-4c5c-92db-b9e5c87cdd4d None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:11.385526 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe81cd-6357-4c5c-92db-b9e5c87cdd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:11.412497 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-cebe81cd-6357-4c5c-92db-b9e5c87cdd4d None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:11.413810 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-cebe81cd-6357-4c5c-92db-b9e5c87cdd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:11.459336 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ef715-08d2-47a3-b2fe-96c27b36f7c2 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:11.459945 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ef715-08d2-47a3-b2fe-96c27b36f7c2 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:11.460383 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ef715-08d2-47a3-b2fe-96c27b36f7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:11.490495 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1090/2182] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:11.510517 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe81cd-6357-4c5c-92db-b9e5c87cdd4d None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:11.512451 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-cebe81cd-6357-4c5c-92db-b9e5c87cdd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:11.518397 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-8a4ef715-08d2-47a3-b2fe-96c27b36f7c2 None None] MFA Rules not processed for user `9b82fa253446493f84cb0d9768ed1573`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:11.519572 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-8a4ef715-08d2-47a3-b2fe-96c27b36f7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:11.662742 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe81cd-6357-4c5c-92db-b9e5c87cdd4d None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:11.670268 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1093/2183] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:11 2021] POST /identity/v3/auth/tokens => generated 3751 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:11.675945 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843936e-2ca8-42ba-aa90-5f8d51eba3ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:11.676700 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843936e-2ca8-42ba-aa90-5f8d51eba3ab service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:11.676860 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843936e-2ca8-42ba-aa90-5f8d51eba3ab service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:11.677085 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843936e-2ca8-42ba-aa90-5f8d51eba3ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:11.698597 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843936e-2ca8-42ba-aa90-5f8d51eba3ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:11.754115 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843936e-2ca8-42ba-aa90-5f8d51eba3ab service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:11.770327 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1091/2184] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:54:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:54:11.773245 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ef715-08d2-47a3-b2fe-96c27b36f7c2 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:11.774616 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-8a4ef715-08d2-47a3-b2fe-96c27b36f7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:11.924010 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ef715-08d2-47a3-b2fe-96c27b36f7c2 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:11.936920 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501b2b5-1774-4028-9b94-bb8f06e53aaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:11.937521 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501b2b5-1774-4028-9b94-bb8f06e53aaf service nova] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:11.937980 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501b2b5-1774-4028-9b94-bb8f06e53aaf service nova] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:11.938393 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501b2b5-1774-4028-9b94-bb8f06e53aaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:11.943763 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c501b2b5-1774-4028-9b94-bb8f06e53aaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:12.039600 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501b2b5-1774-4028-9b94-bb8f06e53aaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:12.072628 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501b2b5-1774-4028-9b94-bb8f06e53aaf service nova] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:12.084447 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1094/2185] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:54:11 2021] GET /identity/v3/auth/tokens => generated 3686 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:54:12.362580 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843936e-2ca8-42ba-aa90-5f8d51eba3ab service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:12.364216 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-8843936e-2ca8-42ba-aa90-5f8d51eba3ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:12.380742 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843936e-2ca8-42ba-aa90-5f8d51eba3ab service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:12.385244 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087ba86-cde1-455a-a79c-c45de171c1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:12.386797 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087ba86-cde1-455a-a79c-c45de171c1c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:12.387055 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087ba86-cde1-455a-a79c-c45de171c1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:12.387328 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087ba86-cde1-455a-a79c-c45de171c1c8 admin admin] PATH_INFO: `/v3/projects/43eddfc453f24d2dbf472d1a4e6115f4` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:12.388420 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087ba86-cde1-455a-a79c-c45de171c1c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43eddfc453f24d2dbf472d1a4e6115f4)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:12.415377 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087ba86-cde1-455a-a79c-c45de171c1c8 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:12.470082 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d087ba86-cde1-455a-a79c-c45de171c1c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43eddfc453f24d2dbf472d1a4e6115f4', 'request_id': 'req-d087ba86-cde1-455a-a79c-c45de171c1c8'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:12.477684 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d087ba86-cde1-455a-a79c-c45de171c1c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43eddfc453f24d2dbf472d1a4e6115f4', 'request_id': 'req-d087ba86-cde1-455a-a79c-c45de171c1c8'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:12.483151 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d087ba86-cde1-455a-a79c-c45de171c1c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43eddfc453f24d2dbf472d1a4e6115f4', 'request_id': 'req-d087ba86-cde1-455a-a79c-c45de171c1c8'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:12.499524 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d087ba86-cde1-455a-a79c-c45de171c1c8 admin admin] The token cache is being invalidate because project 43eddfc453f24d2dbf472d1a4e6115f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:54:12.499836 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d087ba86-cde1-455a-a79c-c45de171c1c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:12.500422 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d087ba86-cde1-455a-a79c-c45de171c1c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:12.502127 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1092/2186] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:54:12 2021] DELETE /identity/v3/projects/43eddfc453f24d2dbf472d1a4e6115f4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:12.506189 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501b2b5-1774-4028-9b94-bb8f06e53aaf service nova] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:12.517895 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501b2b5-1774-4028-9b94-bb8f06e53aaf service nova] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:12.587848 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6bdd3-d68e-492c-9602-14c865ffaed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:12.588700 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6bdd3-d68e-492c-9602-14c865ffaed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:12.588992 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6bdd3-d68e-492c-9602-14c865ffaed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:12.589295 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6bdd3-d68e-492c-9602-14c865ffaed9 admin admin] PATH_INFO: `/v3/users/502ad6645e3b4b78b8ac19b71a99d5d3` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:12.590375 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6bdd3-d68e-492c-9602-14c865ffaed9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=502ad6645e3b4b78b8ac19b71a99d5d3)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:12.616925 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6bdd3-d68e-492c-9602-14c865ffaed9 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:12.684449 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-d0e6bdd3-d68e-492c-9602-14c865ffaed9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '502ad6645e3b4b78b8ac19b71a99d5d3'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:12.697273 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-d0e6bdd3-d68e-492c-9602-14c865ffaed9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '502ad6645e3b4b78b8ac19b71a99d5d3'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:12.697695 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-d0e6bdd3-d68e-492c-9602-14c865ffaed9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '502ad6645e3b4b78b8ac19b71a99d5d3'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:12.707150 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-d0e6bdd3-d68e-492c-9602-14c865ffaed9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '502ad6645e3b4b78b8ac19b71a99d5d3'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:12.722530 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-d0e6bdd3-d68e-492c-9602-14c865ffaed9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '502ad6645e3b4b78b8ac19b71a99d5d3'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:12.732218 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1095/2187] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:54:12 2021] DELETE /identity/v3/users/502ad6645e3b4b78b8ac19b71a99d5d3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:13.341172 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087ba86-cde1-455a-a79c-c45de171c1c8 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:13.343771 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-d087ba86-cde1-455a-a79c-c45de171c1c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:13.370903 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087ba86-cde1-455a-a79c-c45de171c1c8 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:13.460941 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da0160-a4bf-4f9b-bd07-8cd84c840321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:13.462968 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da0160-a4bf-4f9b-bd07-8cd84c840321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:13.463511 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da0160-a4bf-4f9b-bd07-8cd84c840321 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:13.464475 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da0160-a4bf-4f9b-bd07-8cd84c840321 admin admin] PATH_INFO: `/v3/projects/3e1200c869784529a343842913d27128` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:13.465916 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da0160-a4bf-4f9b-bd07-8cd84c840321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e1200c869784529a343842913d27128)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:13.493249 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da0160-a4bf-4f9b-bd07-8cd84c840321 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:13.556098 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-e2da0160-a4bf-4f9b-bd07-8cd84c840321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e1200c869784529a343842913d27128', 'request_id': 'req-e2da0160-a4bf-4f9b-bd07-8cd84c840321'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:13.567228 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-e2da0160-a4bf-4f9b-bd07-8cd84c840321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e1200c869784529a343842913d27128', 'request_id': 'req-e2da0160-a4bf-4f9b-bd07-8cd84c840321'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:13.573205 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-e2da0160-a4bf-4f9b-bd07-8cd84c840321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e1200c869784529a343842913d27128', 'request_id': 'req-e2da0160-a4bf-4f9b-bd07-8cd84c840321'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:13.591356 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-e2da0160-a4bf-4f9b-bd07-8cd84c840321 admin admin] The token cache is being invalidate because project 3e1200c869784529a343842913d27128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:54:13.591601 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-e2da0160-a4bf-4f9b-bd07-8cd84c840321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:13.592310 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-e2da0160-a4bf-4f9b-bd07-8cd84c840321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:13.597850 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1093/2188] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:54:13 2021] DELETE /identity/v3/projects/3e1200c869784529a343842913d27128 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:13.599716 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0af572-240c-4d80-85ac-b5859cb979a0 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:13.600178 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0af572-240c-4d80-85ac-b5859cb979a0 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:13.600178 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0af572-240c-4d80-85ac-b5859cb979a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:13.628563 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-5b0af572-240c-4d80-85ac-b5859cb979a0 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:13.630295 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-5b0af572-240c-4d80-85ac-b5859cb979a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:13.736953 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1096/2189] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:13.742631 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a596f-fd8e-43b7-b54d-74669ceb56a2 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:13.742961 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a596f-fd8e-43b7-b54d-74669ceb56a2 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:13.743254 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a596f-fd8e-43b7-b54d-74669ceb56a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:13.773020 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-b35a596f-fd8e-43b7-b54d-74669ceb56a2 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:13.774232 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-b35a596f-fd8e-43b7-b54d-74669ceb56a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:13.783597 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1094/2190] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:13.788499 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0af572-240c-4d80-85ac-b5859cb979a0 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:13.800856 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0af572-240c-4d80-85ac-b5859cb979a0 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:13.806262 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24379fa2-e001-448a-9112-168349f9daec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:13.807028 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24379fa2-e001-448a-9112-168349f9daec admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:13.807469 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24379fa2-e001-448a-9112-168349f9daec admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:13.807825 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24379fa2-e001-448a-9112-168349f9daec admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:13.808513 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24379fa2-e001-448a-9112-168349f9daec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:54:13.808821 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24379fa2-e001-448a-9112-168349f9daec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:13.839253 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24379fa2-e001-448a-9112-168349f9daec admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:13.871406 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1097/2191] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:54:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:54:13.875888 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a596f-fd8e-43b7-b54d-74669ceb56a2 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:13.888587 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a596f-fd8e-43b7-b54d-74669ceb56a2 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:13.900579 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2e49e-4742-434e-8939-5fe28c4f90dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:13.901286 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2e49e-4742-434e-8939-5fe28c4f90dc admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:13.901749 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2e49e-4742-434e-8939-5fe28c4f90dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:13.902232 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2e49e-4742-434e-8939-5fe28c4f90dc admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:13.903124 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2e49e-4742-434e-8939-5fe28c4f90dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:13.951735 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2e49e-4742-434e-8939-5fe28c4f90dc admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:13.993045 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1095/2192] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:54:13 2021] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:54:13.997263 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24379fa2-e001-448a-9112-168349f9daec admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:14.008533 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24379fa2-e001-448a-9112-168349f9daec admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:14.091639 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee8b5a-e136-40b5-9ba1-7f72204a516f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:14.092275 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee8b5a-e136-40b5-9ba1-7f72204a516f admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:14.092564 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee8b5a-e136-40b5-9ba1-7f72204a516f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:14.092847 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee8b5a-e136-40b5-9ba1-7f72204a516f admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:14.093490 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee8b5a-e136-40b5-9ba1-7f72204a516f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:14.120270 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee8b5a-e136-40b5-9ba1-7f72204a516f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:14.140081 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1098/2193] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:54:13 2021] POST /identity/v3/users => generated 291 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:54:14.144574 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2e49e-4742-434e-8939-5fe28c4f90dc admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:14.155099 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2e49e-4742-434e-8939-5fe28c4f90dc admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:14.159560 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd173d5-b0dd-4d36-963e-78198eba71a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:14.160155 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd173d5-b0dd-4d36-963e-78198eba71a2 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:14.160833 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd173d5-b0dd-4d36-963e-78198eba71a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:14.160833 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd173d5-b0dd-4d36-963e-78198eba71a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:14.161580 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd173d5-b0dd-4d36-963e-78198eba71a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:14.197654 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd173d5-b0dd-4d36-963e-78198eba71a2 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:14.210610 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1096/2194] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:54:14 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:54:14.215054 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee8b5a-e136-40b5-9ba1-7f72204a516f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:14.225521 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee8b5a-e136-40b5-9ba1-7f72204a516f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:14.230403 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0457c-4a32-4b97-b526-33f0cebc7f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:14.231251 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0457c-4a32-4b97-b526-33f0cebc7f59 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:14.231587 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0457c-4a32-4b97-b526-33f0cebc7f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:14.231924 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0457c-4a32-4b97-b526-33f0cebc7f59 admin admin] PATH_INFO: `/v3/projects/fc650e00ca5c409b8e88c0605f763feb/users/71f7e8be698c46a1b0e470bb59bd0ba6/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:14.258882 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0457c-4a32-4b97-b526-33f0cebc7f59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc650e00ca5c409b8e88c0605f763feb, user_id=71f7e8be698c46a1b0e470bb59bd0ba6, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:14.288032 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0457c-4a32-4b97-b526-33f0cebc7f59 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:14.304762 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1099/2195] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:54:14 2021] PUT /identity/v3/projects/fc650e00ca5c409b8e88c0605f763feb/users/71f7e8be698c46a1b0e470bb59bd0ba6/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:14.317156 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb165524-dba5-4407-83eb-0305a25ef907 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:14.317525 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb165524-dba5-4407-83eb-0305a25ef907 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:14.317886 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb165524-dba5-4407-83eb-0305a25ef907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:14.373288 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-fb165524-dba5-4407-83eb-0305a25ef907 None None] MFA Rules not processed for user `71f7e8be698c46a1b0e470bb59bd0ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:14.374456 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-fb165524-dba5-4407-83eb-0305a25ef907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:14.466183 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1097/2196] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:14 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:14.470467 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0457c-4a32-4b97-b526-33f0cebc7f59 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:14.541853 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb165524-dba5-4407-83eb-0305a25ef907 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:14.543072 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-fb165524-dba5-4407-83eb-0305a25ef907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:14.591646 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0457c-4a32-4b97-b526-33f0cebc7f59 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:14.596479 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c95e06-7cdc-4f82-b15e-2616682345fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:14.605167 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c95e06-7cdc-4f82-b15e-2616682345fe admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:14.605801 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c95e06-7cdc-4f82-b15e-2616682345fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:14.605801 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c95e06-7cdc-4f82-b15e-2616682345fe admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:14.606429 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c95e06-7cdc-4f82-b15e-2616682345fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:14.623578 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb165524-dba5-4407-83eb-0305a25ef907 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:14.628058 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a53dfe-7c76-4872-991a-b4ad694349a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:14.628847 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a53dfe-7c76-4872-991a-b4ad694349a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:14.629186 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a53dfe-7c76-4872-991a-b4ad694349a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:14.629466 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a53dfe-7c76-4872-991a-b4ad694349a4 admin admin] PATH_INFO: `/v3/users/5c22f447fece425c99e9227948141a27` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:14.630680 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a53dfe-7c76-4872-991a-b4ad694349a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c22f447fece425c99e9227948141a27)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:14.637832 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c95e06-7cdc-4f82-b15e-2616682345fe admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:14.661496 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a53dfe-7c76-4872-991a-b4ad694349a4 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:14.670742 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1100/2197] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:54:14 2021] POST /identity/v3/projects => generated 381 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:54:14.672620 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c95e06-7cdc-4f82-b15e-2616682345fe admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:14.723584 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-a2a53dfe-7c76-4872-991a-b4ad694349a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c22f447fece425c99e9227948141a27'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:14.724546 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-a2a53dfe-7c76-4872-991a-b4ad694349a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c22f447fece425c99e9227948141a27'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:14.734427 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-a2a53dfe-7c76-4872-991a-b4ad694349a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c22f447fece425c99e9227948141a27'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:14.751557 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-a2a53dfe-7c76-4872-991a-b4ad694349a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c22f447fece425c99e9227948141a27'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:14.762297 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c95e06-7cdc-4f82-b15e-2616682345fe admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:14.764706 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-a2a53dfe-7c76-4872-991a-b4ad694349a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c22f447fece425c99e9227948141a27'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:14.767978 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfba0d-1edb-4719-9f5d-f43a45c99852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:14.768664 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfba0d-1edb-4719-9f5d-f43a45c99852 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:14.769056 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfba0d-1edb-4719-9f5d-f43a45c99852 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:14.769408 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfba0d-1edb-4719-9f5d-f43a45c99852 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:14.770206 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cfba0d-1edb-4719-9f5d-f43a45c99852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:14.787989 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1098/2198] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:54:14 2021] DELETE /identity/v3/users/5c22f447fece425c99e9227948141a27 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:54:14.793122 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629be4f-933f-48fb-b24f-20c7c9eeba3a None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:14.793418 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629be4f-933f-48fb-b24f-20c7c9eeba3a None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:14.793818 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629be4f-933f-48fb-b24f-20c7c9eeba3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:14.798602 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cfba0d-1edb-4719-9f5d-f43a45c99852 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:14.829700 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1101/2199] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:54:14 2021] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:54:14.834747 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfba0d-1edb-4719-9f5d-f43a45c99852 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:14.837680 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-42cfba0d-1edb-4719-9f5d-f43a45c99852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:14.846591 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-8629be4f-933f-48fb-b24f-20c7c9eeba3a None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:14.847758 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-8629be4f-933f-48fb-b24f-20c7c9eeba3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:14.851962 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfba0d-1edb-4719-9f5d-f43a45c99852 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:14.945550 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1698e47-f51f-4e35-a144-6cc544b041de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:14.946437 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1698e47-f51f-4e35-a144-6cc544b041de admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:14.947018 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1698e47-f51f-4e35-a144-6cc544b041de admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:14.947532 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1698e47-f51f-4e35-a144-6cc544b041de admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:14.949183 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1698e47-f51f-4e35-a144-6cc544b041de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:14.957445 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1099/2200] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:54:14.968561 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629be4f-933f-48fb-b24f-20c7c9eeba3a None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:14.970235 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-8629be4f-933f-48fb-b24f-20c7c9eeba3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:14.989409 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1698e47-f51f-4e35-a144-6cc544b041de admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:15.012494 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1102/2201] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:54:14 2021] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:54:15.013614 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1698e47-f51f-4e35-a144-6cc544b041de admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:15.025388 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1698e47-f51f-4e35-a144-6cc544b041de admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:15.030268 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdd6db-ace4-45ef-9786-d3939c1383e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:15.031175 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdd6db-ace4-45ef-9786-d3939c1383e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:15.031511 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdd6db-ace4-45ef-9786-d3939c1383e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:15.031796 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdd6db-ace4-45ef-9786-d3939c1383e1 admin admin] PATH_INFO: `/v3/projects/e5bc13e224704b228c1d720341332ece/users/73d02b2b82be4e719d5ea83bc6cb7a71/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:15.044087 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629be4f-933f-48fb-b24f-20c7c9eeba3a None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:15.047542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f6acf-2c74-4f37-a0f2-474a1323d71f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:15.048127 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f6acf-2c74-4f37-a0f2-474a1323d71f service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:15.048415 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f6acf-2c74-4f37-a0f2-474a1323d71f service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:15.048695 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f6acf-2c74-4f37-a0f2-474a1323d71f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:15.063233 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f6acf-2c74-4f37-a0f2-474a1323d71f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:15.072369 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdd6db-ace4-45ef-9786-d3939c1383e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5bc13e224704b228c1d720341332ece, user_id=73d02b2b82be4e719d5ea83bc6cb7a71, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:15.137596 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdd6db-ace4-45ef-9786-d3939c1383e1 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:15.138835 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f6acf-2c74-4f37-a0f2-474a1323d71f service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:15.167428 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1100/2202] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:54:14 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:54:15.207372 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1103/2203] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:54:15 2021] PUT /identity/v3/projects/e5bc13e224704b228c1d720341332ece/users/73d02b2b82be4e719d5ea83bc6cb7a71/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:15.214454 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f6acf-2c74-4f37-a0f2-474a1323d71f service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:15.227921 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f6acf-2c74-4f37-a0f2-474a1323d71f service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:15.400517 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390b0bf-717f-4bc1-9b81-ecf96d80191f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:15.401932 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390b0bf-717f-4bc1-9b81-ecf96d80191f admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:15.402271 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390b0bf-717f-4bc1-9b81-ecf96d80191f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:15.402557 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390b0bf-717f-4bc1-9b81-ecf96d80191f admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:15.403302 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390b0bf-717f-4bc1-9b81-ecf96d80191f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:15.466680 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390b0bf-717f-4bc1-9b81-ecf96d80191f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:15.482506 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1101/2204] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:54:15 2021] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:54:15.487298 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdd6db-ace4-45ef-9786-d3939c1383e1 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:15.500489 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdd6db-ace4-45ef-9786-d3939c1383e1 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:15.507123 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980df9b5-3add-4086-a54f-af83610d6f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:15.508696 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980df9b5-3add-4086-a54f-af83610d6f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:15.509740 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980df9b5-3add-4086-a54f-af83610d6f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:15.510871 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980df9b5-3add-4086-a54f-af83610d6f74 admin admin] PATH_INFO: `/v3/projects/e5bc13e224704b228c1d720341332ece/users/73d02b2b82be4e719d5ea83bc6cb7a71/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:15.513317 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980df9b5-3add-4086-a54f-af83610d6f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5bc13e224704b228c1d720341332ece, user_id=73d02b2b82be4e719d5ea83bc6cb7a71, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:15.546292 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980df9b5-3add-4086-a54f-af83610d6f74 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:15.560968 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1104/2205] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:54:15 2021] PUT /identity/v3/projects/e5bc13e224704b228c1d720341332ece/users/73d02b2b82be4e719d5ea83bc6cb7a71/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:15.564856 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390b0bf-717f-4bc1-9b81-ecf96d80191f admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:15.577625 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390b0bf-717f-4bc1-9b81-ecf96d80191f admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:15.665968 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47f8d3-b6f8-4a41-8d4b-d131afe2d9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:15.667299 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47f8d3-b6f8-4a41-8d4b-d131afe2d9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:15.667675 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47f8d3-b6f8-4a41-8d4b-d131afe2d9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:15.668100 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47f8d3-b6f8-4a41-8d4b-d131afe2d9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:15.668823 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47f8d3-b6f8-4a41-8d4b-d131afe2d9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:15.701422 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47f8d3-b6f8-4a41-8d4b-d131afe2d9d9 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:15.717766 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1102/2206] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:54:15 2021] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:54:15.721744 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980df9b5-3add-4086-a54f-af83610d6f74 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:15.741503 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980df9b5-3add-4086-a54f-af83610d6f74 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:15.747765 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85a667-21fa-4c61-a3a8-5a0cc30a98a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:15.749879 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85a667-21fa-4c61-a3a8-5a0cc30a98a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:15.750349 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85a667-21fa-4c61-a3a8-5a0cc30a98a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:15.750884 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85a667-21fa-4c61-a3a8-5a0cc30a98a5 admin admin] PATH_INFO: `/v3/projects/e5bc13e224704b228c1d720341332ece/users/73d02b2b82be4e719d5ea83bc6cb7a71/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:15.762744 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85a667-21fa-4c61-a3a8-5a0cc30a98a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5bc13e224704b228c1d720341332ece, user_id=73d02b2b82be4e719d5ea83bc6cb7a71, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:15.798208 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85a667-21fa-4c61-a3a8-5a0cc30a98a5 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:15.848463 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1105/2207] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:54:15 2021] PUT /identity/v3/projects/e5bc13e224704b228c1d720341332ece/users/73d02b2b82be4e719d5ea83bc6cb7a71/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:15.849205 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8308312-48e6-47de-bbee-52efcb62f926 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:15.849510 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8308312-48e6-47de-bbee-52efcb62f926 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:15.849798 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8308312-48e6-47de-bbee-52efcb62f926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:15.892876 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-f8308312-48e6-47de-bbee-52efcb62f926 None None] MFA Rules not processed for user `73d02b2b82be4e719d5ea83bc6cb7a71`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:15.894056 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-f8308312-48e6-47de-bbee-52efcb62f926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:15.975119 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85a667-21fa-4c61-a3a8-5a0cc30a98a5 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:15.977326 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-7a85a667-21fa-4c61-a3a8-5a0cc30a98a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:16.023260 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1103/2208] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:15 2021] POST /identity/v3/auth/tokens => generated 3755 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:16.034072 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8308312-48e6-47de-bbee-52efcb62f926 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:16.035527 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-f8308312-48e6-47de-bbee-52efcb62f926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:16.130186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85a667-21fa-4c61-a3a8-5a0cc30a98a5 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:16.143781 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b18c3-5bd5-49a8-848a-ba491d13cbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:16.144592 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b18c3-5bd5-49a8-848a-ba491d13cbd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:16.144882 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b18c3-5bd5-49a8-848a-ba491d13cbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:16.145171 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b18c3-5bd5-49a8-848a-ba491d13cbd7 admin admin] PATH_INFO: `/v3/projects/07f1392f4bce44c4bb68ab1dfd103f18` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:16.146278 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8308312-48e6-47de-bbee-52efcb62f926 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:16.146937 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b18c3-5bd5-49a8-848a-ba491d13cbd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07f1392f4bce44c4bb68ab1dfd103f18)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:16.150302 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fb8e1-9b60-4b68-92fa-baa6fcdd5961 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:16.151233 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fb8e1-9b60-4b68-92fa-baa6fcdd5961 service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:16.152047 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fb8e1-9b60-4b68-92fa-baa6fcdd5961 service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:16.152411 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fb8e1-9b60-4b68-92fa-baa6fcdd5961 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:16.163084 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fb8e1-9b60-4b68-92fa-baa6fcdd5961 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:16.182933 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b18c3-5bd5-49a8-848a-ba491d13cbd7 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:16.189903 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fb8e1-9b60-4b68-92fa-baa6fcdd5961 service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:16.201352 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1104/2209] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:54:16 2021] GET /identity/v3/auth/tokens => generated 3755 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:54:16.244865 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-314b18c3-5bd5-49a8-848a-ba491d13cbd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07f1392f4bce44c4bb68ab1dfd103f18', 'request_id': 'req-314b18c3-5bd5-49a8-848a-ba491d13cbd7'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:16.254445 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-314b18c3-5bd5-49a8-848a-ba491d13cbd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07f1392f4bce44c4bb68ab1dfd103f18', 'request_id': 'req-314b18c3-5bd5-49a8-848a-ba491d13cbd7'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:16.289893 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-314b18c3-5bd5-49a8-848a-ba491d13cbd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07f1392f4bce44c4bb68ab1dfd103f18', 'request_id': 'req-314b18c3-5bd5-49a8-848a-ba491d13cbd7'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:16.305785 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-314b18c3-5bd5-49a8-848a-ba491d13cbd7 admin admin] The token cache is being invalidate because project 07f1392f4bce44c4bb68ab1dfd103f18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:54:16.306186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-314b18c3-5bd5-49a8-848a-ba491d13cbd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:16.307060 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-314b18c3-5bd5-49a8-848a-ba491d13cbd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:16.308904 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1106/2210] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:54:15 2021] DELETE /identity/v3/projects/07f1392f4bce44c4bb68ab1dfd103f18 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:54:16.315848 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c055e-9088-448c-8c09-2ddf854ccfe3 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:16.316236 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c055e-9088-448c-8c09-2ddf854ccfe3 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:16.316588 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c055e-9088-448c-8c09-2ddf854ccfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:16.343431 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-746c055e-9088-448c-8c09-2ddf854ccfe3 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:16.344655 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-746c055e-9088-448c-8c09-2ddf854ccfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:16.427820 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1105/2211] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:16.435783 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e180f-3299-4295-90a2-b130bd1c2f69 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:16.436146 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e180f-3299-4295-90a2-b130bd1c2f69 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:16.438697 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e180f-3299-4295-90a2-b130bd1c2f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:16.465670 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-420e180f-3299-4295-90a2-b130bd1c2f69 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:16.468403 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-420e180f-3299-4295-90a2-b130bd1c2f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:16.476616 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1107/2212] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:16.481295 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c055e-9088-448c-8c09-2ddf854ccfe3 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:16.497142 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c055e-9088-448c-8c09-2ddf854ccfe3 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:16.501530 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2794669-9703-4b4c-8789-dc07843ad801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:16.502118 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2794669-9703-4b4c-8789-dc07843ad801 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:16.502402 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2794669-9703-4b4c-8789-dc07843ad801 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:16.502702 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2794669-9703-4b4c-8789-dc07843ad801 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:16.503398 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2794669-9703-4b4c-8789-dc07843ad801 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:54:16.503693 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2794669-9703-4b4c-8789-dc07843ad801 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:16.531555 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2794669-9703-4b4c-8789-dc07843ad801 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:16.553599 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e180f-3299-4295-90a2-b130bd1c2f69 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:16.558539 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1106/2213] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:54:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:54:16.564938 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e180f-3299-4295-90a2-b130bd1c2f69 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:16.570118 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf29757-f903-41d8-a6d3-2cb99676b81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:16.570807 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf29757-f903-41d8-a6d3-2cb99676b81c admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:16.571150 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf29757-f903-41d8-a6d3-2cb99676b81c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:16.571678 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf29757-f903-41d8-a6d3-2cb99676b81c admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:16.572332 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf29757-f903-41d8-a6d3-2cb99676b81c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:16.601285 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf29757-f903-41d8-a6d3-2cb99676b81c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:16.633967 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1108/2214] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:54:16 2021] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:54:16.638232 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2794669-9703-4b4c-8789-dc07843ad801 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:16.647868 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2794669-9703-4b4c-8789-dc07843ad801 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:16.800136 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392f656-92c2-4425-9b59-20d96a924394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:16.800728 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392f656-92c2-4425-9b59-20d96a924394 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:16.801011 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392f656-92c2-4425-9b59-20d96a924394 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:16.801300 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392f656-92c2-4425-9b59-20d96a924394 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:16.802269 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392f656-92c2-4425-9b59-20d96a924394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:16.837433 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392f656-92c2-4425-9b59-20d96a924394 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:16.869501 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1107/2215] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:54:16 2021] POST /identity/v3/users => generated 288 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:54:16.874329 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf29757-f903-41d8-a6d3-2cb99676b81c admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:16.895377 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf29757-f903-41d8-a6d3-2cb99676b81c admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:16.914988 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c4f8b-2652-4578-96ff-2afb9e592482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:16.915844 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c4f8b-2652-4578-96ff-2afb9e592482 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:16.916984 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c4f8b-2652-4578-96ff-2afb9e592482 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:16.917577 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c4f8b-2652-4578-96ff-2afb9e592482 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:16.918809 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c4f8b-2652-4578-96ff-2afb9e592482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:16.958837 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c4f8b-2652-4578-96ff-2afb9e592482 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:16.969359 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1109/2216] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:54:16 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:54:16.973425 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392f656-92c2-4425-9b59-20d96a924394 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:16.983611 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392f656-92c2-4425-9b59-20d96a924394 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:16.984636 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c4f8b-2652-4578-96ff-2afb9e592482 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:16.986595 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-176c4f8b-2652-4578-96ff-2afb9e592482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:16.988202 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05bda0-1ca6-4ed3-82b6-244e1410ee98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:16.989026 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05bda0-1ca6-4ed3-82b6-244e1410ee98 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:16.989319 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05bda0-1ca6-4ed3-82b6-244e1410ee98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:16.989646 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05bda0-1ca6-4ed3-82b6-244e1410ee98 admin admin] PATH_INFO: `/v3/projects/0d36ec3cd89c40a7a5706c6046525884/users/4c912c35829146279177ce1e320d346a/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:17.001729 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c4f8b-2652-4578-96ff-2afb9e592482 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:17.006389 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62840a41-8f7c-47a9-8481-d2deb2fe7cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:17.007596 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62840a41-8f7c-47a9-8481-d2deb2fe7cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:17.007779 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62840a41-8f7c-47a9-8481-d2deb2fe7cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:17.008030 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62840a41-8f7c-47a9-8481-d2deb2fe7cb6 admin admin] PATH_INFO: `/v3/users/71f7e8be698c46a1b0e470bb59bd0ba6` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:17.009125 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62840a41-8f7c-47a9-8481-d2deb2fe7cb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71f7e8be698c46a1b0e470bb59bd0ba6)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:17.011923 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05bda0-1ca6-4ed3-82b6-244e1410ee98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d36ec3cd89c40a7a5706c6046525884, user_id=4c912c35829146279177ce1e320d346a, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:17.035265 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62840a41-8f7c-47a9-8481-d2deb2fe7cb6 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:17.040159 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05bda0-1ca6-4ed3-82b6-244e1410ee98 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:17.057071 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1108/2217] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:54:16 2021] PUT /identity/v3/projects/0d36ec3cd89c40a7a5706c6046525884/users/4c912c35829146279177ce1e320d346a/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:17.067878 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3fc6a-2f92-40d5-8bf1-c650592fb3f1 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:17.068196 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3fc6a-2f92-40d5-8bf1-c650592fb3f1 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:17.068686 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3fc6a-2f92-40d5-8bf1-c650592fb3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:17.096935 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-62840a41-8f7c-47a9-8481-d2deb2fe7cb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71f7e8be698c46a1b0e470bb59bd0ba6'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:17.108385 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-fde3fc6a-2f92-40d5-8bf1-c650592fb3f1 None None] MFA Rules not processed for user `4c912c35829146279177ce1e320d346a`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:17.109625 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-fde3fc6a-2f92-40d5-8bf1-c650592fb3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:17.110401 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-62840a41-8f7c-47a9-8481-d2deb2fe7cb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71f7e8be698c46a1b0e470bb59bd0ba6'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:17.111085 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-62840a41-8f7c-47a9-8481-d2deb2fe7cb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71f7e8be698c46a1b0e470bb59bd0ba6'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:17.118916 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-62840a41-8f7c-47a9-8481-d2deb2fe7cb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71f7e8be698c46a1b0e470bb59bd0ba6'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:17.126544 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-62840a41-8f7c-47a9-8481-d2deb2fe7cb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71f7e8be698c46a1b0e470bb59bd0ba6'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:17.132358 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1110/2218] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:54:16 2021] DELETE /identity/v3/users/71f7e8be698c46a1b0e470bb59bd0ba6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:54:17.136660 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3f149-7157-4997-89a3-70c0232d60bf None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:17.136999 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3f149-7157-4997-89a3-70c0232d60bf None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:17.137282 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3f149-7157-4997-89a3-70c0232d60bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:17.158297 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-83c3f149-7157-4997-89a3-70c0232d60bf None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:17.159470 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-83c3f149-7157-4997-89a3-70c0232d60bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:17.190234 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1109/2219] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:17 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:54:17.202066 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3fc6a-2f92-40d5-8bf1-c650592fb3f1 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:17.203452 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-fde3fc6a-2f92-40d5-8bf1-c650592fb3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:17.241899 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1111/2220] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:54:17.253688 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3f149-7157-4997-89a3-70c0232d60bf None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:17.255314 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-83c3f149-7157-4997-89a3-70c0232d60bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:17.275358 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3fc6a-2f92-40d5-8bf1-c650592fb3f1 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:17.337082 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3f149-7157-4997-89a3-70c0232d60bf None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:17.340961 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c124c3-9e68-48e9-a6ec-fd1d7f8a8bf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:17.341551 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c124c3-9e68-48e9-a6ec-fd1d7f8a8bf3 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:17.341837 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c124c3-9e68-48e9-a6ec-fd1d7f8a8bf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:17.342119 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c124c3-9e68-48e9-a6ec-fd1d7f8a8bf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:17.353782 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c124c3-9e68-48e9-a6ec-fd1d7f8a8bf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:17.375869 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ce576-44a7-4946-a2a7-5fecc1a14874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:17.376622 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ce576-44a7-4946-a2a7-5fecc1a14874 service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:17.376943 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ce576-44a7-4946-a2a7-5fecc1a14874 service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:17.377230 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ce576-44a7-4946-a2a7-5fecc1a14874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:17.386237 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c124c3-9e68-48e9-a6ec-fd1d7f8a8bf3 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:17.397491 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1112/2221] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:54:17 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:54:17.466490 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ce576-44a7-4946-a2a7-5fecc1a14874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:17.510831 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ce576-44a7-4946-a2a7-5fecc1a14874 service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:17.522314 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1110/2222] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:54:17 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:54:18.006538 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c124c3-9e68-48e9-a6ec-fd1d7f8a8bf3 service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:18.008037 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-f5c124c3-9e68-48e9-a6ec-fd1d7f8a8bf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:18.029172 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c124c3-9e68-48e9-a6ec-fd1d7f8a8bf3 service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:18.045475 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74b750-dae0-4deb-9b6e-fae53ff81507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:18.046493 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74b750-dae0-4deb-9b6e-fae53ff81507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:18.046948 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74b750-dae0-4deb-9b6e-fae53ff81507 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:18.047238 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74b750-dae0-4deb-9b6e-fae53ff81507 admin admin] PATH_INFO: `/v3/projects/fc650e00ca5c409b8e88c0605f763feb` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:18.050326 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74b750-dae0-4deb-9b6e-fae53ff81507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc650e00ca5c409b8e88c0605f763feb)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:18.136115 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74b750-dae0-4deb-9b6e-fae53ff81507 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:18.256788 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-7d74b750-dae0-4deb-9b6e-fae53ff81507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc650e00ca5c409b8e88c0605f763feb', 'request_id': 'req-7d74b750-dae0-4deb-9b6e-fae53ff81507'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:18.271485 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-7d74b750-dae0-4deb-9b6e-fae53ff81507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc650e00ca5c409b8e88c0605f763feb', 'request_id': 'req-7d74b750-dae0-4deb-9b6e-fae53ff81507'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:18.285557 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-7d74b750-dae0-4deb-9b6e-fae53ff81507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc650e00ca5c409b8e88c0605f763feb', 'request_id': 'req-7d74b750-dae0-4deb-9b6e-fae53ff81507'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:18.298860 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-7d74b750-dae0-4deb-9b6e-fae53ff81507 admin admin] The token cache is being invalidate because project fc650e00ca5c409b8e88c0605f763feb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:54:18.299583 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-7d74b750-dae0-4deb-9b6e-fae53ff81507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:18.300525 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-7d74b750-dae0-4deb-9b6e-fae53ff81507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:18.308694 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ce576-44a7-4946-a2a7-5fecc1a14874 service cinder] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:18.310556 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1113/2223] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:54:18 2021] DELETE /identity/v3/projects/fc650e00ca5c409b8e88c0605f763feb => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:18.321670 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ce576-44a7-4946-a2a7-5fecc1a14874 service cinder] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:18.407301 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ba6cd-fb44-4a68-b266-cd560e3256e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:18.408362 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ba6cd-fb44-4a68-b266-cd560e3256e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:18.408706 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ba6cd-fb44-4a68-b266-cd560e3256e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:18.409053 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ba6cd-fb44-4a68-b266-cd560e3256e3 admin admin] PATH_INFO: `/v3/users/73d02b2b82be4e719d5ea83bc6cb7a71` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:18.410346 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ba6cd-fb44-4a68-b266-cd560e3256e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73d02b2b82be4e719d5ea83bc6cb7a71)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:18.438958 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ba6cd-fb44-4a68-b266-cd560e3256e3 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:18.500581 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4f6ba6cd-fb44-4a68-b266-cd560e3256e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73d02b2b82be4e719d5ea83bc6cb7a71'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:18.501495 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4f6ba6cd-fb44-4a68-b266-cd560e3256e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73d02b2b82be4e719d5ea83bc6cb7a71'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:18.511211 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4f6ba6cd-fb44-4a68-b266-cd560e3256e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73d02b2b82be4e719d5ea83bc6cb7a71'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:18.531536 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4f6ba6cd-fb44-4a68-b266-cd560e3256e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73d02b2b82be4e719d5ea83bc6cb7a71'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:18.540253 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4f6ba6cd-fb44-4a68-b266-cd560e3256e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73d02b2b82be4e719d5ea83bc6cb7a71'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:18.547113 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1111/2224] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:54:18 2021] DELETE /identity/v3/users/73d02b2b82be4e719d5ea83bc6cb7a71 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:18.923303 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74b750-dae0-4deb-9b6e-fae53ff81507 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:18.924656 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-7d74b750-dae0-4deb-9b6e-fae53ff81507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:18.937102 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74b750-dae0-4deb-9b6e-fae53ff81507 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:19.003087 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d46e20-431b-42d8-a471-12e80435ed7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:19.003865 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d46e20-431b-42d8-a471-12e80435ed7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:19.004156 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d46e20-431b-42d8-a471-12e80435ed7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:19.004439 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d46e20-431b-42d8-a471-12e80435ed7e admin admin] PATH_INFO: `/v3/projects/e5bc13e224704b228c1d720341332ece` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:19.005515 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d46e20-431b-42d8-a471-12e80435ed7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5bc13e224704b228c1d720341332ece)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:19.034673 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d46e20-431b-42d8-a471-12e80435ed7e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:19.089272 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-12d46e20-431b-42d8-a471-12e80435ed7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5bc13e224704b228c1d720341332ece', 'request_id': 'req-12d46e20-431b-42d8-a471-12e80435ed7e'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:19.096812 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-12d46e20-431b-42d8-a471-12e80435ed7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5bc13e224704b228c1d720341332ece', 'request_id': 'req-12d46e20-431b-42d8-a471-12e80435ed7e'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:19.108700 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-12d46e20-431b-42d8-a471-12e80435ed7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5bc13e224704b228c1d720341332ece', 'request_id': 'req-12d46e20-431b-42d8-a471-12e80435ed7e'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:19.118355 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-12d46e20-431b-42d8-a471-12e80435ed7e admin admin] The token cache is being invalidate because project e5bc13e224704b228c1d720341332ece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:54:19.118641 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-12d46e20-431b-42d8-a471-12e80435ed7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:19.119259 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-12d46e20-431b-42d8-a471-12e80435ed7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:19.121397 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1114/2225] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:54:18 2021] DELETE /identity/v3/projects/e5bc13e224704b228c1d720341332ece => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:19.126916 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84de22-f84c-4c9f-beaa-2c68b6619e6d None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:19.127219 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84de22-f84c-4c9f-beaa-2c68b6619e6d None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:19.127509 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84de22-f84c-4c9f-beaa-2c68b6619e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:19.149522 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-2d84de22-f84c-4c9f-beaa-2c68b6619e6d None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:19.150643 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-2d84de22-f84c-4c9f-beaa-2c68b6619e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:19.212765 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1112/2226] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:19.221744 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52739fd-5310-4ef5-a678-d5fa0716f760 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:19.222042 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52739fd-5310-4ef5-a678-d5fa0716f760 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:19.222325 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52739fd-5310-4ef5-a678-d5fa0716f760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:19.245456 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-c52739fd-5310-4ef5-a678-d5fa0716f760 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:19.246621 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c52739fd-5310-4ef5-a678-d5fa0716f760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:19.253666 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1115/2227] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:19.257879 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84de22-f84c-4c9f-beaa-2c68b6619e6d None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:19.267059 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84de22-f84c-4c9f-beaa-2c68b6619e6d None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:19.271193 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d89f4-eb43-4672-b7c5-39f07326bcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:19.271768 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d89f4-eb43-4672-b7c5-39f07326bcb8 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:19.272049 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d89f4-eb43-4672-b7c5-39f07326bcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:19.272356 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d89f4-eb43-4672-b7c5-39f07326bcb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:19.273040 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d89f4-eb43-4672-b7c5-39f07326bcb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:54:19.273352 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d89f4-eb43-4672-b7c5-39f07326bcb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:19.298969 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d89f4-eb43-4672-b7c5-39f07326bcb8 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:19.312462 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1113/2228] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:54:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:54:19.316821 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52739fd-5310-4ef5-a678-d5fa0716f760 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:19.326897 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52739fd-5310-4ef5-a678-d5fa0716f760 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:19.331185 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f447f01-be0a-441f-8895-5a82f1abe7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:19.331836 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f447f01-be0a-441f-8895-5a82f1abe7ab admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:19.332180 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f447f01-be0a-441f-8895-5a82f1abe7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:19.332525 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f447f01-be0a-441f-8895-5a82f1abe7ab admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:19.333231 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f447f01-be0a-441f-8895-5a82f1abe7ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:19.360507 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f447f01-be0a-441f-8895-5a82f1abe7ab admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:19.391172 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1116/2229] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:54:19 2021] POST /identity/v3/projects => generated 381 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:54:19.397011 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d89f4-eb43-4672-b7c5-39f07326bcb8 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:19.410325 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d89f4-eb43-4672-b7c5-39f07326bcb8 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:19.519811 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef778216-1d58-4151-be6d-cba3732bc5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:19.520467 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef778216-1d58-4151-be6d-cba3732bc5e1 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:19.520706 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef778216-1d58-4151-be6d-cba3732bc5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:19.520955 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef778216-1d58-4151-be6d-cba3732bc5e1 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:19.521616 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef778216-1d58-4151-be6d-cba3732bc5e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:19.547397 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef778216-1d58-4151-be6d-cba3732bc5e1 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:19.567691 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1114/2230] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:54:19 2021] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:54:19.571956 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f447f01-be0a-441f-8895-5a82f1abe7ab admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:19.582964 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f447f01-be0a-441f-8895-5a82f1abe7ab admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:19.587393 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0a005-bf2d-47e6-b929-383f05998fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:19.587991 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0a005-bf2d-47e6-b929-383f05998fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:19.588399 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0a005-bf2d-47e6-b929-383f05998fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:19.588919 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0a005-bf2d-47e6-b929-383f05998fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:19.589618 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0a005-bf2d-47e6-b929-383f05998fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:19.616136 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0a005-bf2d-47e6-b929-383f05998fd4 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:19.631806 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef778216-1d58-4151-be6d-cba3732bc5e1 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:19.632186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1117/2231] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:54:19 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:54:19.643586 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef778216-1d58-4151-be6d-cba3732bc5e1 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:19.647700 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483783a1-1de8-4ab9-9da0-b2c89b08f510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:19.648536 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483783a1-1de8-4ab9-9da0-b2c89b08f510 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:19.648812 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483783a1-1de8-4ab9-9da0-b2c89b08f510 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:19.649095 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483783a1-1de8-4ab9-9da0-b2c89b08f510 admin admin] PATH_INFO: `/v3/projects/ce47dcfa224949bebcb18a5eb06d3bdd/users/1f0fa4bcd0114c28baa7f5cdc631ddc1/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:19.681628 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483783a1-1de8-4ab9-9da0-b2c89b08f510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce47dcfa224949bebcb18a5eb06d3bdd, user_id=1f0fa4bcd0114c28baa7f5cdc631ddc1, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:19.714435 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483783a1-1de8-4ab9-9da0-b2c89b08f510 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:19.729841 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1115/2232] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:54:19 2021] PUT /identity/v3/projects/ce47dcfa224949bebcb18a5eb06d3bdd/users/1f0fa4bcd0114c28baa7f5cdc631ddc1/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:19.740378 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ca92f-a1b6-4c04-bb77-00d467d953c5 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:19.740854 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ca92f-a1b6-4c04-bb77-00d467d953c5 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:19.741354 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ca92f-a1b6-4c04-bb77-00d467d953c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:19.782956 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-e04ca92f-a1b6-4c04-bb77-00d467d953c5 None None] MFA Rules not processed for user `1f0fa4bcd0114c28baa7f5cdc631ddc1`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:19.785060 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-e04ca92f-a1b6-4c04-bb77-00d467d953c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:19.859283 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1118/2233] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:19 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:19.863914 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483783a1-1de8-4ab9-9da0-b2c89b08f510 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:19.932335 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483783a1-1de8-4ab9-9da0-b2c89b08f510 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:19.936657 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622b839-92e5-4f57-b00b-b3cb1d2e84fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:19.937239 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622b839-92e5-4f57-b00b-b3cb1d2e84fd admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:19.937528 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622b839-92e5-4f57-b00b-b3cb1d2e84fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:19.937838 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622b839-92e5-4f57-b00b-b3cb1d2e84fd admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:19.938482 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622b839-92e5-4f57-b00b-b3cb1d2e84fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:19.967631 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622b839-92e5-4f57-b00b-b3cb1d2e84fd admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:19.999449 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1116/2234] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:54:19 2021] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:54:20.003623 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ca92f-a1b6-4c04-bb77-00d467d953c5 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:20.014993 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ca92f-a1b6-4c04-bb77-00d467d953c5 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:20.079139 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f965495-830a-4c0c-b7fe-131ef84e4b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:20.079738 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f965495-830a-4c0c-b7fe-131ef84e4b4a admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:20.080014 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f965495-830a-4c0c-b7fe-131ef84e4b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:20.080292 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f965495-830a-4c0c-b7fe-131ef84e4b4a admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:20.080925 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f965495-830a-4c0c-b7fe-131ef84e4b4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:20.106923 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f965495-830a-4c0c-b7fe-131ef84e4b4a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:20.127676 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1119/2235] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:54:20 2021] POST /identity/v3/users => generated 298 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:54:20.131633 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622b839-92e5-4f57-b00b-b3cb1d2e84fd admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:20.142109 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622b839-92e5-4f57-b00b-b3cb1d2e84fd admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:20.146302 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706f5ce-4d7b-4983-b902-d5bca3c8830d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:20.146927 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706f5ce-4d7b-4983-b902-d5bca3c8830d admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:20.147220 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706f5ce-4d7b-4983-b902-d5bca3c8830d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:20.147507 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706f5ce-4d7b-4983-b902-d5bca3c8830d admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:20.148353 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706f5ce-4d7b-4983-b902-d5bca3c8830d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:20.177082 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706f5ce-4d7b-4983-b902-d5bca3c8830d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:20.190617 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1117/2236] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:54:20 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:54:20.195029 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f965495-830a-4c0c-b7fe-131ef84e4b4a admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:20.204760 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f965495-830a-4c0c-b7fe-131ef84e4b4a admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:20.209174 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab1800-9b9b-48bb-9f4d-aa95ad47af83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:20.209983 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab1800-9b9b-48bb-9f4d-aa95ad47af83 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:20.210272 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab1800-9b9b-48bb-9f4d-aa95ad47af83 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:20.210552 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab1800-9b9b-48bb-9f4d-aa95ad47af83 admin admin] PATH_INFO: `/v3/projects/c4adb7be05c1496789d990175fadf532/users/b905543ada1e41428dc71e170753fc64/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:20.231527 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab1800-9b9b-48bb-9f4d-aa95ad47af83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4adb7be05c1496789d990175fadf532, user_id=b905543ada1e41428dc71e170753fc64, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:20.258074 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab1800-9b9b-48bb-9f4d-aa95ad47af83 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:20.271256 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1120/2237] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:54:20 2021] PUT /identity/v3/projects/c4adb7be05c1496789d990175fadf532/users/b905543ada1e41428dc71e170753fc64/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:20.275355 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706f5ce-4d7b-4983-b902-d5bca3c8830d admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:20.284918 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706f5ce-4d7b-4983-b902-d5bca3c8830d admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:20.349581 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a64b7f-261a-46c3-a297-52d8f5dfdaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:20.350466 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a64b7f-261a-46c3-a297-52d8f5dfdaf6 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:20.350783 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a64b7f-261a-46c3-a297-52d8f5dfdaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:20.351080 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a64b7f-261a-46c3-a297-52d8f5dfdaf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:20.351763 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a64b7f-261a-46c3-a297-52d8f5dfdaf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:20.377473 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a64b7f-261a-46c3-a297-52d8f5dfdaf6 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:20.388141 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1118/2238] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:54:20 2021] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:54:20.392241 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab1800-9b9b-48bb-9f4d-aa95ad47af83 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:20.402191 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab1800-9b9b-48bb-9f4d-aa95ad47af83 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:20.406744 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b125a2-cd00-4eac-a9e0-0e3f12a795e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:20.407548 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b125a2-cd00-4eac-a9e0-0e3f12a795e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:20.407834 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b125a2-cd00-4eac-a9e0-0e3f12a795e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:20.408112 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b125a2-cd00-4eac-a9e0-0e3f12a795e0 admin admin] PATH_INFO: `/v3/projects/c4adb7be05c1496789d990175fadf532/users/b905543ada1e41428dc71e170753fc64/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:20.410179 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b125a2-cd00-4eac-a9e0-0e3f12a795e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4adb7be05c1496789d990175fadf532, user_id=b905543ada1e41428dc71e170753fc64, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:20.437728 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b125a2-cd00-4eac-a9e0-0e3f12a795e0 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:20.449924 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1121/2239] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:54:20 2021] PUT /identity/v3/projects/c4adb7be05c1496789d990175fadf532/users/b905543ada1e41428dc71e170753fc64/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:20.453961 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a64b7f-261a-46c3-a297-52d8f5dfdaf6 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:20.464490 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a64b7f-261a-46c3-a297-52d8f5dfdaf6 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:20.532379 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f5b50-431f-48fb-b269-f4ee80f969da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:20.533114 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f5b50-431f-48fb-b269-f4ee80f969da admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:20.533411 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f5b50-431f-48fb-b269-f4ee80f969da admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:20.533728 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f5b50-431f-48fb-b269-f4ee80f969da admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:20.534626 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f5b50-431f-48fb-b269-f4ee80f969da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:20.553196 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863b593-d30d-43d5-bc96-b92fc03eb39b None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:20.553492 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863b593-d30d-43d5-bc96-b92fc03eb39b None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:20.553778 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863b593-d30d-43d5-bc96-b92fc03eb39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:20.562903 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f5b50-431f-48fb-b269-f4ee80f969da admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:20.577757 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1119/2240] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:54:20 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:54:20.581725 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f5b50-431f-48fb-b269-f4ee80f969da admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:20.583231 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-4863b593-d30d-43d5-bc96-b92fc03eb39b None None] MFA Rules not processed for user `4c912c35829146279177ce1e320d346a`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:20.584386 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-4863b593-d30d-43d5-bc96-b92fc03eb39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:20.593057 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f5b50-431f-48fb-b269-f4ee80f969da admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:20.601837 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e126d09-31fb-4f17-86a3-5fd456a12614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:20.603431 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e126d09-31fb-4f17-86a3-5fd456a12614 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:20.604376 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e126d09-31fb-4f17-86a3-5fd456a12614 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:20.605265 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e126d09-31fb-4f17-86a3-5fd456a12614 admin admin] PATH_INFO: `/v3/projects/c4adb7be05c1496789d990175fadf532/users/b905543ada1e41428dc71e170753fc64/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:20.607693 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e126d09-31fb-4f17-86a3-5fd456a12614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4adb7be05c1496789d990175fadf532, user_id=b905543ada1e41428dc71e170753fc64, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:20.639581 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e126d09-31fb-4f17-86a3-5fd456a12614 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:20.651161 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1122/2241] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:20 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:54:20.658549 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1120/2242] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:54:20 2021] PUT /identity/v3/projects/c4adb7be05c1496789d990175fadf532/users/b905543ada1e41428dc71e170753fc64/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:54:20.670338 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5cdf2-9261-49c7-a654-128dfc98ab6f None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:20.670643 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5cdf2-9261-49c7-a654-128dfc98ab6f None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:20.671110 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5cdf2-9261-49c7-a654-128dfc98ab6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:20.709735 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-add5cdf2-9261-49c7-a654-128dfc98ab6f None None] MFA Rules not processed for user `b905543ada1e41428dc71e170753fc64`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:20.710921 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-add5cdf2-9261-49c7-a654-128dfc98ab6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:20.821600 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1123/2243] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:20 2021] POST /identity/v3/auth/tokens => generated 3757 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:20.831982 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e126d09-31fb-4f17-86a3-5fd456a12614 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:20.833612 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-5e126d09-31fb-4f17-86a3-5fd456a12614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:20.910569 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e126d09-31fb-4f17-86a3-5fd456a12614 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:20.914626 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f1f9b-0400-4917-9f25-6d7b315d219b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:20.915741 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f1f9b-0400-4917-9f25-6d7b315d219b service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:20.916027 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f1f9b-0400-4917-9f25-6d7b315d219b service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:20.916453 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f1f9b-0400-4917-9f25-6d7b315d219b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:20.925956 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f1f9b-0400-4917-9f25-6d7b315d219b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:20.953148 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f1f9b-0400-4917-9f25-6d7b315d219b service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:20.963655 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1121/2244] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:54:20 2021] GET /identity/v3/auth/tokens => generated 3757 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:54:21.077691 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5cdf2-9261-49c7-a654-128dfc98ab6f None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:21.089729 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5cdf2-9261-49c7-a654-128dfc98ab6f None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:21.094785 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfaba3c-7432-4b2d-9d26-d9b2ab006dbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:21.095595 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfaba3c-7432-4b2d-9d26-d9b2ab006dbc service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:21.096223 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfaba3c-7432-4b2d-9d26-d9b2ab006dbc service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:21.096911 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfaba3c-7432-4b2d-9d26-d9b2ab006dbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:21.199392 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfaba3c-7432-4b2d-9d26-d9b2ab006dbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:21.238133 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfaba3c-7432-4b2d-9d26-d9b2ab006dbc service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:21.248514 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1124/2245] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:54:21 2021] GET /identity/v3/auth/tokens => generated 3688 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:54:21.496692 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704db8a5-1c10-42c2-b879-eb13a8cd5eea None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:21.497106 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704db8a5-1c10-42c2-b879-eb13a8cd5eea None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:21.497460 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704db8a5-1c10-42c2-b879-eb13a8cd5eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:21.522695 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-704db8a5-1c10-42c2-b879-eb13a8cd5eea None None] MFA Rules not processed for user `e8cf467bd7664df4a7f9d8c45f12a1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:21.524263 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-704db8a5-1c10-42c2-b879-eb13a8cd5eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:21.641131 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1122/2246] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:21 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:21.731947 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfaba3c-7432-4b2d-9d26-d9b2ab006dbc service cinder] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:21.843256 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfaba3c-7432-4b2d-9d26-d9b2ab006dbc service cinder] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:21.848357 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d091e-556e-4c8d-96f2-46aa6d002be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:21.849206 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d091e-556e-4c8d-96f2-46aa6d002be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:21.849629 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d091e-556e-4c8d-96f2-46aa6d002be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:21.849967 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d091e-556e-4c8d-96f2-46aa6d002be7 admin admin] PATH_INFO: `/v3/users/1f0fa4bcd0114c28baa7f5cdc631ddc1` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:21.851316 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d091e-556e-4c8d-96f2-46aa6d002be7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f0fa4bcd0114c28baa7f5cdc631ddc1)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:21.883291 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d091e-556e-4c8d-96f2-46aa6d002be7 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:21.974160 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-454d091e-556e-4c8d-96f2-46aa6d002be7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f0fa4bcd0114c28baa7f5cdc631ddc1'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:21.991568 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-454d091e-556e-4c8d-96f2-46aa6d002be7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f0fa4bcd0114c28baa7f5cdc631ddc1'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:21.992548 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-454d091e-556e-4c8d-96f2-46aa6d002be7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f0fa4bcd0114c28baa7f5cdc631ddc1'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:22.001279 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-454d091e-556e-4c8d-96f2-46aa6d002be7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f0fa4bcd0114c28baa7f5cdc631ddc1'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:22.013081 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-454d091e-556e-4c8d-96f2-46aa6d002be7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f0fa4bcd0114c28baa7f5cdc631ddc1'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:22.019722 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1125/2247] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:54:21 2021] DELETE /identity/v3/users/1f0fa4bcd0114c28baa7f5cdc631ddc1 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:22.024364 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9add3-eb36-4c41-b1c8-63214745d506 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:22.024679 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9add3-eb36-4c41-b1c8-63214745d506 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:22.024959 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9add3-eb36-4c41-b1c8-63214745d506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:22.050893 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-fca9add3-eb36-4c41-b1c8-63214745d506 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:22.052305 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-fca9add3-eb36-4c41-b1c8-63214745d506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:22.137682 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1123/2248] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:22.154297 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d091e-556e-4c8d-96f2-46aa6d002be7 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:22.155664 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-454d091e-556e-4c8d-96f2-46aa6d002be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:22.248374 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d091e-556e-4c8d-96f2-46aa6d002be7 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:22.251893 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cadcd-ecf9-43a0-a846-cceb19843a9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:22.252471 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cadcd-ecf9-43a0-a846-cceb19843a9f service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:22.252756 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cadcd-ecf9-43a0-a846-cceb19843a9f service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:22.253033 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cadcd-ecf9-43a0-a846-cceb19843a9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:22.263790 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cadcd-ecf9-43a0-a846-cceb19843a9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:22.290537 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cadcd-ecf9-43a0-a846-cceb19843a9f service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:22.302323 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1126/2249] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:54:22 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:54:23.033217 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9add3-eb36-4c41-b1c8-63214745d506 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:23.042531 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-fca9add3-eb36-4c41-b1c8-63214745d506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:23.056224 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9add3-eb36-4c41-b1c8-63214745d506 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:23.061805 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50263d-de26-46cc-a751-39345bdfe536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:23.062727 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50263d-de26-46cc-a751-39345bdfe536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:23.063352 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50263d-de26-46cc-a751-39345bdfe536 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:23.063636 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50263d-de26-46cc-a751-39345bdfe536 admin admin] PATH_INFO: `/v3/projects/ce47dcfa224949bebcb18a5eb06d3bdd` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:23.064725 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50263d-de26-46cc-a751-39345bdfe536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce47dcfa224949bebcb18a5eb06d3bdd)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:23.091582 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50263d-de26-46cc-a751-39345bdfe536 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:23.143269 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4a50263d-de26-46cc-a751-39345bdfe536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce47dcfa224949bebcb18a5eb06d3bdd', 'request_id': 'req-4a50263d-de26-46cc-a751-39345bdfe536'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:23.150339 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4a50263d-de26-46cc-a751-39345bdfe536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce47dcfa224949bebcb18a5eb06d3bdd', 'request_id': 'req-4a50263d-de26-46cc-a751-39345bdfe536'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:23.155839 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4a50263d-de26-46cc-a751-39345bdfe536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce47dcfa224949bebcb18a5eb06d3bdd', 'request_id': 'req-4a50263d-de26-46cc-a751-39345bdfe536'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:23.171532 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4a50263d-de26-46cc-a751-39345bdfe536 admin admin] The token cache is being invalidate because project ce47dcfa224949bebcb18a5eb06d3bdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:54:23.171814 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4a50263d-de26-46cc-a751-39345bdfe536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:23.172397 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4a50263d-de26-46cc-a751-39345bdfe536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:23.173778 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1124/2250] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:54:23 2021] DELETE /identity/v3/projects/ce47dcfa224949bebcb18a5eb06d3bdd => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:23.177747 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cadcd-ecf9-43a0-a846-cceb19843a9f service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:23.187912 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cadcd-ecf9-43a0-a846-cceb19843a9f service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:23.256960 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e731c-953c-4907-9208-76e5a313399c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:23.257761 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e731c-953c-4907-9208-76e5a313399c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:23.258079 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e731c-953c-4907-9208-76e5a313399c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:23.258361 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e731c-953c-4907-9208-76e5a313399c admin admin] PATH_INFO: `/v3/users/b905543ada1e41428dc71e170753fc64` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:23.259840 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e731c-953c-4907-9208-76e5a313399c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b905543ada1e41428dc71e170753fc64)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:23.286301 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e731c-953c-4907-9208-76e5a313399c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:23.339523 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-6e8e731c-953c-4907-9208-76e5a313399c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b905543ada1e41428dc71e170753fc64'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:23.351789 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-6e8e731c-953c-4907-9208-76e5a313399c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b905543ada1e41428dc71e170753fc64'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:23.352482 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-6e8e731c-953c-4907-9208-76e5a313399c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b905543ada1e41428dc71e170753fc64'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:23.362173 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-6e8e731c-953c-4907-9208-76e5a313399c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b905543ada1e41428dc71e170753fc64'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:23.371571 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-6e8e731c-953c-4907-9208-76e5a313399c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b905543ada1e41428dc71e170753fc64'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:23.379399 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1127/2251] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:54:23 2021] DELETE /identity/v3/users/b905543ada1e41428dc71e170753fc64 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:24.068760 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50263d-de26-46cc-a751-39345bdfe536 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:24.070699 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-4a50263d-de26-46cc-a751-39345bdfe536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:24.083571 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50263d-de26-46cc-a751-39345bdfe536 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:24.161917 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fef8f-7c7a-4a64-acf2-24a52aafd4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:24.163148 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fef8f-7c7a-4a64-acf2-24a52aafd4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:24.163510 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fef8f-7c7a-4a64-acf2-24a52aafd4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:24.163862 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fef8f-7c7a-4a64-acf2-24a52aafd4bd admin admin] PATH_INFO: `/v3/projects/c4adb7be05c1496789d990175fadf532` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:24.165550 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fef8f-7c7a-4a64-acf2-24a52aafd4bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4adb7be05c1496789d990175fadf532)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:24.195891 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fef8f-7c7a-4a64-acf2-24a52aafd4bd admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:24.249319 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-667fef8f-7c7a-4a64-acf2-24a52aafd4bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4adb7be05c1496789d990175fadf532', 'request_id': 'req-667fef8f-7c7a-4a64-acf2-24a52aafd4bd'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:24.257531 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-667fef8f-7c7a-4a64-acf2-24a52aafd4bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4adb7be05c1496789d990175fadf532', 'request_id': 'req-667fef8f-7c7a-4a64-acf2-24a52aafd4bd'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:24.263971 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-667fef8f-7c7a-4a64-acf2-24a52aafd4bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4adb7be05c1496789d990175fadf532', 'request_id': 'req-667fef8f-7c7a-4a64-acf2-24a52aafd4bd'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:24.282038 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-667fef8f-7c7a-4a64-acf2-24a52aafd4bd admin admin] The token cache is being invalidate because project c4adb7be05c1496789d990175fadf532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:54:24.282328 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-667fef8f-7c7a-4a64-acf2-24a52aafd4bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:24.282980 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-667fef8f-7c7a-4a64-acf2-24a52aafd4bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:24.284629 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1125/2252] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:54:24 2021] DELETE /identity/v3/projects/c4adb7be05c1496789d990175fadf532 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:24.292573 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc0920-cd34-4d08-95ea-6905fc685aef None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:24.293170 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc0920-cd34-4d08-95ea-6905fc685aef None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:24.293170 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc0920-cd34-4d08-95ea-6905fc685aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:24.316052 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-c1bc0920-cd34-4d08-95ea-6905fc685aef None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:24.317461 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c1bc0920-cd34-4d08-95ea-6905fc685aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:24.387593 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1128/2253] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:24.394951 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d876d32-d0ee-44d2-85b5-4ca0d2df60a1 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:24.395294 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d876d32-d0ee-44d2-85b5-4ca0d2df60a1 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:24.396314 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d876d32-d0ee-44d2-85b5-4ca0d2df60a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:24.423023 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-0d876d32-d0ee-44d2-85b5-4ca0d2df60a1 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:24.424635 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-0d876d32-d0ee-44d2-85b5-4ca0d2df60a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:24.432635 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1126/2254] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:24.436830 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc0920-cd34-4d08-95ea-6905fc685aef None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:24.452369 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc0920-cd34-4d08-95ea-6905fc685aef None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:24.468063 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7be9e9-a451-45bb-9174-032e37b13bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:24.469073 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7be9e9-a451-45bb-9174-032e37b13bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:24.469438 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7be9e9-a451-45bb-9174-032e37b13bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:24.469723 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7be9e9-a451-45bb-9174-032e37b13bd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:24.470901 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7be9e9-a451-45bb-9174-032e37b13bd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:54:24.471363 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7be9e9-a451-45bb-9174-032e37b13bd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:24.508515 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7be9e9-a451-45bb-9174-032e37b13bd9 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:24.524795 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1129/2255] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:54:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:54:24.529025 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d876d32-d0ee-44d2-85b5-4ca0d2df60a1 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:24.538419 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d876d32-d0ee-44d2-85b5-4ca0d2df60a1 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:24.544019 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1c79e-3e9d-4dcb-9dff-cf668111e6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:24.544750 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1c79e-3e9d-4dcb-9dff-cf668111e6cf admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:24.545039 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1c79e-3e9d-4dcb-9dff-cf668111e6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:24.545324 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1c79e-3e9d-4dcb-9dff-cf668111e6cf admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:24.546016 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1c79e-3e9d-4dcb-9dff-cf668111e6cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:24.575138 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1c79e-3e9d-4dcb-9dff-cf668111e6cf admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:24.613070 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7be9e9-a451-45bb-9174-032e37b13bd9 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:24.618273 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1127/2256] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:54:24 2021] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:54:24.628555 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7be9e9-a451-45bb-9174-032e37b13bd9 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:24.702581 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d17c01-b966-470f-91ff-2dbef5db8925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:24.704062 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d17c01-b966-470f-91ff-2dbef5db8925 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:24.704401 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d17c01-b966-470f-91ff-2dbef5db8925 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:24.705302 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d17c01-b966-470f-91ff-2dbef5db8925 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:24.705955 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d17c01-b966-470f-91ff-2dbef5db8925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:24.735979 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d17c01-b966-470f-91ff-2dbef5db8925 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:24.761515 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1130/2257] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:54:24 2021] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:54:24.762887 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1c79e-3e9d-4dcb-9dff-cf668111e6cf admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:24.773115 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1c79e-3e9d-4dcb-9dff-cf668111e6cf admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:24.777785 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f24133-3184-4eb3-9680-51769068d7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:24.778485 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f24133-3184-4eb3-9680-51769068d7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:24.778840 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f24133-3184-4eb3-9680-51769068d7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:24.779175 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f24133-3184-4eb3-9680-51769068d7d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:24.779890 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f24133-3184-4eb3-9680-51769068d7d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:24.806115 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f24133-3184-4eb3-9680-51769068d7d2 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:24.820763 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1128/2258] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:54:24 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:54:24.822130 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d17c01-b966-470f-91ff-2dbef5db8925 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:24.838312 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d17c01-b966-470f-91ff-2dbef5db8925 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:24.844859 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a626633-3e96-4d91-96cd-9b042b3e9c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:24.845837 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a626633-3e96-4d91-96cd-9b042b3e9c9e admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:24.846220 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a626633-3e96-4d91-96cd-9b042b3e9c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:24.846689 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a626633-3e96-4d91-96cd-9b042b3e9c9e admin admin] PATH_INFO: `/v3/projects/8ef0a02b83d548c38f3f44d4dcbb458e/users/deb95a4360d9457a8988c3b354ae2117/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:24.867163 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a626633-3e96-4d91-96cd-9b042b3e9c9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ef0a02b83d548c38f3f44d4dcbb458e, user_id=deb95a4360d9457a8988c3b354ae2117, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:24.895424 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a626633-3e96-4d91-96cd-9b042b3e9c9e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:24.927452 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1131/2259] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:54:24 2021] PUT /identity/v3/projects/8ef0a02b83d548c38f3f44d4dcbb458e/users/deb95a4360d9457a8988c3b354ae2117/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:24.933662 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96871568-1920-4381-b993-390ea01d9d42 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:24.936329 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96871568-1920-4381-b993-390ea01d9d42 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:24.936756 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96871568-1920-4381-b993-390ea01d9d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:25.007776 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-96871568-1920-4381-b993-390ea01d9d42 None None] MFA Rules not processed for user `deb95a4360d9457a8988c3b354ae2117`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:25.010929 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-96871568-1920-4381-b993-390ea01d9d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:25.114975 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1129/2260] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:24 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:54:25.124909 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a626633-3e96-4d91-96cd-9b042b3e9c9e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:25.126611 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-4a626633-3e96-4d91-96cd-9b042b3e9c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:25.208113 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a626633-3e96-4d91-96cd-9b042b3e9c9e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:25.212145 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f8304-c22a-4734-a576-ade7a2502061 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:25.212946 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f8304-c22a-4734-a576-ade7a2502061 service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:25.213691 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f8304-c22a-4734-a576-ade7a2502061 service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:25.213916 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f8304-c22a-4734-a576-ade7a2502061 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:25.225965 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f8304-c22a-4734-a576-ade7a2502061 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:25.257767 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f8304-c22a-4734-a576-ade7a2502061 service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:25.275454 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1132/2261] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:54:25 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:54:25.343449 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96871568-1920-4381-b993-390ea01d9d42 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:25.517210 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96871568-1920-4381-b993-390ea01d9d42 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:25.528039 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92753ba8-8b98-421c-b23b-174b71791447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:25.530824 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92753ba8-8b98-421c-b23b-174b71791447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:25.531946 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92753ba8-8b98-421c-b23b-174b71791447 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:25.533003 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92753ba8-8b98-421c-b23b-174b71791447 admin admin] PATH_INFO: `/v3/users/deb95a4360d9457a8988c3b354ae2117` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:25.534649 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92753ba8-8b98-421c-b23b-174b71791447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deb95a4360d9457a8988c3b354ae2117)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:25.601846 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92753ba8-8b98-421c-b23b-174b71791447 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:25.725207 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-92753ba8-8b98-421c-b23b-174b71791447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deb95a4360d9457a8988c3b354ae2117'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:25.726122 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-92753ba8-8b98-421c-b23b-174b71791447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deb95a4360d9457a8988c3b354ae2117'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:25.746481 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-92753ba8-8b98-421c-b23b-174b71791447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deb95a4360d9457a8988c3b354ae2117'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:25.760536 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-92753ba8-8b98-421c-b23b-174b71791447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deb95a4360d9457a8988c3b354ae2117'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:25.771464 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-92753ba8-8b98-421c-b23b-174b71791447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deb95a4360d9457a8988c3b354ae2117'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:25.784425 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1130/2262] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:54:25 2021] DELETE /identity/v3/users/deb95a4360d9457a8988c3b354ae2117 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:25.786383 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6bac7-be98-40d2-a4e1-34745e5f637f None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:25.787269 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6bac7-be98-40d2-a4e1-34745e5f637f None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:25.787825 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6bac7-be98-40d2-a4e1-34745e5f637f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:25.837355 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-34d6bac7-be98-40d2-a4e1-34745e5f637f None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:25.839770 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-34d6bac7-be98-40d2-a4e1-34745e5f637f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:25.927374 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1133/2263] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:54:25.939969 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92753ba8-8b98-421c-b23b-174b71791447 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:25.941557 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-92753ba8-8b98-421c-b23b-174b71791447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:26.014099 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92753ba8-8b98-421c-b23b-174b71791447 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:26.021612 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba9f8a-0a6b-4581-91f9-03e098d8bbd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:26.022358 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba9f8a-0a6b-4581-91f9-03e098d8bbd9 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:26.023383 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba9f8a-0a6b-4581-91f9-03e098d8bbd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:26.023383 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba9f8a-0a6b-4581-91f9-03e098d8bbd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:26.037462 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba9f8a-0a6b-4581-91f9-03e098d8bbd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:26.067153 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba9f8a-0a6b-4581-91f9-03e098d8bbd9 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:26.080027 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1131/2264] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:54:25 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:54:26.648456 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6bac7-be98-40d2-a4e1-34745e5f637f None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:26.649835 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-34d6bac7-be98-40d2-a4e1-34745e5f637f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:26.672595 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6bac7-be98-40d2-a4e1-34745e5f637f None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:26.681971 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b591f2-64c9-4022-9b7d-5b5200e61b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:26.683102 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b591f2-64c9-4022-9b7d-5b5200e61b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:26.683635 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b591f2-64c9-4022-9b7d-5b5200e61b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:26.684119 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b591f2-64c9-4022-9b7d-5b5200e61b79 admin admin] PATH_INFO: `/v3/projects/8ef0a02b83d548c38f3f44d4dcbb458e` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:26.687183 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b591f2-64c9-4022-9b7d-5b5200e61b79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ef0a02b83d548c38f3f44d4dcbb458e)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:26.747341 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b591f2-64c9-4022-9b7d-5b5200e61b79 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:26.818530 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-85b591f2-64c9-4022-9b7d-5b5200e61b79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ef0a02b83d548c38f3f44d4dcbb458e', 'request_id': 'req-85b591f2-64c9-4022-9b7d-5b5200e61b79'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:26.836484 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-85b591f2-64c9-4022-9b7d-5b5200e61b79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ef0a02b83d548c38f3f44d4dcbb458e', 'request_id': 'req-85b591f2-64c9-4022-9b7d-5b5200e61b79'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:26.862022 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-85b591f2-64c9-4022-9b7d-5b5200e61b79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ef0a02b83d548c38f3f44d4dcbb458e', 'request_id': 'req-85b591f2-64c9-4022-9b7d-5b5200e61b79'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:26.898845 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-85b591f2-64c9-4022-9b7d-5b5200e61b79 admin admin] The token cache is being invalidate because project 8ef0a02b83d548c38f3f44d4dcbb458e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:54:26.899163 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-85b591f2-64c9-4022-9b7d-5b5200e61b79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:26.901189 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-85b591f2-64c9-4022-9b7d-5b5200e61b79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:26.905829 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1134/2265] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:54:26 2021] DELETE /identity/v3/projects/8ef0a02b83d548c38f3f44d4dcbb458e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:26.911793 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed477562-737d-4449-83c8-848888b5d1d2 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:26.912580 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed477562-737d-4449-83c8-848888b5d1d2 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:26.912845 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed477562-737d-4449-83c8-848888b5d1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:26.943939 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-ed477562-737d-4449-83c8-848888b5d1d2 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:26.945702 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-ed477562-737d-4449-83c8-848888b5d1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:27.051469 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1132/2266] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:27.055531 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0052af-40db-42bf-8779-33d3b0157642 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:27.056016 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0052af-40db-42bf-8779-33d3b0157642 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:27.056497 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0052af-40db-42bf-8779-33d3b0157642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:27.086266 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-6c0052af-40db-42bf-8779-33d3b0157642 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:27.088391 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-6c0052af-40db-42bf-8779-33d3b0157642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:27.097194 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1135/2267] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:27.101394 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed477562-737d-4449-83c8-848888b5d1d2 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:27.114141 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed477562-737d-4449-83c8-848888b5d1d2 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:27.121721 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd2a59-ed11-4867-acfd-ff59970f70d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:27.122592 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd2a59-ed11-4867-acfd-ff59970f70d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:27.123083 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd2a59-ed11-4867-acfd-ff59970f70d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:27.123653 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd2a59-ed11-4867-acfd-ff59970f70d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:27.124802 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd2a59-ed11-4867-acfd-ff59970f70d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:54:27.125376 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd2a59-ed11-4867-acfd-ff59970f70d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:27.156371 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd2a59-ed11-4867-acfd-ff59970f70d9 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:27.179369 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0052af-40db-42bf-8779-33d3b0157642 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:27.186895 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1133/2268] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:54:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:54:27.190538 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0052af-40db-42bf-8779-33d3b0157642 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:27.244706 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a28626-4585-47b3-9917-a13aa8ebe78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:27.264046 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a28626-4585-47b3-9917-a13aa8ebe78a admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:27.264808 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a28626-4585-47b3-9917-a13aa8ebe78a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:27.265374 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a28626-4585-47b3-9917-a13aa8ebe78a admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:27.266224 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a28626-4585-47b3-9917-a13aa8ebe78a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:27.303452 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a28626-4585-47b3-9917-a13aa8ebe78a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:27.342163 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1136/2269] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:54:27 2021] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:54:27.346027 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd2a59-ed11-4867-acfd-ff59970f70d9 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:27.360707 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd2a59-ed11-4867-acfd-ff59970f70d9 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:27.443749 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665eabeb-d3d0-4454-a85f-2d227aa8e542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:27.444615 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665eabeb-d3d0-4454-a85f-2d227aa8e542 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:27.444902 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665eabeb-d3d0-4454-a85f-2d227aa8e542 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:27.445181 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665eabeb-d3d0-4454-a85f-2d227aa8e542 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:27.445940 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665eabeb-d3d0-4454-a85f-2d227aa8e542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:27.476978 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665eabeb-d3d0-4454-a85f-2d227aa8e542 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:27.522282 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1134/2270] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:54:27 2021] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:54:27.527014 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a28626-4585-47b3-9917-a13aa8ebe78a admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:27.540465 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a28626-4585-47b3-9917-a13aa8ebe78a admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:27.547248 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39d3ad-4b4d-4edb-827b-a69bb6646a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:27.549311 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39d3ad-4b4d-4edb-827b-a69bb6646a8b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:27.549705 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39d3ad-4b4d-4edb-827b-a69bb6646a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:27.550122 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39d3ad-4b4d-4edb-827b-a69bb6646a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:27.551212 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39d3ad-4b4d-4edb-827b-a69bb6646a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:27.593059 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39d3ad-4b4d-4edb-827b-a69bb6646a8b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:27.607624 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1137/2271] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:54:27 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:54:27.611921 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665eabeb-d3d0-4454-a85f-2d227aa8e542 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:27.627261 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665eabeb-d3d0-4454-a85f-2d227aa8e542 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:27.634367 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62e420-131e-4908-a1b8-eaaf77d4ea51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:27.635487 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62e420-131e-4908-a1b8-eaaf77d4ea51 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:27.635837 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62e420-131e-4908-a1b8-eaaf77d4ea51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:27.637293 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62e420-131e-4908-a1b8-eaaf77d4ea51 admin admin] PATH_INFO: `/v3/projects/1a0c3e5026514cd1b7caebf6ffd1933a/users/2cb971df907749619993cd62801f05b7/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:27.706318 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62e420-131e-4908-a1b8-eaaf77d4ea51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a0c3e5026514cd1b7caebf6ffd1933a, user_id=2cb971df907749619993cd62801f05b7, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:27.776891 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62e420-131e-4908-a1b8-eaaf77d4ea51 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:27.803431 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1135/2272] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:54:27 2021] PUT /identity/v3/projects/1a0c3e5026514cd1b7caebf6ffd1933a/users/2cb971df907749619993cd62801f05b7/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:27.815406 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9094129-e57a-4ef8-94b3-72a6c055c6be None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:27.816092 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9094129-e57a-4ef8-94b3-72a6c055c6be None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:27.816654 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9094129-e57a-4ef8-94b3-72a6c055c6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:27.928084 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-f9094129-e57a-4ef8-94b3-72a6c055c6be None None] MFA Rules not processed for user `2cb971df907749619993cd62801f05b7`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:27.929416 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-f9094129-e57a-4ef8-94b3-72a6c055c6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:28.081581 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1138/2273] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:27 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:54:28.085607 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62e420-131e-4908-a1b8-eaaf77d4ea51 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:28.171485 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62e420-131e-4908-a1b8-eaaf77d4ea51 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:28.176613 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc64a8f-6685-4bf1-a5ae-417cc36c3325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:28.177552 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc64a8f-6685-4bf1-a5ae-417cc36c3325 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:28.178064 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc64a8f-6685-4bf1-a5ae-417cc36c3325 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:28.178569 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc64a8f-6685-4bf1-a5ae-417cc36c3325 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:28.179962 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc64a8f-6685-4bf1-a5ae-417cc36c3325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:28.211178 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc64a8f-6685-4bf1-a5ae-417cc36c3325 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:28.277904 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1136/2274] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:54:28 2021] POST /identity/v3/projects => generated 383 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:54:28.281891 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9094129-e57a-4ef8-94b3-72a6c055c6be None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:28.301054 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9094129-e57a-4ef8-94b3-72a6c055c6be None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:28.453355 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a08610-f89b-428c-b11c-d3c90ab26d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:28.454106 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a08610-f89b-428c-b11c-d3c90ab26d3d admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:28.455028 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a08610-f89b-428c-b11c-d3c90ab26d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:28.455317 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a08610-f89b-428c-b11c-d3c90ab26d3d admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:28.456141 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a08610-f89b-428c-b11c-d3c90ab26d3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:28.491795 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a08610-f89b-428c-b11c-d3c90ab26d3d admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:28.520474 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1139/2275] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:54:28 2021] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:54:28.524399 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc64a8f-6685-4bf1-a5ae-417cc36c3325 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:28.539809 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc64a8f-6685-4bf1-a5ae-417cc36c3325 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:28.552213 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6173b7f-1eda-49c1-8386-e237cf5319dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:28.556292 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6173b7f-1eda-49c1-8386-e237cf5319dc admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:28.556725 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6173b7f-1eda-49c1-8386-e237cf5319dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:28.559021 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6173b7f-1eda-49c1-8386-e237cf5319dc admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:28.559689 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6173b7f-1eda-49c1-8386-e237cf5319dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:28.607258 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6173b7f-1eda-49c1-8386-e237cf5319dc admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:28.621016 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1137/2276] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:54:28 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:54:28.624903 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a08610-f89b-428c-b11c-d3c90ab26d3d admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:28.635769 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a08610-f89b-428c-b11c-d3c90ab26d3d admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:28.640423 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6771a55-6580-4569-94dc-266393b1ce97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:28.641237 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6771a55-6580-4569-94dc-266393b1ce97 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:28.641524 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6771a55-6580-4569-94dc-266393b1ce97 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:28.641797 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6771a55-6580-4569-94dc-266393b1ce97 admin admin] PATH_INFO: `/v3/projects/789b72e2b2044546ae7f330ac36e4006/users/9ceb16c29ea64ffb883b7176ffbf6539/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:28.667441 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6771a55-6580-4569-94dc-266393b1ce97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=789b72e2b2044546ae7f330ac36e4006, user_id=9ceb16c29ea64ffb883b7176ffbf6539, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:28.711600 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6771a55-6580-4569-94dc-266393b1ce97 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:28.743112 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1140/2277] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:54:28 2021] PUT /identity/v3/projects/789b72e2b2044546ae7f330ac36e4006/users/9ceb16c29ea64ffb883b7176ffbf6539/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:54:28.753724 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ff934-35ea-4507-a663-fcab3b33e57c None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:28.754201 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ff934-35ea-4507-a663-fcab3b33e57c None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:28.754789 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ff934-35ea-4507-a663-fcab3b33e57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:28.810419 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-a26ff934-35ea-4507-a663-fcab3b33e57c None None] MFA Rules not processed for user `9ceb16c29ea64ffb883b7176ffbf6539`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:28.811995 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-a26ff934-35ea-4507-a663-fcab3b33e57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:28.932647 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1138/2278] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:28 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:28.937898 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6771a55-6580-4569-94dc-266393b1ce97 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:29.031421 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6771a55-6580-4569-94dc-266393b1ce97 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:29.042128 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21c80f-4112-4f06-9137-735f887abd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:29.042982 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21c80f-4112-4f06-9137-735f887abd57 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:29.043355 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21c80f-4112-4f06-9137-735f887abd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:29.043715 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21c80f-4112-4f06-9137-735f887abd57 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:29.045326 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21c80f-4112-4f06-9137-735f887abd57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:29.085873 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21c80f-4112-4f06-9137-735f887abd57 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:29.131021 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1141/2279] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:54:28 2021] POST /identity/v3/projects => generated 383 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:54:29.133785 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ff934-35ea-4507-a663-fcab3b33e57c None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:29.150903 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ff934-35ea-4507-a663-fcab3b33e57c None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:29.327238 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b2322-9d3b-4286-a965-0b90a4e53d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:29.329933 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b2322-9d3b-4286-a965-0b90a4e53d5c admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:29.330219 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b2322-9d3b-4286-a965-0b90a4e53d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:29.331946 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b2322-9d3b-4286-a965-0b90a4e53d5c admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:29.334454 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b2322-9d3b-4286-a965-0b90a4e53d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:29.403534 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b2322-9d3b-4286-a965-0b90a4e53d5c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:29.449874 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1139/2280] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:54:29 2021] POST /identity/v3/users => generated 298 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:54:29.453621 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21c80f-4112-4f06-9137-735f887abd57 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:29.466434 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21c80f-4112-4f06-9137-735f887abd57 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:29.492198 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ef9ef-de71-42d1-981e-4207e7a3e073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:29.492990 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ef9ef-de71-42d1-981e-4207e7a3e073 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:29.493392 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ef9ef-de71-42d1-981e-4207e7a3e073 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:29.493785 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ef9ef-de71-42d1-981e-4207e7a3e073 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:29.494724 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ef9ef-de71-42d1-981e-4207e7a3e073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:29.582532 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ef9ef-de71-42d1-981e-4207e7a3e073 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:29.618742 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1142/2281] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:54:29 2021] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:54:29.620417 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b2322-9d3b-4286-a965-0b90a4e53d5c admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:29.647684 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b2322-9d3b-4286-a965-0b90a4e53d5c admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:29.652514 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdc508-66e6-4bb3-aff3-b1cc69f31b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:29.654062 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdc508-66e6-4bb3-aff3-b1cc69f31b23 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:29.654400 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdc508-66e6-4bb3-aff3-b1cc69f31b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:29.656733 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdc508-66e6-4bb3-aff3-b1cc69f31b23 admin admin] PATH_INFO: `/v3/projects/c9604fbb7e864baab97089b9f02ea473/users/1b9c6b5dfd5248c39db7e282c1055d39/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:29.687541 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdc508-66e6-4bb3-aff3-b1cc69f31b23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9604fbb7e864baab97089b9f02ea473, user_id=1b9c6b5dfd5248c39db7e282c1055d39, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:29.720080 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdc508-66e6-4bb3-aff3-b1cc69f31b23 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:29.737691 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1140/2282] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:54:29 2021] PUT /identity/v3/projects/c9604fbb7e864baab97089b9f02ea473/users/1b9c6b5dfd5248c39db7e282c1055d39/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:29.740872 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ef9ef-de71-42d1-981e-4207e7a3e073 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:29.756779 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ef9ef-de71-42d1-981e-4207e7a3e073 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:29.906687 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec1699-b973-478e-a080-c665dd99614d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:29.907893 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec1699-b973-478e-a080-c665dd99614d admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:29.908306 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec1699-b973-478e-a080-c665dd99614d admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:29.908797 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec1699-b973-478e-a080-c665dd99614d admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:29.909741 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec1699-b973-478e-a080-c665dd99614d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:29.956704 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec1699-b973-478e-a080-c665dd99614d admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:29.973506 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1143/2283] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:54:29 2021] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:54:29.977370 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdc508-66e6-4bb3-aff3-b1cc69f31b23 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:29.988977 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdc508-66e6-4bb3-aff3-b1cc69f31b23 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:29.994737 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b284fb5-ad84-4b02-9d33-189cc990cd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:29.995949 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b284fb5-ad84-4b02-9d33-189cc990cd3f admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:29.996460 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b284fb5-ad84-4b02-9d33-189cc990cd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:29.997004 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b284fb5-ad84-4b02-9d33-189cc990cd3f admin admin] PATH_INFO: `/v3/projects/c9604fbb7e864baab97089b9f02ea473/users/1b9c6b5dfd5248c39db7e282c1055d39/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:30.001952 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b284fb5-ad84-4b02-9d33-189cc990cd3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9604fbb7e864baab97089b9f02ea473, user_id=1b9c6b5dfd5248c39db7e282c1055d39, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:30.061790 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b284fb5-ad84-4b02-9d33-189cc990cd3f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:30.075680 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1141/2284] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:54:29 2021] PUT /identity/v3/projects/c9604fbb7e864baab97089b9f02ea473/users/1b9c6b5dfd5248c39db7e282c1055d39/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:30.079479 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec1699-b973-478e-a080-c665dd99614d admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:30.090071 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec1699-b973-478e-a080-c665dd99614d admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:30.217601 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a42f40-dcfc-42f0-9d19-b5b49b142987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:30.218705 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a42f40-dcfc-42f0-9d19-b5b49b142987 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:30.219343 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a42f40-dcfc-42f0-9d19-b5b49b142987 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:30.219823 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a42f40-dcfc-42f0-9d19-b5b49b142987 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:30.221107 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a42f40-dcfc-42f0-9d19-b5b49b142987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:30.255048 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a42f40-dcfc-42f0-9d19-b5b49b142987 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:30.271908 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1144/2285] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:54:30 2021] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:54:30.273081 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b284fb5-ad84-4b02-9d33-189cc990cd3f admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:30.285643 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b284fb5-ad84-4b02-9d33-189cc990cd3f admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:30.290443 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a850d3-ed7a-469f-a98d-f453a6862379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:30.294622 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a850d3-ed7a-469f-a98d-f453a6862379 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:30.295266 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a850d3-ed7a-469f-a98d-f453a6862379 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:30.310944 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a850d3-ed7a-469f-a98d-f453a6862379 admin admin] PATH_INFO: `/v3/projects/c9604fbb7e864baab97089b9f02ea473/users/1b9c6b5dfd5248c39db7e282c1055d39/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:30.313194 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a850d3-ed7a-469f-a98d-f453a6862379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9604fbb7e864baab97089b9f02ea473, user_id=1b9c6b5dfd5248c39db7e282c1055d39, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:30.362134 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a850d3-ed7a-469f-a98d-f453a6862379 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:30.394767 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1142/2286] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:54:30 2021] PUT /identity/v3/projects/c9604fbb7e864baab97089b9f02ea473/users/1b9c6b5dfd5248c39db7e282c1055d39/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:30.405676 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8364e-3e04-4c0d-aebe-465171288d4e None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:30.406273 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8364e-3e04-4c0d-aebe-465171288d4e None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:30.406792 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8364e-3e04-4c0d-aebe-465171288d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:30.483298 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-e8d8364e-3e04-4c0d-aebe-465171288d4e None None] MFA Rules not processed for user `1b9c6b5dfd5248c39db7e282c1055d39`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:30.484533 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-e8d8364e-3e04-4c0d-aebe-465171288d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:30.862274 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1145/2287] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:30 2021] POST /identity/v3/auth/tokens => generated 3757 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:30.873568 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a850d3-ed7a-469f-a98d-f453a6862379 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:30.875614 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-a2a850d3-ed7a-469f-a98d-f453a6862379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:31.060533 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a850d3-ed7a-469f-a98d-f453a6862379 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:31.079219 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22a164-733d-43c7-b814-68770f707375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:31.079998 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22a164-733d-43c7-b814-68770f707375 service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:31.080297 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22a164-733d-43c7-b814-68770f707375 service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:31.080586 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22a164-733d-43c7-b814-68770f707375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:31.172998 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22a164-733d-43c7-b814-68770f707375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:31.210072 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22a164-733d-43c7-b814-68770f707375 service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:31.222280 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1143/2288] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:54:30 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:54:33.397362 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8364e-3e04-4c0d-aebe-465171288d4e None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:33.409725 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8364e-3e04-4c0d-aebe-465171288d4e None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:33.413647 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eab39a-1d08-4f0d-b2b4-cc1d50851099 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:33.414415 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eab39a-1d08-4f0d-b2b4-cc1d50851099 service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:33.414841 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eab39a-1d08-4f0d-b2b4-cc1d50851099 service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:33.415229 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eab39a-1d08-4f0d-b2b4-cc1d50851099 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:33.537417 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eab39a-1d08-4f0d-b2b4-cc1d50851099 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:33.570901 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eab39a-1d08-4f0d-b2b4-cc1d50851099 service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:33.584185 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1146/2289] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:54:33 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:54:34.680199 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22a164-733d-43c7-b814-68770f707375 service cinder] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:34.689095 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22a164-733d-43c7-b814-68770f707375 service cinder] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:34.692959 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb2aa9-634c-4090-ad2d-410d033c0a1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:34.693935 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb2aa9-634c-4090-ad2d-410d033c0a1a service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:34.693935 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb2aa9-634c-4090-ad2d-410d033c0a1a service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:34.694570 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb2aa9-634c-4090-ad2d-410d033c0a1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:34.705555 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb2aa9-634c-4090-ad2d-410d033c0a1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:34.732429 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb2aa9-634c-4090-ad2d-410d033c0a1a service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:34.742162 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1144/2290] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:54:34 2021] GET /identity/v3/auth/tokens => generated 3757 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:54:35.117693 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eab39a-1d08-4f0d-b2b4-cc1d50851099 service cinder] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:35.119217 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-83eab39a-1d08-4f0d-b2b4-cc1d50851099 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:35.210831 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eab39a-1d08-4f0d-b2b4-cc1d50851099 service cinder] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:35.216881 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd8db6-a855-4d1e-b155-6e5f48cfe5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:35.217242 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd8db6-a855-4d1e-b155-6e5f48cfe5b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:35.217708 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd8db6-a855-4d1e-b155-6e5f48cfe5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:35.217995 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd8db6-a855-4d1e-b155-6e5f48cfe5b9 admin admin] PATH_INFO: `/v3/users/d87f4289c77c4891ada462981082e97a` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:35.219672 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd8db6-a855-4d1e-b155-6e5f48cfe5b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d87f4289c77c4891ada462981082e97a)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:35.248467 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd8db6-a855-4d1e-b155-6e5f48cfe5b9 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:35.308998 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-fcdd8db6-a855-4d1e-b155-6e5f48cfe5b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd87f4289c77c4891ada462981082e97a'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:35.324260 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-fcdd8db6-a855-4d1e-b155-6e5f48cfe5b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd87f4289c77c4891ada462981082e97a'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:35.325932 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-fcdd8db6-a855-4d1e-b155-6e5f48cfe5b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd87f4289c77c4891ada462981082e97a'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:35.333627 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-fcdd8db6-a855-4d1e-b155-6e5f48cfe5b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd87f4289c77c4891ada462981082e97a'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:35.346481 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-fcdd8db6-a855-4d1e-b155-6e5f48cfe5b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd87f4289c77c4891ada462981082e97a'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:35.353321 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1147/2291] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:54:35 2021] DELETE /identity/v3/users/d87f4289c77c4891ada462981082e97a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:35.357599 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650e32e-4d50-4cc2-b3d6-3b304d3336c1 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:35.357915 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650e32e-4d50-4cc2-b3d6-3b304d3336c1 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:35.358404 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650e32e-4d50-4cc2-b3d6-3b304d3336c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:35.397573 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-0650e32e-4d50-4cc2-b3d6-3b304d3336c1 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:35.398747 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-0650e32e-4d50-4cc2-b3d6-3b304d3336c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:35.471594 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1145/2292] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:35.482476 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd8db6-a855-4d1e-b155-6e5f48cfe5b9 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:35.483813 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-fcdd8db6-a855-4d1e-b155-6e5f48cfe5b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:35.551205 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd8db6-a855-4d1e-b155-6e5f48cfe5b9 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:35.554561 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9c2b5-7f1e-4234-94c0-b7d958e20fb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:35.555163 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9c2b5-7f1e-4234-94c0-b7d958e20fb8 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:35.555448 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9c2b5-7f1e-4234-94c0-b7d958e20fb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:35.555730 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9c2b5-7f1e-4234-94c0-b7d958e20fb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:35.565854 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9c2b5-7f1e-4234-94c0-b7d958e20fb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:35.592762 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9c2b5-7f1e-4234-94c0-b7d958e20fb8 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:35.602813 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1148/2293] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:54:35 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:54:36.053695 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650e32e-4d50-4cc2-b3d6-3b304d3336c1 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:36.058800 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-0650e32e-4d50-4cc2-b3d6-3b304d3336c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:36.077437 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650e32e-4d50-4cc2-b3d6-3b304d3336c1 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:36.083714 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cc74a-9ec2-412b-9c16-35f4958f434b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:36.084901 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cc74a-9ec2-412b-9c16-35f4958f434b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:36.085356 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cc74a-9ec2-412b-9c16-35f4958f434b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:36.085793 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cc74a-9ec2-412b-9c16-35f4958f434b admin admin] PATH_INFO: `/v3/projects/7dd0bcb664614307872df6dfd2fe970c` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:36.087115 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cc74a-9ec2-412b-9c16-35f4958f434b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dd0bcb664614307872df6dfd2fe970c)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:36.115003 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cc74a-9ec2-412b-9c16-35f4958f434b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:36.185770 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-0e1cc74a-9ec2-412b-9c16-35f4958f434b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dd0bcb664614307872df6dfd2fe970c', 'request_id': 'req-0e1cc74a-9ec2-412b-9c16-35f4958f434b'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:36.193345 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-0e1cc74a-9ec2-412b-9c16-35f4958f434b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dd0bcb664614307872df6dfd2fe970c', 'request_id': 'req-0e1cc74a-9ec2-412b-9c16-35f4958f434b'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:36.200910 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-0e1cc74a-9ec2-412b-9c16-35f4958f434b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dd0bcb664614307872df6dfd2fe970c', 'request_id': 'req-0e1cc74a-9ec2-412b-9c16-35f4958f434b'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:36.221188 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-0e1cc74a-9ec2-412b-9c16-35f4958f434b admin admin] The token cache is being invalidate because project 7dd0bcb664614307872df6dfd2fe970c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:54:36.221703 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-0e1cc74a-9ec2-412b-9c16-35f4958f434b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:36.222236 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-0e1cc74a-9ec2-412b-9c16-35f4958f434b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:36.223752 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1146/2294] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:54:36 2021] DELETE /identity/v3/projects/7dd0bcb664614307872df6dfd2fe970c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:36.229927 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c18c5c-5df9-4b5a-aed3-c03742174862 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:36.230433 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c18c5c-5df9-4b5a-aed3-c03742174862 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:36.230540 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c18c5c-5df9-4b5a-aed3-c03742174862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:36.255790 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-43c18c5c-5df9-4b5a-aed3-c03742174862 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:36.256965 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-43c18c5c-5df9-4b5a-aed3-c03742174862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:36.340142 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1149/2295] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:36.347746 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae979b-3176-437c-b819-1a5846ecb74c None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:36.351095 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae979b-3176-437c-b819-1a5846ecb74c None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:36.351628 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae979b-3176-437c-b819-1a5846ecb74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:36.411262 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-16ae979b-3176-437c-b819-1a5846ecb74c None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:36.412880 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-16ae979b-3176-437c-b819-1a5846ecb74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:36.453488 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1147/2296] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:36.458957 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c18c5c-5df9-4b5a-aed3-c03742174862 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:36.471463 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c18c5c-5df9-4b5a-aed3-c03742174862 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:36.481326 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f415f94-ec1f-47e2-8bba-70b5abceaedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:36.481928 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f415f94-ec1f-47e2-8bba-70b5abceaedc admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:36.482215 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f415f94-ec1f-47e2-8bba-70b5abceaedc admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:36.482497 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f415f94-ec1f-47e2-8bba-70b5abceaedc admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:36.483453 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f415f94-ec1f-47e2-8bba-70b5abceaedc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:54:36.483823 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f415f94-ec1f-47e2-8bba-70b5abceaedc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:36.529987 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f415f94-ec1f-47e2-8bba-70b5abceaedc admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:36.550806 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1150/2297] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:54:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:54:36.555125 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae979b-3176-437c-b819-1a5846ecb74c None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:36.570834 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae979b-3176-437c-b819-1a5846ecb74c None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:36.577307 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915327f-71c8-426e-bc79-27b5f9a06b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:36.578321 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915327f-71c8-426e-bc79-27b5f9a06b29 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:36.578937 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915327f-71c8-426e-bc79-27b5f9a06b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:36.579579 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915327f-71c8-426e-bc79-27b5f9a06b29 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:36.580709 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915327f-71c8-426e-bc79-27b5f9a06b29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:36.638498 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915327f-71c8-426e-bc79-27b5f9a06b29 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:36.697375 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1148/2298] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:54:36 2021] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:54:36.701868 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f415f94-ec1f-47e2-8bba-70b5abceaedc admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:36.726922 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f415f94-ec1f-47e2-8bba-70b5abceaedc admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:36.846428 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c9fee-1438-465b-8471-692d6d9394ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:36.847353 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c9fee-1438-465b-8471-692d6d9394ed admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:36.847809 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c9fee-1438-465b-8471-692d6d9394ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:36.848250 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c9fee-1438-465b-8471-692d6d9394ed admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:36.849046 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c9fee-1438-465b-8471-692d6d9394ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:36.886120 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c9fee-1438-465b-8471-692d6d9394ed admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:36.963105 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1151/2299] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:54:36 2021] POST /identity/v3/users => generated 292 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:54:36.967700 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915327f-71c8-426e-bc79-27b5f9a06b29 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:36.998264 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915327f-71c8-426e-bc79-27b5f9a06b29 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:37.010825 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c2ad8-0b94-489f-9e2d-f1efb9f26b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:37.011422 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c2ad8-0b94-489f-9e2d-f1efb9f26b5a admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:37.011710 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c2ad8-0b94-489f-9e2d-f1efb9f26b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:37.013230 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c2ad8-0b94-489f-9e2d-f1efb9f26b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:37.013230 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c2ad8-0b94-489f-9e2d-f1efb9f26b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:37.038674 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c2ad8-0b94-489f-9e2d-f1efb9f26b5a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:37.049254 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1149/2300] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:54:36 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:54:37.053578 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c9fee-1438-465b-8471-692d6d9394ed admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:37.136049 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c9fee-1438-465b-8471-692d6d9394ed admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:37.145208 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669f389-f4e3-4bc6-bc4d-c582b656ab5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:37.146398 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669f389-f4e3-4bc6-bc4d-c582b656ab5f admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:37.146978 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669f389-f4e3-4bc6-bc4d-c582b656ab5f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:37.147611 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669f389-f4e3-4bc6-bc4d-c582b656ab5f admin admin] PATH_INFO: `/v3/projects/d835ac2b7b0e4c4aa5e9e9cdb3a4faa5/users/abea74c48ef444f5b8dd15fdc4ce5a71/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:37.174266 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669f389-f4e3-4bc6-bc4d-c582b656ab5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d835ac2b7b0e4c4aa5e9e9cdb3a4faa5, user_id=abea74c48ef444f5b8dd15fdc4ce5a71, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:37.206458 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669f389-f4e3-4bc6-bc4d-c582b656ab5f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:37.235170 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1152/2301] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:54:37 2021] PUT /identity/v3/projects/d835ac2b7b0e4c4aa5e9e9cdb3a4faa5/users/abea74c48ef444f5b8dd15fdc4ce5a71/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:54:37.240665 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cd2b7-3758-48fc-8b36-05c1495c4f63 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:37.241139 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cd2b7-3758-48fc-8b36-05c1495c4f63 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:37.241237 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cd2b7-3758-48fc-8b36-05c1495c4f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:37.270131 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-2b7cd2b7-3758-48fc-8b36-05c1495c4f63 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:37.271392 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-2b7cd2b7-3758-48fc-8b36-05c1495c4f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:37.339443 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1150/2302] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:37.350938 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669f389-f4e3-4bc6-bc4d-c582b656ab5f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:37.352564 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-0669f389-f4e3-4bc6-bc4d-c582b656ab5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:37.460290 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669f389-f4e3-4bc6-bc4d-c582b656ab5f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:37.464838 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297a454-f6e1-430d-b935-abefa58ed74d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:37.465645 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297a454-f6e1-430d-b935-abefa58ed74d service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:37.466177 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297a454-f6e1-430d-b935-abefa58ed74d service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:37.466587 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297a454-f6e1-430d-b935-abefa58ed74d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:37.476354 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297a454-f6e1-430d-b935-abefa58ed74d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:37.503088 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297a454-f6e1-430d-b935-abefa58ed74d service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:37.514600 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1153/2303] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:54:37 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:54:38.499495 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62a85b-956f-4080-aa1c-fdc75efc8dc6 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:38.500352 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62a85b-956f-4080-aa1c-fdc75efc8dc6 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:38.500827 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62a85b-956f-4080-aa1c-fdc75efc8dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:38.542325 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-cc62a85b-956f-4080-aa1c-fdc75efc8dc6 None None] MFA Rules not processed for user `abea74c48ef444f5b8dd15fdc4ce5a71`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:38.544244 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-cc62a85b-956f-4080-aa1c-fdc75efc8dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:38.621099 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1151/2304] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:38 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:38.629719 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297a454-f6e1-430d-b935-abefa58ed74d service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:38.631638 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-5297a454-f6e1-430d-b935-abefa58ed74d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:38.709703 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297a454-f6e1-430d-b935-abefa58ed74d service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:38.716411 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b00b55-22e6-4968-9953-0703dacf5223 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:38.717101 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b00b55-22e6-4968-9953-0703dacf5223 service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:38.717463 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b00b55-22e6-4968-9953-0703dacf5223 service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:38.717855 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b00b55-22e6-4968-9953-0703dacf5223 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:38.728376 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b00b55-22e6-4968-9953-0703dacf5223 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:38.763863 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b00b55-22e6-4968-9953-0703dacf5223 service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:38.773756 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1154/2305] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:54:38 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:54:47.606649 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995df83-b9f7-4272-a696-91c6aa5aa1ee None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:47.607185 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995df83-b9f7-4272-a696-91c6aa5aa1ee None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:47.607442 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995df83-b9f7-4272-a696-91c6aa5aa1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:47.631982 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-a995df83-b9f7-4272-a696-91c6aa5aa1ee None None] MFA Rules not processed for user `1959af22edbf47cd8afca70831d476c0`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:47.633356 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-a995df83-b9f7-4272-a696-91c6aa5aa1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:47.697313 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1152/2306] 10.222.0.37 () {58 vars in 1014 bytes} [Wed Dec 29 20:54:47 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:47.740054 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b00b55-22e6-4968-9953-0703dacf5223 service cinder] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:47.742064 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-26b00b55-22e6-4968-9953-0703dacf5223 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:47.829615 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b00b55-22e6-4968-9953-0703dacf5223 service cinder] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:47.834881 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9c758-4c7e-4ae4-a2b4-a9492d5c9ee6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd2861e377640c9b76d0dfb08cf088e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:47.835456 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9c758-4c7e-4ae4-a2b4-a9492d5c9ee6 service swift] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:47.835738 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9c758-4c7e-4ae4-a2b4-a9492d5c9ee6 service swift] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:47.836014 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9c758-4c7e-4ae4-a2b4-a9492d5c9ee6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:47.844803 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9c758-4c7e-4ae4-a2b4-a9492d5c9ee6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:47.873245 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9c758-4c7e-4ae4-a2b4-a9492d5c9ee6 service swift] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:47.881623 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1155/2307] 10.222.0.37 () {60 vars in 1384 bytes} [Wed Dec 29 20:54:47 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 29 20:54:48.453782 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995df83-b9f7-4272-a696-91c6aa5aa1ee None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:48.455587 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-a995df83-b9f7-4272-a696-91c6aa5aa1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:48.473541 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995df83-b9f7-4272-a696-91c6aa5aa1ee None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:48.481250 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50688d-60c4-453e-bbdf-99f239f6a12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:48.482335 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50688d-60c4-453e-bbdf-99f239f6a12a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:48.482930 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50688d-60c4-453e-bbdf-99f239f6a12a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:48.483831 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50688d-60c4-453e-bbdf-99f239f6a12a admin admin] PATH_INFO: `/v3/users/2cb971df907749619993cd62801f05b7` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:48.485752 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50688d-60c4-453e-bbdf-99f239f6a12a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cb971df907749619993cd62801f05b7)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:48.514787 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50688d-60c4-453e-bbdf-99f239f6a12a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:48.624960 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-cb50688d-60c4-453e-bbdf-99f239f6a12a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cb971df907749619993cd62801f05b7'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:48.627045 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-cb50688d-60c4-453e-bbdf-99f239f6a12a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cb971df907749619993cd62801f05b7'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:48.639117 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-cb50688d-60c4-453e-bbdf-99f239f6a12a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cb971df907749619993cd62801f05b7'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:48.653755 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-cb50688d-60c4-453e-bbdf-99f239f6a12a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cb971df907749619993cd62801f05b7'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:48.663926 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-cb50688d-60c4-453e-bbdf-99f239f6a12a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cb971df907749619993cd62801f05b7'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:48.671935 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1153/2308] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:54:48 2021] DELETE /identity/v3/users/2cb971df907749619993cd62801f05b7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:48.676622 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d292325-6de9-4bd9-92ee-68e2832051ac None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:48.677230 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d292325-6de9-4bd9-92ee-68e2832051ac None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:48.677730 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d292325-6de9-4bd9-92ee-68e2832051ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:48.753229 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-7d292325-6de9-4bd9-92ee-68e2832051ac None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:48.754329 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-7d292325-6de9-4bd9-92ee-68e2832051ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:48.870636 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1156/2309] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:48.882369 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50688d-60c4-453e-bbdf-99f239f6a12a admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:48.885104 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-cb50688d-60c4-453e-bbdf-99f239f6a12a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:48.981202 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50688d-60c4-453e-bbdf-99f239f6a12a admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:48.984572 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fa772-37fd-43ad-a539-2bb7b565c130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:48.985147 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fa772-37fd-43ad-a539-2bb7b565c130 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:48.985431 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fa772-37fd-43ad-a539-2bb7b565c130 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:48.985706 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fa772-37fd-43ad-a539-2bb7b565c130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:48.999300 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9fa772-37fd-43ad-a539-2bb7b565c130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:49.030806 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9fa772-37fd-43ad-a539-2bb7b565c130 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:49.041465 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1154/2310] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:54:48 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:54:49.263193 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc0d4d-80e4-4571-b5d3-c81efd1aebd0 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:49.264428 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc0d4d-80e4-4571-b5d3-c81efd1aebd0 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:49.264892 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc0d4d-80e4-4571-b5d3-c81efd1aebd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:49.288674 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-e1fc0d4d-80e4-4571-b5d3-c81efd1aebd0 None None] MFA Rules not processed for user `abea74c48ef444f5b8dd15fdc4ce5a71`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:49.290221 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-e1fc0d4d-80e4-4571-b5d3-c81efd1aebd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:49.372048 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1157/2311] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:49 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:49.943173 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fa772-37fd-43ad-a539-2bb7b565c130 service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:49.948168 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-8e9fa772-37fd-43ad-a539-2bb7b565c130 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:49.992048 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fa772-37fd-43ad-a539-2bb7b565c130 service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:50.012527 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa134e7a-8622-46d0-9b8a-bf4f6bb2ba83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:50.013438 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa134e7a-8622-46d0-9b8a-bf4f6bb2ba83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:50.013822 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa134e7a-8622-46d0-9b8a-bf4f6bb2ba83 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:50.014200 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa134e7a-8622-46d0-9b8a-bf4f6bb2ba83 admin admin] PATH_INFO: `/v3/projects/1a0c3e5026514cd1b7caebf6ffd1933a` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:50.016118 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa134e7a-8622-46d0-9b8a-bf4f6bb2ba83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a0c3e5026514cd1b7caebf6ffd1933a)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:50.063963 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa134e7a-8622-46d0-9b8a-bf4f6bb2ba83 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:50.130408 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-aa134e7a-8622-46d0-9b8a-bf4f6bb2ba83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a0c3e5026514cd1b7caebf6ffd1933a', 'request_id': 'req-aa134e7a-8622-46d0-9b8a-bf4f6bb2ba83'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:50.142977 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-aa134e7a-8622-46d0-9b8a-bf4f6bb2ba83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a0c3e5026514cd1b7caebf6ffd1933a', 'request_id': 'req-aa134e7a-8622-46d0-9b8a-bf4f6bb2ba83'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:50.152714 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-aa134e7a-8622-46d0-9b8a-bf4f6bb2ba83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a0c3e5026514cd1b7caebf6ffd1933a', 'request_id': 'req-aa134e7a-8622-46d0-9b8a-bf4f6bb2ba83'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:50.173556 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-aa134e7a-8622-46d0-9b8a-bf4f6bb2ba83 admin admin] The token cache is being invalidate because project 1a0c3e5026514cd1b7caebf6ffd1933a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:54:50.173985 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-aa134e7a-8622-46d0-9b8a-bf4f6bb2ba83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:50.174934 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-aa134e7a-8622-46d0-9b8a-bf4f6bb2ba83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:50.177023 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1155/2312] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:54:49 2021] DELETE /identity/v3/projects/1a0c3e5026514cd1b7caebf6ffd1933a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:50.182038 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc0d4d-80e4-4571-b5d3-c81efd1aebd0 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:50.196777 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc0d4d-80e4-4571-b5d3-c81efd1aebd0 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:50.285106 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16ba7a-95e8-4285-b352-cff43f4b2d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:50.286347 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16ba7a-95e8-4285-b352-cff43f4b2d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:50.286944 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16ba7a-95e8-4285-b352-cff43f4b2d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:50.287389 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16ba7a-95e8-4285-b352-cff43f4b2d87 admin admin] PATH_INFO: `/v3/users/9ceb16c29ea64ffb883b7176ffbf6539` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:50.289226 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16ba7a-95e8-4285-b352-cff43f4b2d87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ceb16c29ea64ffb883b7176ffbf6539)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:50.331406 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16ba7a-95e8-4285-b352-cff43f4b2d87 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:50.403460 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ef16ba7a-95e8-4285-b352-cff43f4b2d87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ceb16c29ea64ffb883b7176ffbf6539'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:50.417238 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ef16ba7a-95e8-4285-b352-cff43f4b2d87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ceb16c29ea64ffb883b7176ffbf6539'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:50.417921 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ef16ba7a-95e8-4285-b352-cff43f4b2d87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ceb16c29ea64ffb883b7176ffbf6539'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:50.426900 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ef16ba7a-95e8-4285-b352-cff43f4b2d87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ceb16c29ea64ffb883b7176ffbf6539'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:50.439555 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ef16ba7a-95e8-4285-b352-cff43f4b2d87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ceb16c29ea64ffb883b7176ffbf6539'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:50.451933 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1158/2313] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:54:50 2021] DELETE /identity/v3/users/9ceb16c29ea64ffb883b7176ffbf6539 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:51.195611 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a9015-18f5-4729-b588-bc5eb8e82325 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:51.196935 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a9015-18f5-4729-b588-bc5eb8e82325 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:51.197380 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a9015-18f5-4729-b588-bc5eb8e82325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:51.239799 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-eb0a9015-18f5-4729-b588-bc5eb8e82325 None None] MFA Rules not processed for user `df2ec396a09f497fa5761cef615b262d`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:54:51.240976 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-eb0a9015-18f5-4729-b588-bc5eb8e82325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:51.335985 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1156/2314] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:54:51 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:54:51.791140 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16ba7a-95e8-4285-b352-cff43f4b2d87 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:51.792592 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-ef16ba7a-95e8-4285-b352-cff43f4b2d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:51.927261 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16ba7a-95e8-4285-b352-cff43f4b2d87 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:51.936696 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3ba5f-ad7f-4b8c-a692-ec2f984c5ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:51.938419 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3ba5f-ad7f-4b8c-a692-ec2f984c5ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:51.939820 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3ba5f-ad7f-4b8c-a692-ec2f984c5ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:51.940239 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3ba5f-ad7f-4b8c-a692-ec2f984c5ea3 admin admin] PATH_INFO: `/v3/projects/789b72e2b2044546ae7f330ac36e4006` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:51.943589 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3ba5f-ad7f-4b8c-a692-ec2f984c5ea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=789b72e2b2044546ae7f330ac36e4006)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:52.008082 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3ba5f-ad7f-4b8c-a692-ec2f984c5ea3 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:52.174281 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-90c3ba5f-ad7f-4b8c-a692-ec2f984c5ea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '789b72e2b2044546ae7f330ac36e4006', 'request_id': 'req-90c3ba5f-ad7f-4b8c-a692-ec2f984c5ea3'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:52.205400 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-90c3ba5f-ad7f-4b8c-a692-ec2f984c5ea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '789b72e2b2044546ae7f330ac36e4006', 'request_id': 'req-90c3ba5f-ad7f-4b8c-a692-ec2f984c5ea3'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:52.257840 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-90c3ba5f-ad7f-4b8c-a692-ec2f984c5ea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '789b72e2b2044546ae7f330ac36e4006', 'request_id': 'req-90c3ba5f-ad7f-4b8c-a692-ec2f984c5ea3'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:52.294882 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-90c3ba5f-ad7f-4b8c-a692-ec2f984c5ea3 admin admin] The token cache is being invalidate because project 789b72e2b2044546ae7f330ac36e4006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:54:52.295691 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-90c3ba5f-ad7f-4b8c-a692-ec2f984c5ea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:52.298100 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-90c3ba5f-ad7f-4b8c-a692-ec2f984c5ea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:52.308728 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1159/2315] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:54:51 2021] DELETE /identity/v3/projects/789b72e2b2044546ae7f330ac36e4006 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:52.316963 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a9015-18f5-4729-b588-bc5eb8e82325 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:52.344944 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a9015-18f5-4729-b588-bc5eb8e82325 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:52.576148 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16083e0-d4a3-4e33-9b9d-b3af304497c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:52.577774 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16083e0-d4a3-4e33-9b9d-b3af304497c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:52.579914 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16083e0-d4a3-4e33-9b9d-b3af304497c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:52.580801 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16083e0-d4a3-4e33-9b9d-b3af304497c5 admin admin] PATH_INFO: `/v3/users/1b9c6b5dfd5248c39db7e282c1055d39` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:52.587000 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16083e0-d4a3-4e33-9b9d-b3af304497c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b9c6b5dfd5248c39db7e282c1055d39)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:52.634386 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16083e0-d4a3-4e33-9b9d-b3af304497c5 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:52.758754 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f16083e0-d4a3-4e33-9b9d-b3af304497c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b9c6b5dfd5248c39db7e282c1055d39'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:52.759516 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f16083e0-d4a3-4e33-9b9d-b3af304497c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b9c6b5dfd5248c39db7e282c1055d39'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:52.793563 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f16083e0-d4a3-4e33-9b9d-b3af304497c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b9c6b5dfd5248c39db7e282c1055d39'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:52.843800 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f16083e0-d4a3-4e33-9b9d-b3af304497c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b9c6b5dfd5248c39db7e282c1055d39'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:52.881098 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f16083e0-d4a3-4e33-9b9d-b3af304497c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b9c6b5dfd5248c39db7e282c1055d39'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:52.889455 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1157/2316] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:54:52 2021] DELETE /identity/v3/users/1b9c6b5dfd5248c39db7e282c1055d39 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:54:53.762040 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3ba5f-ad7f-4b8c-a692-ec2f984c5ea3 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:54:53.763474 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-90c3ba5f-ad7f-4b8c-a692-ec2f984c5ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:54:53.784150 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3ba5f-ad7f-4b8c-a692-ec2f984c5ea3 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:54:53.919239 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b1234-1c8b-4a75-899e-b701d77ae836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:54:53.920212 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b1234-1c8b-4a75-899e-b701d77ae836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:54:53.920612 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b1234-1c8b-4a75-899e-b701d77ae836 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:54:53.921216 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b1234-1c8b-4a75-899e-b701d77ae836 admin admin] PATH_INFO: `/v3/projects/c9604fbb7e864baab97089b9f02ea473` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:54:53.923354 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b1234-1c8b-4a75-899e-b701d77ae836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9604fbb7e864baab97089b9f02ea473)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:54:53.981993 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b1234-1c8b-4a75-899e-b701d77ae836 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:54:54.067379 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-889b1234-1c8b-4a75-899e-b701d77ae836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9604fbb7e864baab97089b9f02ea473', 'request_id': 'req-889b1234-1c8b-4a75-899e-b701d77ae836'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:54.089417 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-889b1234-1c8b-4a75-899e-b701d77ae836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9604fbb7e864baab97089b9f02ea473', 'request_id': 'req-889b1234-1c8b-4a75-899e-b701d77ae836'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:54.104504 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-889b1234-1c8b-4a75-899e-b701d77ae836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9604fbb7e864baab97089b9f02ea473', 'request_id': 'req-889b1234-1c8b-4a75-899e-b701d77ae836'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:54.123851 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-889b1234-1c8b-4a75-899e-b701d77ae836 admin admin] The token cache is being invalidate because project c9604fbb7e864baab97089b9f02ea473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:54:54.124390 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-889b1234-1c8b-4a75-899e-b701d77ae836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:54.125504 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-889b1234-1c8b-4a75-899e-b701d77ae836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:54:54.145737 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1160/2317] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:54:53 2021] DELETE /identity/v3/projects/c9604fbb7e864baab97089b9f02ea473 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:55:03.544664 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b33b9a-6243-455b-9175-d599eb737d28 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:03.545293 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b33b9a-6243-455b-9175-d599eb737d28 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:03.545463 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b33b9a-6243-455b-9175-d599eb737d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:03.583229 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-82b33b9a-6243-455b-9175-d599eb737d28 None None] MFA Rules not processed for user `1959af22edbf47cd8afca70831d476c0`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:03.584619 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-82b33b9a-6243-455b-9175-d599eb737d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:03.680637 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1158/2318] 10.222.0.37 () {58 vars in 1014 bytes} [Wed Dec 29 20:55:03 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:03.697909 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b1234-1c8b-4a75-899e-b701d77ae836 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:03.699879 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-889b1234-1c8b-4a75-899e-b701d77ae836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:03.879906 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b1234-1c8b-4a75-899e-b701d77ae836 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:03.893393 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16609116-cda7-4c30-8bc3-4f0225dad209 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd2861e377640c9b76d0dfb08cf088e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:03.894536 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16609116-cda7-4c30-8bc3-4f0225dad209 service swift] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:03.895245 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16609116-cda7-4c30-8bc3-4f0225dad209 service swift] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:03.895964 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16609116-cda7-4c30-8bc3-4f0225dad209 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:03.934162 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16609116-cda7-4c30-8bc3-4f0225dad209 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:03.986956 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16609116-cda7-4c30-8bc3-4f0225dad209 service swift] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:04.073936 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1161/2319] 10.222.0.37 () {60 vars in 1384 bytes} [Wed Dec 29 20:55:03 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 29 20:55:05.410768 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e781d-c61e-4f2e-b169-4a15feefeace None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:05.411318 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e781d-c61e-4f2e-b169-4a15feefeace None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:05.411552 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e781d-c61e-4f2e-b169-4a15feefeace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:05.442035 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-398e781d-c61e-4f2e-b169-4a15feefeace None None] MFA Rules not processed for user `1959af22edbf47cd8afca70831d476c0`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:05.444227 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-398e781d-c61e-4f2e-b169-4a15feefeace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:05.459003 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1159/2320] 10.222.0.37 () {58 vars in 967 bytes} [Wed Dec 29 20:55:05 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:05.474330 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16609116-cda7-4c30-8bc3-4f0225dad209 service swift] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:05.493464 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16609116-cda7-4c30-8bc3-4f0225dad209 service swift] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:05.503502 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a174da-a852-4aa0-86fd-9fd311e728c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd2861e377640c9b76d0dfb08cf088e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:05.504397 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a174da-a852-4aa0-86fd-9fd311e728c7 service swift] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:05.504845 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a174da-a852-4aa0-86fd-9fd311e728c7 service swift] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:05.505292 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a174da-a852-4aa0-86fd-9fd311e728c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:05.516857 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a174da-a852-4aa0-86fd-9fd311e728c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:05.563677 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a174da-a852-4aa0-86fd-9fd311e728c7 service swift] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:05.578862 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1162/2321] 10.222.0.37 () {60 vars in 1384 bytes} [Wed Dec 29 20:55:05 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 29 20:55:05.995569 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c8ea2-327b-4858-9974-7ad9530013e2 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:05.995936 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c8ea2-327b-4858-9974-7ad9530013e2 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:05.996328 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c8ea2-327b-4858-9974-7ad9530013e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:06.029352 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-943c8ea2-327b-4858-9974-7ad9530013e2 None None] MFA Rules not processed for user `1959af22edbf47cd8afca70831d476c0`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:06.031721 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-943c8ea2-327b-4858-9974-7ad9530013e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:06.052806 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1160/2322] 10.222.0.37 () {58 vars in 1014 bytes} [Wed Dec 29 20:55:05 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:06.067612 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a174da-a852-4aa0-86fd-9fd311e728c7 service swift] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:06.083963 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a174da-a852-4aa0-86fd-9fd311e728c7 service swift] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:06.097247 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fd81f-1aed-4028-b9cd-39eb71ad224e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd2861e377640c9b76d0dfb08cf088e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:06.097923 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fd81f-1aed-4028-b9cd-39eb71ad224e service swift] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:06.098272 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fd81f-1aed-4028-b9cd-39eb71ad224e service swift] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:06.098935 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fd81f-1aed-4028-b9cd-39eb71ad224e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:06.110840 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27fd81f-1aed-4028-b9cd-39eb71ad224e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:06.143133 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27fd81f-1aed-4028-b9cd-39eb71ad224e service swift] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:06.163505 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1163/2323] 10.222.0.37 () {60 vars in 1384 bytes} [Wed Dec 29 20:55:06 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 29 20:55:06.718582 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a5613-5af6-4d04-854f-b1adf7702090 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:06.719108 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a5613-5af6-4d04-854f-b1adf7702090 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:06.719408 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a5613-5af6-4d04-854f-b1adf7702090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:06.742449 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-652a5613-5af6-4d04-854f-b1adf7702090 None None] MFA Rules not processed for user `1959af22edbf47cd8afca70831d476c0`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:06.743641 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-652a5613-5af6-4d04-854f-b1adf7702090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:06.751050 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1161/2324] 10.222.0.37 () {58 vars in 967 bytes} [Wed Dec 29 20:55:06 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:06.769479 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fd81f-1aed-4028-b9cd-39eb71ad224e service swift] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:06.784305 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fd81f-1aed-4028-b9cd-39eb71ad224e service swift] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:06.790813 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b598d1-5f08-481d-a287-2a733bd4ad90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd2861e377640c9b76d0dfb08cf088e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:06.791402 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b598d1-5f08-481d-a287-2a733bd4ad90 service swift] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:06.791776 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b598d1-5f08-481d-a287-2a733bd4ad90 service swift] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:06.792263 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b598d1-5f08-481d-a287-2a733bd4ad90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:06.801564 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b598d1-5f08-481d-a287-2a733bd4ad90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:06.845361 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b598d1-5f08-481d-a287-2a733bd4ad90 service swift] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:06.855376 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1164/2325] 10.222.0.37 () {60 vars in 1384 bytes} [Wed Dec 29 20:55:06 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 29 20:55:10.653567 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a5613-5af6-4d04-854f-b1adf7702090 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:10.655237 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-652a5613-5af6-4d04-854f-b1adf7702090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:10.765606 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a5613-5af6-4d04-854f-b1adf7702090 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:10.772466 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6073356-3d5a-4bf1-8827-9b17d72edc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:10.774001 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6073356-3d5a-4bf1-8827-9b17d72edc62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:10.774517 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6073356-3d5a-4bf1-8827-9b17d72edc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:10.774990 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6073356-3d5a-4bf1-8827-9b17d72edc62 admin admin] PATH_INFO: `/v3/users/4c912c35829146279177ce1e320d346a` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:10.776533 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6073356-3d5a-4bf1-8827-9b17d72edc62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c912c35829146279177ce1e320d346a)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:10.827264 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6073356-3d5a-4bf1-8827-9b17d72edc62 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:10.894397 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d6073356-3d5a-4bf1-8827-9b17d72edc62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c912c35829146279177ce1e320d346a'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:10.895113 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d6073356-3d5a-4bf1-8827-9b17d72edc62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c912c35829146279177ce1e320d346a'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:10.912628 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d6073356-3d5a-4bf1-8827-9b17d72edc62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c912c35829146279177ce1e320d346a'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:10.929877 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d6073356-3d5a-4bf1-8827-9b17d72edc62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c912c35829146279177ce1e320d346a'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:10.939751 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-d6073356-3d5a-4bf1-8827-9b17d72edc62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c912c35829146279177ce1e320d346a'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:10.947882 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1162/2326] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:55:10 2021] DELETE /identity/v3/users/4c912c35829146279177ce1e320d346a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:55:10.952556 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094137e-a763-4b24-8bd8-a72e8ddb708c None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:10.953257 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094137e-a763-4b24-8bd8-a72e8ddb708c None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:10.953257 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094137e-a763-4b24-8bd8-a72e8ddb708c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:10.989528 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-7094137e-a763-4b24-8bd8-a72e8ddb708c None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:10.990777 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-7094137e-a763-4b24-8bd8-a72e8ddb708c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:11.153378 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1165/2327] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:55:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:11.161885 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6073356-3d5a-4bf1-8827-9b17d72edc62 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:11.164686 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-d6073356-3d5a-4bf1-8827-9b17d72edc62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:11.256019 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6073356-3d5a-4bf1-8827-9b17d72edc62 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:11.261305 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14727f9e-7eaf-478e-8583-7f27baecf945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:11.262174 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14727f9e-7eaf-478e-8583-7f27baecf945 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:11.262758 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14727f9e-7eaf-478e-8583-7f27baecf945 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:11.263325 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14727f9e-7eaf-478e-8583-7f27baecf945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:11.274817 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14727f9e-7eaf-478e-8583-7f27baecf945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:11.301101 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14727f9e-7eaf-478e-8583-7f27baecf945 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:11.313989 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1163/2328] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:55:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:55:11.624500 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094137e-a763-4b24-8bd8-a72e8ddb708c None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:11.626688 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-7094137e-a763-4b24-8bd8-a72e8ddb708c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:11.645919 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094137e-a763-4b24-8bd8-a72e8ddb708c None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:11.652505 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3794f-9e2a-422a-9e16-e7453370367c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:11.653644 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3794f-9e2a-422a-9e16-e7453370367c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:11.654279 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3794f-9e2a-422a-9e16-e7453370367c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:11.654821 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3794f-9e2a-422a-9e16-e7453370367c admin admin] PATH_INFO: `/v3/projects/0d36ec3cd89c40a7a5706c6046525884` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:11.656314 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3794f-9e2a-422a-9e16-e7453370367c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d36ec3cd89c40a7a5706c6046525884)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:11.688543 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3794f-9e2a-422a-9e16-e7453370367c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:11.777046 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-3ec3794f-9e2a-422a-9e16-e7453370367c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d36ec3cd89c40a7a5706c6046525884', 'request_id': 'req-3ec3794f-9e2a-422a-9e16-e7453370367c'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:11.791509 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-3ec3794f-9e2a-422a-9e16-e7453370367c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d36ec3cd89c40a7a5706c6046525884', 'request_id': 'req-3ec3794f-9e2a-422a-9e16-e7453370367c'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:11.812936 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-3ec3794f-9e2a-422a-9e16-e7453370367c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d36ec3cd89c40a7a5706c6046525884', 'request_id': 'req-3ec3794f-9e2a-422a-9e16-e7453370367c'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:11.834244 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-3ec3794f-9e2a-422a-9e16-e7453370367c admin admin] The token cache is being invalidate because project 0d36ec3cd89c40a7a5706c6046525884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:55:11.834802 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-3ec3794f-9e2a-422a-9e16-e7453370367c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:11.837017 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-3ec3794f-9e2a-422a-9e16-e7453370367c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:11.875057 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1166/2329] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:55:11 2021] DELETE /identity/v3/projects/0d36ec3cd89c40a7a5706c6046525884 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:55:14.022233 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14727f9e-7eaf-478e-8583-7f27baecf945 service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:14.026763 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-14727f9e-7eaf-478e-8583-7f27baecf945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:14.220813 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14727f9e-7eaf-478e-8583-7f27baecf945 service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:14.389894 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb1fdb-6507-4dbb-bffa-0bdc78bd599d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25cb71bb64a3456fb2dc02095c487d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:14.390716 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb1fdb-6507-4dbb-bffa-0bdc78bd599d service placement] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:14.391515 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb1fdb-6507-4dbb-bffa-0bdc78bd599d service placement] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:14.391837 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb1fdb-6507-4dbb-bffa-0bdc78bd599d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:14.394706 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-64cb1fdb-6507-4dbb-bffa-0bdc78bd599d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:14.416647 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb1fdb-6507-4dbb-bffa-0bdc78bd599d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:14.466200 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb1fdb-6507-4dbb-bffa-0bdc78bd599d service placement] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:14.484015 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1164/2330] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:55:14 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:55:15.941084 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cebd55-becb-4359-80b1-cf6487668add None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:15.941577 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cebd55-becb-4359-80b1-cf6487668add None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:15.941730 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cebd55-becb-4359-80b1-cf6487668add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:15.964238 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-81cebd55-becb-4359-80b1-cf6487668add None None] MFA Rules not processed for user `1959af22edbf47cd8afca70831d476c0`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:15.965418 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-81cebd55-becb-4359-80b1-cf6487668add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:16.047314 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1167/2331] 10.222.0.37 () {58 vars in 967 bytes} [Wed Dec 29 20:55:15 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:16.059872 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb1fdb-6507-4dbb-bffa-0bdc78bd599d service placement] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:16.061217 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-64cb1fdb-6507-4dbb-bffa-0bdc78bd599d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:16.154510 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb1fdb-6507-4dbb-bffa-0bdc78bd599d service placement] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:16.159496 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de35967-4fc7-4c98-a1ec-a8a63f95ed6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd2861e377640c9b76d0dfb08cf088e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:16.160367 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de35967-4fc7-4c98-a1ec-a8a63f95ed6f service swift] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:16.160663 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de35967-4fc7-4c98-a1ec-a8a63f95ed6f service swift] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:16.160841 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de35967-4fc7-4c98-a1ec-a8a63f95ed6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:16.169923 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de35967-4fc7-4c98-a1ec-a8a63f95ed6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:16.197661 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de35967-4fc7-4c98-a1ec-a8a63f95ed6f service swift] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:16.236977 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1165/2332] 10.222.0.37 () {60 vars in 1384 bytes} [Wed Dec 29 20:55:16 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 29 20:55:18.862154 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cebd55-becb-4359-80b1-cf6487668add None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:18.863564 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-81cebd55-becb-4359-80b1-cf6487668add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:18.945203 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cebd55-becb-4359-80b1-cf6487668add None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:18.950068 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c87de9-0836-4b68-9e37-bdb0ef208fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:18.950589 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c87de9-0836-4b68-9e37-bdb0ef208fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:18.950831 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c87de9-0836-4b68-9e37-bdb0ef208fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:18.951110 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c87de9-0836-4b68-9e37-bdb0ef208fd9 admin admin] PATH_INFO: `/v3/users/2a6e346d5ebb470eb4258fd097d197eb` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:18.952253 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c87de9-0836-4b68-9e37-bdb0ef208fd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a6e346d5ebb470eb4258fd097d197eb)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:18.980172 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c87de9-0836-4b68-9e37-bdb0ef208fd9 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:19.041600 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-54c87de9-0836-4b68-9e37-bdb0ef208fd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a6e346d5ebb470eb4258fd097d197eb'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:19.061206 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-54c87de9-0836-4b68-9e37-bdb0ef208fd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a6e346d5ebb470eb4258fd097d197eb'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:19.062250 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-54c87de9-0836-4b68-9e37-bdb0ef208fd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a6e346d5ebb470eb4258fd097d197eb'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:19.071618 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-54c87de9-0836-4b68-9e37-bdb0ef208fd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a6e346d5ebb470eb4258fd097d197eb'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:19.081628 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-54c87de9-0836-4b68-9e37-bdb0ef208fd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a6e346d5ebb470eb4258fd097d197eb'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:19.102521 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1168/2333] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:55:18 2021] DELETE /identity/v3/users/2a6e346d5ebb470eb4258fd097d197eb => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:55:19.590028 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de35967-4fc7-4c98-a1ec-a8a63f95ed6f service swift] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:19.601077 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de35967-4fc7-4c98-a1ec-a8a63f95ed6f service swift] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:19.679805 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9d641-eef9-4427-8b03-830554271c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:19.681083 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9d641-eef9-4427-8b03-830554271c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:19.681552 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9d641-eef9-4427-8b03-830554271c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:19.681828 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9d641-eef9-4427-8b03-830554271c55 admin admin] PATH_INFO: `/v3/projects/4571ff0de0f3460cbd122222fa652641` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:19.683167 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9d641-eef9-4427-8b03-830554271c55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4571ff0de0f3460cbd122222fa652641)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:19.712798 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9d641-eef9-4427-8b03-830554271c55 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:19.765939 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-58e9d641-eef9-4427-8b03-830554271c55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4571ff0de0f3460cbd122222fa652641', 'request_id': 'req-58e9d641-eef9-4427-8b03-830554271c55'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:19.771988 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-58e9d641-eef9-4427-8b03-830554271c55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4571ff0de0f3460cbd122222fa652641', 'request_id': 'req-58e9d641-eef9-4427-8b03-830554271c55'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:19.777599 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-58e9d641-eef9-4427-8b03-830554271c55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4571ff0de0f3460cbd122222fa652641', 'request_id': 'req-58e9d641-eef9-4427-8b03-830554271c55'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:19.793365 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-58e9d641-eef9-4427-8b03-830554271c55 admin admin] The token cache is being invalidate because project 4571ff0de0f3460cbd122222fa652641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:55:19.793648 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-58e9d641-eef9-4427-8b03-830554271c55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:19.794258 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-58e9d641-eef9-4427-8b03-830554271c55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:19.795738 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1166/2334] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:55:19 2021] DELETE /identity/v3/projects/4571ff0de0f3460cbd122222fa652641 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:55:19.801373 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6d864-fa09-4574-9b61-506d40523ab4 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:19.801676 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6d864-fa09-4574-9b61-506d40523ab4 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:19.801986 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6d864-fa09-4574-9b61-506d40523ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:19.861776 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-01d6d864-fa09-4574-9b61-506d40523ab4 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:19.862864 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-01d6d864-fa09-4574-9b61-506d40523ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:19.925895 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1169/2335] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:55:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:19.934162 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8da18-5447-4530-8050-f28c87a8fea1 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:19.934456 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8da18-5447-4530-8050-f28c87a8fea1 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:19.934776 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8da18-5447-4530-8050-f28c87a8fea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:19.957223 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-9aa8da18-5447-4530-8050-f28c87a8fea1 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:19.958365 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-9aa8da18-5447-4530-8050-f28c87a8fea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:19.967890 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1167/2336] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:55:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:19.972052 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6d864-fa09-4574-9b61-506d40523ab4 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:19.981654 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6d864-fa09-4574-9b61-506d40523ab4 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:19.985759 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ae827-8e6c-46a4-9eb0-a78d96e2f614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:19.986334 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ae827-8e6c-46a4-9eb0-a78d96e2f614 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:19.986625 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ae827-8e6c-46a4-9eb0-a78d96e2f614 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:19.986946 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ae827-8e6c-46a4-9eb0-a78d96e2f614 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:19.987636 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ae827-8e6c-46a4-9eb0-a78d96e2f614 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:55:19.987933 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ae827-8e6c-46a4-9eb0-a78d96e2f614 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:20.015235 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ae827-8e6c-46a4-9eb0-a78d96e2f614 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:20.031114 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1170/2337] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:55:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:55:20.035666 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8da18-5447-4530-8050-f28c87a8fea1 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:20.044774 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8da18-5447-4530-8050-f28c87a8fea1 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:20.048990 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a7770-54a3-46a3-ba90-3040c15bffa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:20.049576 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a7770-54a3-46a3-ba90-3040c15bffa5 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:20.049871 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a7770-54a3-46a3-ba90-3040c15bffa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:20.050151 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a7770-54a3-46a3-ba90-3040c15bffa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:20.050819 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a7770-54a3-46a3-ba90-3040c15bffa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:20.077879 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a7770-54a3-46a3-ba90-3040c15bffa5 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:20.107966 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1168/2338] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:55:20 2021] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:55:20.109431 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ae827-8e6c-46a4-9eb0-a78d96e2f614 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:20.119745 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ae827-8e6c-46a4-9eb0-a78d96e2f614 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:20.188901 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15c3dc-e6a2-4af8-8a15-cffcfaa19b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:20.189506 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15c3dc-e6a2-4af8-8a15-cffcfaa19b0d admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:20.189794 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15c3dc-e6a2-4af8-8a15-cffcfaa19b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:20.190079 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15c3dc-e6a2-4af8-8a15-cffcfaa19b0d admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:20.190953 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15c3dc-e6a2-4af8-8a15-cffcfaa19b0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:20.220123 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15c3dc-e6a2-4af8-8a15-cffcfaa19b0d admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:20.242106 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1171/2339] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:55:20 2021] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:55:20.246335 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a7770-54a3-46a3-ba90-3040c15bffa5 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:20.256538 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a7770-54a3-46a3-ba90-3040c15bffa5 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:20.261973 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a527a2b-b419-46c8-aa4d-98028a576ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:20.261973 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a527a2b-b419-46c8-aa4d-98028a576ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:20.261973 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a527a2b-b419-46c8-aa4d-98028a576ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:20.262306 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a527a2b-b419-46c8-aa4d-98028a576ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:20.263090 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a527a2b-b419-46c8-aa4d-98028a576ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:20.289553 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a527a2b-b419-46c8-aa4d-98028a576ee8 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:20.300430 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1169/2340] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:55:20 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:55:20.305182 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15c3dc-e6a2-4af8-8a15-cffcfaa19b0d admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:20.328687 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15c3dc-e6a2-4af8-8a15-cffcfaa19b0d admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:20.339082 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653657f7-661c-4cbf-9621-2f98c277c3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:20.339889 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653657f7-661c-4cbf-9621-2f98c277c3f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:20.340207 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653657f7-661c-4cbf-9621-2f98c277c3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:20.340513 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653657f7-661c-4cbf-9621-2f98c277c3f7 admin admin] PATH_INFO: `/v3/projects/5a99266b7d254d309f74bf744c238286/users/445e178244b84be59356dcdf6db24114/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:20.363176 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653657f7-661c-4cbf-9621-2f98c277c3f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a99266b7d254d309f74bf744c238286, user_id=445e178244b84be59356dcdf6db24114, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:20.391557 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653657f7-661c-4cbf-9621-2f98c277c3f7 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:20.416673 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1172/2341] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:55:20 2021] PUT /identity/v3/projects/5a99266b7d254d309f74bf744c238286/users/445e178244b84be59356dcdf6db24114/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:55:20.430876 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a7087-f5fa-45d6-8851-099db09cba5f None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:20.431267 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a7087-f5fa-45d6-8851-099db09cba5f None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:20.431556 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a7087-f5fa-45d6-8851-099db09cba5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:20.478369 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-5a3a7087-f5fa-45d6-8851-099db09cba5f None None] MFA Rules not processed for user `445e178244b84be59356dcdf6db24114`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:20.479665 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-5a3a7087-f5fa-45d6-8851-099db09cba5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:20.550987 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1170/2342] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:55:20 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:20.561599 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653657f7-661c-4cbf-9621-2f98c277c3f7 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:20.563198 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-653657f7-661c-4cbf-9621-2f98c277c3f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:20.638293 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653657f7-661c-4cbf-9621-2f98c277c3f7 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:20.642897 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535d9ec-6479-4e39-8718-6f8e8deae2a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:20.644145 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535d9ec-6479-4e39-8718-6f8e8deae2a2 service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:20.644616 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535d9ec-6479-4e39-8718-6f8e8deae2a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:20.644968 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535d9ec-6479-4e39-8718-6f8e8deae2a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:20.655592 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535d9ec-6479-4e39-8718-6f8e8deae2a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:20.683998 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535d9ec-6479-4e39-8718-6f8e8deae2a2 service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:20.695015 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1173/2343] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:55:20 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:55:23.346048 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a7087-f5fa-45d6-8851-099db09cba5f None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:23.347397 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-5a3a7087-f5fa-45d6-8851-099db09cba5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:23.410825 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a7087-f5fa-45d6-8851-099db09cba5f None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:23.415377 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268ebee-be67-4ab4-8d52-41f70632cbdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:23.416041 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268ebee-be67-4ab4-8d52-41f70632cbdd service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:23.416331 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268ebee-be67-4ab4-8d52-41f70632cbdd service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:23.416625 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268ebee-be67-4ab4-8d52-41f70632cbdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:23.418279 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-1268ebee-be67-4ab4-8d52-41f70632cbdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:23.491488 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268ebee-be67-4ab4-8d52-41f70632cbdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:23.517115 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268ebee-be67-4ab4-8d52-41f70632cbdd service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:23.528361 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1171/2344] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:55:23 2021] GET /identity/v3/auth/tokens => generated 3751 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:55:23.671282 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535d9ec-6479-4e39-8718-6f8e8deae2a2 service cinder] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:23.759426 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535d9ec-6479-4e39-8718-6f8e8deae2a2 service cinder] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:23.771367 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fae86f-64f1-4add-b3ae-97b450dd730e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:23.772219 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fae86f-64f1-4add-b3ae-97b450dd730e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:23.772552 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fae86f-64f1-4add-b3ae-97b450dd730e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:23.772975 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fae86f-64f1-4add-b3ae-97b450dd730e admin admin] PATH_INFO: `/v3/users/445e178244b84be59356dcdf6db24114` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:23.774086 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fae86f-64f1-4add-b3ae-97b450dd730e admin admin] RBAC: Authorizing `identity:delete_user(user_id=445e178244b84be59356dcdf6db24114)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:23.799949 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fae86f-64f1-4add-b3ae-97b450dd730e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:23.855456 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-b8fae86f-64f1-4add-b3ae-97b450dd730e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '445e178244b84be59356dcdf6db24114'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:23.869767 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-b8fae86f-64f1-4add-b3ae-97b450dd730e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '445e178244b84be59356dcdf6db24114'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:23.870778 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-b8fae86f-64f1-4add-b3ae-97b450dd730e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '445e178244b84be59356dcdf6db24114'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:23.879135 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-b8fae86f-64f1-4add-b3ae-97b450dd730e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '445e178244b84be59356dcdf6db24114'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:23.889604 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-b8fae86f-64f1-4add-b3ae-97b450dd730e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '445e178244b84be59356dcdf6db24114'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:23.897706 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1174/2345] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:55:23 2021] DELETE /identity/v3/users/445e178244b84be59356dcdf6db24114 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:55:23.902139 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e94d14-e690-4480-ba89-9986aa4b03e2 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:23.902432 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e94d14-e690-4480-ba89-9986aa4b03e2 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:23.902733 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e94d14-e690-4480-ba89-9986aa4b03e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:23.933322 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-43e94d14-e690-4480-ba89-9986aa4b03e2 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:23.934633 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-43e94d14-e690-4480-ba89-9986aa4b03e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:24.028615 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1172/2346] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:55:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:24.042126 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fae86f-64f1-4add-b3ae-97b450dd730e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:24.043795 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-b8fae86f-64f1-4add-b3ae-97b450dd730e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:24.128599 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fae86f-64f1-4add-b3ae-97b450dd730e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:24.132499 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff97a7-008a-436a-9f00-dff6a472f626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:24.133070 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff97a7-008a-436a-9f00-dff6a472f626 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:24.133387 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff97a7-008a-436a-9f00-dff6a472f626 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:24.133665 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff97a7-008a-436a-9f00-dff6a472f626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:24.142977 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff97a7-008a-436a-9f00-dff6a472f626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:24.168002 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff97a7-008a-436a-9f00-dff6a472f626 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:24.177927 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1175/2347] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:55:24 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:55:24.578830 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e94d14-e690-4480-ba89-9986aa4b03e2 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:24.580697 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-43e94d14-e690-4480-ba89-9986aa4b03e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:24.592400 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e94d14-e690-4480-ba89-9986aa4b03e2 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:24.599426 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedddbe1-05cc-4c9e-923c-f772a3657a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:24.600491 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedddbe1-05cc-4c9e-923c-f772a3657a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:24.601018 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedddbe1-05cc-4c9e-923c-f772a3657a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:24.601298 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedddbe1-05cc-4c9e-923c-f772a3657a9a admin admin] PATH_INFO: `/v3/projects/5a99266b7d254d309f74bf744c238286` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:24.602711 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedddbe1-05cc-4c9e-923c-f772a3657a9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a99266b7d254d309f74bf744c238286)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:24.629854 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedddbe1-05cc-4c9e-923c-f772a3657a9a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:24.696442 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-cedddbe1-05cc-4c9e-923c-f772a3657a9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a99266b7d254d309f74bf744c238286', 'request_id': 'req-cedddbe1-05cc-4c9e-923c-f772a3657a9a'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:24.707261 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-cedddbe1-05cc-4c9e-923c-f772a3657a9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a99266b7d254d309f74bf744c238286', 'request_id': 'req-cedddbe1-05cc-4c9e-923c-f772a3657a9a'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:24.716126 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-cedddbe1-05cc-4c9e-923c-f772a3657a9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a99266b7d254d309f74bf744c238286', 'request_id': 'req-cedddbe1-05cc-4c9e-923c-f772a3657a9a'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:24.737497 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-cedddbe1-05cc-4c9e-923c-f772a3657a9a admin admin] The token cache is being invalidate because project 5a99266b7d254d309f74bf744c238286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:55:24.737870 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-cedddbe1-05cc-4c9e-923c-f772a3657a9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:24.738420 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-cedddbe1-05cc-4c9e-923c-f772a3657a9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:24.740110 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1173/2348] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:55:24 2021] DELETE /identity/v3/projects/5a99266b7d254d309f74bf744c238286 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:55:24.746308 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4307cd-3ae6-489e-9945-d96cc514911c None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:24.748755 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4307cd-3ae6-489e-9945-d96cc514911c None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:24.749298 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4307cd-3ae6-489e-9945-d96cc514911c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:24.780260 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-cb4307cd-3ae6-489e-9945-d96cc514911c None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:24.782206 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-cb4307cd-3ae6-489e-9945-d96cc514911c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:24.904354 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1176/2349] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:55:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:24.912108 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf3cb9-10a9-4953-a668-90c165bb0600 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:24.912407 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf3cb9-10a9-4953-a668-90c165bb0600 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:24.912768 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf3cb9-10a9-4953-a668-90c165bb0600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:24.936985 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-0ddf3cb9-10a9-4953-a668-90c165bb0600 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:24.938148 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-0ddf3cb9-10a9-4953-a668-90c165bb0600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:24.946830 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1174/2350] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:55:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:24.950786 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4307cd-3ae6-489e-9945-d96cc514911c None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:24.961042 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4307cd-3ae6-489e-9945-d96cc514911c None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:24.965672 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319498e-5213-4306-a340-c24606938f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:24.966288 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319498e-5213-4306-a340-c24606938f9c admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:24.966583 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319498e-5213-4306-a340-c24606938f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:24.967408 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319498e-5213-4306-a340-c24606938f9c admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:24.967629 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319498e-5213-4306-a340-c24606938f9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:55:24.967948 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319498e-5213-4306-a340-c24606938f9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:24.995951 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319498e-5213-4306-a340-c24606938f9c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:25.012657 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1177/2351] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:55:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:55:25.016831 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf3cb9-10a9-4953-a668-90c165bb0600 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:25.028715 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf3cb9-10a9-4953-a668-90c165bb0600 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:25.042495 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb2161-99c1-4405-918d-8199040c246a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:25.043148 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb2161-99c1-4405-918d-8199040c246a admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:25.043433 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb2161-99c1-4405-918d-8199040c246a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:25.043717 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb2161-99c1-4405-918d-8199040c246a admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:25.044365 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb2161-99c1-4405-918d-8199040c246a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:25.080093 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb2161-99c1-4405-918d-8199040c246a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:25.137686 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1175/2352] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:55:25 2021] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:55:25.141802 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319498e-5213-4306-a340-c24606938f9c admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:25.162695 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319498e-5213-4306-a340-c24606938f9c admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:25.253437 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd6555-79da-45b9-9db2-a3f1a457d123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:25.254057 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd6555-79da-45b9-9db2-a3f1a457d123 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:25.254388 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd6555-79da-45b9-9db2-a3f1a457d123 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:25.254792 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd6555-79da-45b9-9db2-a3f1a457d123 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:25.255500 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd6555-79da-45b9-9db2-a3f1a457d123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:25.281487 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd6555-79da-45b9-9db2-a3f1a457d123 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:25.302696 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1178/2353] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:55:25 2021] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:55:25.306738 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb2161-99c1-4405-918d-8199040c246a admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:25.317827 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb2161-99c1-4405-918d-8199040c246a admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:25.323246 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f34fe2-55ae-49b1-8358-3fba45ff6c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:25.323918 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f34fe2-55ae-49b1-8358-3fba45ff6c75 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:25.324280 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f34fe2-55ae-49b1-8358-3fba45ff6c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:25.324633 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f34fe2-55ae-49b1-8358-3fba45ff6c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:25.325506 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f34fe2-55ae-49b1-8358-3fba45ff6c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:25.351672 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f34fe2-55ae-49b1-8358-3fba45ff6c75 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:25.362280 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1176/2354] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:55:25 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:55:25.367783 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd6555-79da-45b9-9db2-a3f1a457d123 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:25.377860 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd6555-79da-45b9-9db2-a3f1a457d123 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:25.384450 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b796c-ff5a-4e6c-8b6f-4572ac7eeade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:25.385362 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b796c-ff5a-4e6c-8b6f-4572ac7eeade admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:25.385743 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b796c-ff5a-4e6c-8b6f-4572ac7eeade admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:25.386116 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b796c-ff5a-4e6c-8b6f-4572ac7eeade admin admin] PATH_INFO: `/v3/projects/b82d8e5fb4c648019d4b3875da92adfd/users/967d5285cbd443bc83f0330fa5867032/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:25.416783 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b796c-ff5a-4e6c-8b6f-4572ac7eeade admin admin] RBAC: Authorizing `identity:create_grant(project_id=b82d8e5fb4c648019d4b3875da92adfd, user_id=967d5285cbd443bc83f0330fa5867032, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:25.445658 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b796c-ff5a-4e6c-8b6f-4572ac7eeade admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:25.460851 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1179/2355] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:55:25 2021] PUT /identity/v3/projects/b82d8e5fb4c648019d4b3875da92adfd/users/967d5285cbd443bc83f0330fa5867032/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:55:25.471649 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ec74f-4438-48ca-9876-fe74326bab95 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:25.471950 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ec74f-4438-48ca-9876-fe74326bab95 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:25.472282 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ec74f-4438-48ca-9876-fe74326bab95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:25.512072 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-5b7ec74f-4438-48ca-9876-fe74326bab95 None None] MFA Rules not processed for user `967d5285cbd443bc83f0330fa5867032`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:25.513245 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-5b7ec74f-4438-48ca-9876-fe74326bab95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:25.590474 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1177/2356] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:55:25 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:25.599865 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b796c-ff5a-4e6c-8b6f-4572ac7eeade admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:25.601531 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-fa7b796c-ff5a-4e6c-8b6f-4572ac7eeade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:25.668464 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b796c-ff5a-4e6c-8b6f-4572ac7eeade admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:25.675029 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1649aa8-9375-4c8a-b33d-bb639db8ea6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:25.675959 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1649aa8-9375-4c8a-b33d-bb639db8ea6b service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:25.676671 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1649aa8-9375-4c8a-b33d-bb639db8ea6b service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:25.676991 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1649aa8-9375-4c8a-b33d-bb639db8ea6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:25.687019 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1649aa8-9375-4c8a-b33d-bb639db8ea6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:25.713589 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1649aa8-9375-4c8a-b33d-bb639db8ea6b service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:25.723020 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1180/2357] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:55:25 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:55:35.547403 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ec74f-4438-48ca-9876-fe74326bab95 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:35.548771 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-5b7ec74f-4438-48ca-9876-fe74326bab95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:35.623599 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ec74f-4438-48ca-9876-fe74326bab95 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:35.627832 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8411c7-0043-4a0d-85da-1fd973042604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:35.628615 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8411c7-0043-4a0d-85da-1fd973042604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:35.628906 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8411c7-0043-4a0d-85da-1fd973042604 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:35.629191 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8411c7-0043-4a0d-85da-1fd973042604 admin admin] PATH_INFO: `/v3/users/e8cf467bd7664df4a7f9d8c45f12a1dd` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:35.630283 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8411c7-0043-4a0d-85da-1fd973042604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8cf467bd7664df4a7f9d8c45f12a1dd)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:35.660837 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8411c7-0043-4a0d-85da-1fd973042604 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:35.714801 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-3b8411c7-0043-4a0d-85da-1fd973042604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8cf467bd7664df4a7f9d8c45f12a1dd'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:35.716850 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-3b8411c7-0043-4a0d-85da-1fd973042604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8cf467bd7664df4a7f9d8c45f12a1dd'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:35.723540 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-3b8411c7-0043-4a0d-85da-1fd973042604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8cf467bd7664df4a7f9d8c45f12a1dd'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:35.737999 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-3b8411c7-0043-4a0d-85da-1fd973042604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8cf467bd7664df4a7f9d8c45f12a1dd'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:35.748410 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-3b8411c7-0043-4a0d-85da-1fd973042604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8cf467bd7664df4a7f9d8c45f12a1dd'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:35.755097 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1178/2358] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:55:35 2021] DELETE /identity/v3/users/e8cf467bd7664df4a7f9d8c45f12a1dd => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:55:35.992192 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1649aa8-9375-4c8a-b33d-bb639db8ea6b service cinder] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:36.009999 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1649aa8-9375-4c8a-b33d-bb639db8ea6b service cinder] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:36.088256 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f2e8f-512e-4839-a39e-d8742606de76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:36.089067 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f2e8f-512e-4839-a39e-d8742606de76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:36.089354 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f2e8f-512e-4839-a39e-d8742606de76 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:36.089633 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f2e8f-512e-4839-a39e-d8742606de76 admin admin] PATH_INFO: `/v3/projects/d83bfebda32544d0821c5e2cc15c6d4d` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:36.090827 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f2e8f-512e-4839-a39e-d8742606de76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d83bfebda32544d0821c5e2cc15c6d4d)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:36.119874 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f2e8f-512e-4839-a39e-d8742606de76 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:36.170290 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-876f2e8f-512e-4839-a39e-d8742606de76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd83bfebda32544d0821c5e2cc15c6d4d', 'request_id': 'req-876f2e8f-512e-4839-a39e-d8742606de76'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:36.180132 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-876f2e8f-512e-4839-a39e-d8742606de76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd83bfebda32544d0821c5e2cc15c6d4d', 'request_id': 'req-876f2e8f-512e-4839-a39e-d8742606de76'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:36.192202 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-876f2e8f-512e-4839-a39e-d8742606de76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd83bfebda32544d0821c5e2cc15c6d4d', 'request_id': 'req-876f2e8f-512e-4839-a39e-d8742606de76'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:36.204914 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-876f2e8f-512e-4839-a39e-d8742606de76 admin admin] The token cache is being invalidate because project d83bfebda32544d0821c5e2cc15c6d4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:55:36.205198 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-876f2e8f-512e-4839-a39e-d8742606de76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:36.205950 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-876f2e8f-512e-4839-a39e-d8742606de76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:36.208133 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1181/2359] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:55:35 2021] DELETE /identity/v3/projects/d83bfebda32544d0821c5e2cc15c6d4d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:55:36.214009 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed8041-2ff1-4d69-8b04-5fe4e4ed1cf9 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:36.214301 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed8041-2ff1-4d69-8b04-5fe4e4ed1cf9 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:36.214581 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed8041-2ff1-4d69-8b04-5fe4e4ed1cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:36.239354 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-3aed8041-2ff1-4d69-8b04-5fe4e4ed1cf9 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:36.241331 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-3aed8041-2ff1-4d69-8b04-5fe4e4ed1cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:36.319813 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1179/2360] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:55:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:36.327509 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39504088-7985-45d8-af7b-37d9e22c1bb7 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:36.327867 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39504088-7985-45d8-af7b-37d9e22c1bb7 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:36.328216 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39504088-7985-45d8-af7b-37d9e22c1bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:36.350647 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-39504088-7985-45d8-af7b-37d9e22c1bb7 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:36.351928 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-39504088-7985-45d8-af7b-37d9e22c1bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:36.359672 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1182/2361] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:55:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:36.363813 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed8041-2ff1-4d69-8b04-5fe4e4ed1cf9 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:36.373581 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed8041-2ff1-4d69-8b04-5fe4e4ed1cf9 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:36.378218 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8185e-f446-41fe-98ff-06645b896add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:36.378918 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8185e-f446-41fe-98ff-06645b896add admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:36.379306 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8185e-f446-41fe-98ff-06645b896add admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:36.379690 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8185e-f446-41fe-98ff-06645b896add admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:36.380475 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8185e-f446-41fe-98ff-06645b896add admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:55:36.381373 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8185e-f446-41fe-98ff-06645b896add admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:36.407490 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8185e-f446-41fe-98ff-06645b896add admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:36.420477 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1180/2362] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:55:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:55:36.424966 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39504088-7985-45d8-af7b-37d9e22c1bb7 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:36.434128 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39504088-7985-45d8-af7b-37d9e22c1bb7 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:36.438583 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6bb22-2a34-4223-b73c-0b7b0f7cdfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:36.439207 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6bb22-2a34-4223-b73c-0b7b0f7cdfbc admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:36.439485 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6bb22-2a34-4223-b73c-0b7b0f7cdfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:36.439770 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6bb22-2a34-4223-b73c-0b7b0f7cdfbc admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:36.440393 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6bb22-2a34-4223-b73c-0b7b0f7cdfbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:36.467181 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6bb22-2a34-4223-b73c-0b7b0f7cdfbc admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:36.493448 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1183/2363] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:55:36 2021] POST /identity/v3/projects => generated 401 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:55:36.497381 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8185e-f446-41fe-98ff-06645b896add admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:36.507538 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8185e-f446-41fe-98ff-06645b896add admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:36.570254 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53890ae0-a31a-4ade-9e35-5215c2d2597c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:36.570914 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53890ae0-a31a-4ade-9e35-5215c2d2597c admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:36.571169 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53890ae0-a31a-4ade-9e35-5215c2d2597c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:36.571431 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53890ae0-a31a-4ade-9e35-5215c2d2597c admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:36.572090 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53890ae0-a31a-4ade-9e35-5215c2d2597c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:36.598076 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53890ae0-a31a-4ade-9e35-5215c2d2597c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:36.617103 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1181/2364] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:55:36 2021] POST /identity/v3/users => generated 301 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:55:36.621139 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6bb22-2a34-4223-b73c-0b7b0f7cdfbc admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:36.630701 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6bb22-2a34-4223-b73c-0b7b0f7cdfbc admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:36.635302 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360ada2-fffc-40eb-92ba-0e47328c40ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:36.635881 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360ada2-fffc-40eb-92ba-0e47328c40ac admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:36.636165 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360ada2-fffc-40eb-92ba-0e47328c40ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:36.636442 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360ada2-fffc-40eb-92ba-0e47328c40ac admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:36.637122 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360ada2-fffc-40eb-92ba-0e47328c40ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:36.662570 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360ada2-fffc-40eb-92ba-0e47328c40ac admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:36.672671 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1184/2365] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:55:36 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:55:36.676883 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53890ae0-a31a-4ade-9e35-5215c2d2597c admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:36.686835 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53890ae0-a31a-4ade-9e35-5215c2d2597c admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:36.691009 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afc9a3-9e7d-4bc1-86a1-5f985c7c3d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:36.691821 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afc9a3-9e7d-4bc1-86a1-5f985c7c3d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:36.692109 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afc9a3-9e7d-4bc1-86a1-5f985c7c3d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:36.692390 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afc9a3-9e7d-4bc1-86a1-5f985c7c3d7b admin admin] PATH_INFO: `/v3/projects/80103f212ac841a59726a303563f9180/users/3b8c7bc8563d4f31886c27a0e9cb3873/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:36.713748 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6afc9a3-9e7d-4bc1-86a1-5f985c7c3d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=80103f212ac841a59726a303563f9180, user_id=3b8c7bc8563d4f31886c27a0e9cb3873, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:36.740650 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6afc9a3-9e7d-4bc1-86a1-5f985c7c3d7b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:36.752603 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1182/2366] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:55:36 2021] PUT /identity/v3/projects/80103f212ac841a59726a303563f9180/users/3b8c7bc8563d4f31886c27a0e9cb3873/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:55:36.763082 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617974e0-ac2e-45fa-a54b-c74dec49b79e None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:36.763376 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617974e0-ac2e-45fa-a54b-c74dec49b79e None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:36.763662 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617974e0-ac2e-45fa-a54b-c74dec49b79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:36.799589 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-617974e0-ac2e-45fa-a54b-c74dec49b79e None None] MFA Rules not processed for user `3b8c7bc8563d4f31886c27a0e9cb3873`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:36.800728 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-617974e0-ac2e-45fa-a54b-c74dec49b79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:36.873468 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1185/2367] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:55:36 2021] POST /identity/v3/auth/tokens => generated 3708 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:36.877851 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afc9a3-9e7d-4bc1-86a1-5f985c7c3d7b admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:36.947388 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afc9a3-9e7d-4bc1-86a1-5f985c7c3d7b admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:36.951608 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f86e55-400f-41f0-a666-30f687201dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:36.952217 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f86e55-400f-41f0-a666-30f687201dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:36.952507 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f86e55-400f-41f0-a666-30f687201dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:36.952791 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f86e55-400f-41f0-a666-30f687201dc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:36.953468 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f86e55-400f-41f0-a666-30f687201dc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:36.979577 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f86e55-400f-41f0-a666-30f687201dc4 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:37.004769 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1183/2368] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:55:36 2021] POST /identity/v3/projects => generated 403 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:55:37.008708 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617974e0-ac2e-45fa-a54b-c74dec49b79e None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:37.019256 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617974e0-ac2e-45fa-a54b-c74dec49b79e None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:37.081549 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fa714-5808-4a23-9eeb-55ca72a86815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:37.082176 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fa714-5808-4a23-9eeb-55ca72a86815 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:37.082467 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fa714-5808-4a23-9eeb-55ca72a86815 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:37.082781 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fa714-5808-4a23-9eeb-55ca72a86815 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:37.083418 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7fa714-5808-4a23-9eeb-55ca72a86815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:37.109876 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7fa714-5808-4a23-9eeb-55ca72a86815 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:37.133522 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1186/2369] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:55:37 2021] POST /identity/v3/users => generated 308 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:55:37.134696 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f86e55-400f-41f0-a666-30f687201dc4 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:37.144926 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f86e55-400f-41f0-a666-30f687201dc4 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:37.154359 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77120733-035c-46e7-85d5-56739efae557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:37.155766 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77120733-035c-46e7-85d5-56739efae557 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:37.156120 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77120733-035c-46e7-85d5-56739efae557 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:37.156467 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77120733-035c-46e7-85d5-56739efae557 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:37.157379 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77120733-035c-46e7-85d5-56739efae557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:37.185865 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77120733-035c-46e7-85d5-56739efae557 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:37.197667 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1184/2370] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:55:37 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:55:37.201859 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fa714-5808-4a23-9eeb-55ca72a86815 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:37.211694 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fa714-5808-4a23-9eeb-55ca72a86815 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:37.215973 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c489a-fe18-4115-a7a4-a0c96dd119ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:37.216779 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c489a-fe18-4115-a7a4-a0c96dd119ec admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:37.217227 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c489a-fe18-4115-a7a4-a0c96dd119ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:37.217545 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c489a-fe18-4115-a7a4-a0c96dd119ec admin admin] PATH_INFO: `/v3/projects/5334203f290245b88d5c5a1018b39849/users/f31772b7d257409a9c400dbfa7ee0a12/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:37.241504 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c489a-fe18-4115-a7a4-a0c96dd119ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5334203f290245b88d5c5a1018b39849, user_id=f31772b7d257409a9c400dbfa7ee0a12, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:37.274863 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c489a-fe18-4115-a7a4-a0c96dd119ec admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:37.288050 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1187/2371] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:55:37 2021] PUT /identity/v3/projects/5334203f290245b88d5c5a1018b39849/users/f31772b7d257409a9c400dbfa7ee0a12/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:55:37.291955 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77120733-035c-46e7-85d5-56739efae557 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:37.301145 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77120733-035c-46e7-85d5-56739efae557 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:37.367760 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e604e7-3302-43e7-b1fa-371315e93097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:37.368429 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e604e7-3302-43e7-b1fa-371315e93097 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:37.368896 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e604e7-3302-43e7-b1fa-371315e93097 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:37.369245 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e604e7-3302-43e7-b1fa-371315e93097 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:37.370010 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e604e7-3302-43e7-b1fa-371315e93097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:37.396469 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e604e7-3302-43e7-b1fa-371315e93097 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:37.407626 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1185/2372] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:55:37 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:55:37.411654 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c489a-fe18-4115-a7a4-a0c96dd119ec admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:37.421527 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c489a-fe18-4115-a7a4-a0c96dd119ec admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:37.426774 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497f030-e473-48da-9e24-cda18138fe79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:37.429215 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497f030-e473-48da-9e24-cda18138fe79 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:37.429509 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497f030-e473-48da-9e24-cda18138fe79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:37.429794 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497f030-e473-48da-9e24-cda18138fe79 admin admin] PATH_INFO: `/v3/projects/5334203f290245b88d5c5a1018b39849/users/f31772b7d257409a9c400dbfa7ee0a12/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:37.431793 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497f030-e473-48da-9e24-cda18138fe79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5334203f290245b88d5c5a1018b39849, user_id=f31772b7d257409a9c400dbfa7ee0a12, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:37.460981 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497f030-e473-48da-9e24-cda18138fe79 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:37.471719 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1188/2373] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:55:37 2021] PUT /identity/v3/projects/5334203f290245b88d5c5a1018b39849/users/f31772b7d257409a9c400dbfa7ee0a12/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:55:37.475983 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e604e7-3302-43e7-b1fa-371315e93097 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:37.486370 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e604e7-3302-43e7-b1fa-371315e93097 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:37.567671 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8944dd7-86ef-4646-bdca-99f9bc83e5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:37.568852 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8944dd7-86ef-4646-bdca-99f9bc83e5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:37.569191 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8944dd7-86ef-4646-bdca-99f9bc83e5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:37.569551 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8944dd7-86ef-4646-bdca-99f9bc83e5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:37.570696 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8944dd7-86ef-4646-bdca-99f9bc83e5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:37.601779 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8944dd7-86ef-4646-bdca-99f9bc83e5f9 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:37.612163 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1186/2374] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:55:37 2021] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:55:37.616533 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497f030-e473-48da-9e24-cda18138fe79 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:37.626094 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497f030-e473-48da-9e24-cda18138fe79 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:37.630454 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae4cf5-479b-4b3d-8466-4d271356e877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:37.632703 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae4cf5-479b-4b3d-8466-4d271356e877 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:37.633012 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae4cf5-479b-4b3d-8466-4d271356e877 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:37.634059 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae4cf5-479b-4b3d-8466-4d271356e877 admin admin] PATH_INFO: `/v3/projects/5334203f290245b88d5c5a1018b39849/users/f31772b7d257409a9c400dbfa7ee0a12/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:37.635398 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae4cf5-479b-4b3d-8466-4d271356e877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5334203f290245b88d5c5a1018b39849, user_id=f31772b7d257409a9c400dbfa7ee0a12, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:37.662893 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae4cf5-479b-4b3d-8466-4d271356e877 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:37.676960 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1189/2375] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:55:37 2021] PUT /identity/v3/projects/5334203f290245b88d5c5a1018b39849/users/f31772b7d257409a9c400dbfa7ee0a12/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:55:37.688437 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54781af0-3f9d-4fec-a788-8ef7375875e6 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:37.688733 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54781af0-3f9d-4fec-a788-8ef7375875e6 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:37.689042 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54781af0-3f9d-4fec-a788-8ef7375875e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:37.726147 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-54781af0-3f9d-4fec-a788-8ef7375875e6 None None] MFA Rules not processed for user `f31772b7d257409a9c400dbfa7ee0a12`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:37.727333 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-54781af0-3f9d-4fec-a788-8ef7375875e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:37.801604 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1187/2376] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:55:37 2021] POST /identity/v3/auth/tokens => generated 3777 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:37.811195 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae4cf5-479b-4b3d-8466-4d271356e877 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:37.812746 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-ceae4cf5-479b-4b3d-8466-4d271356e877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:37.878779 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae4cf5-479b-4b3d-8466-4d271356e877 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:37.882682 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe7fce-bda5-43b6-affa-5522993248e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:37.883289 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe7fce-bda5-43b6-affa-5522993248e2 service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:37.883578 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe7fce-bda5-43b6-affa-5522993248e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:37.883861 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe7fce-bda5-43b6-affa-5522993248e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:37.892821 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe7fce-bda5-43b6-affa-5522993248e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:37.918916 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe7fce-bda5-43b6-affa-5522993248e2 service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:37.928570 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1190/2377] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:55:37 2021] GET /identity/v3/auth/tokens => generated 3777 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:55:38.063039 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54781af0-3f9d-4fec-a788-8ef7375875e6 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:38.212626 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54781af0-3f9d-4fec-a788-8ef7375875e6 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:38.216723 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c005f-8391-485b-8786-b6568994517a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:38.217522 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c005f-8391-485b-8786-b6568994517a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:38.217808 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c005f-8391-485b-8786-b6568994517a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:38.218086 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c005f-8391-485b-8786-b6568994517a admin admin] PATH_INFO: `/v3/users/3b8c7bc8563d4f31886c27a0e9cb3873` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:38.219185 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c005f-8391-485b-8786-b6568994517a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b8c7bc8563d4f31886c27a0e9cb3873)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:38.245132 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c005f-8391-485b-8786-b6568994517a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:38.292091 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-3e3c005f-8391-485b-8786-b6568994517a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b8c7bc8563d4f31886c27a0e9cb3873'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:38.292753 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-3e3c005f-8391-485b-8786-b6568994517a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b8c7bc8563d4f31886c27a0e9cb3873'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:38.300182 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-3e3c005f-8391-485b-8786-b6568994517a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b8c7bc8563d4f31886c27a0e9cb3873'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:38.311862 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-3e3c005f-8391-485b-8786-b6568994517a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b8c7bc8563d4f31886c27a0e9cb3873'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:38.319297 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-3e3c005f-8391-485b-8786-b6568994517a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b8c7bc8563d4f31886c27a0e9cb3873'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:38.324917 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1188/2378] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:55:38 2021] DELETE /identity/v3/users/3b8c7bc8563d4f31886c27a0e9cb3873 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:55:38.329454 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c6ab4-94bd-4631-8ba5-c57528bf94c6 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:38.329930 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c6ab4-94bd-4631-8ba5-c57528bf94c6 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:38.330072 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c6ab4-94bd-4631-8ba5-c57528bf94c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:38.351420 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-325c6ab4-94bd-4631-8ba5-c57528bf94c6 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:38.352543 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-325c6ab4-94bd-4631-8ba5-c57528bf94c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:38.405896 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c005f-8391-485b-8786-b6568994517a admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:38.407240 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-3e3c005f-8391-485b-8786-b6568994517a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:38.417591 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1191/2379] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:55:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:38.427355 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c6ab4-94bd-4631-8ba5-c57528bf94c6 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:38.429166 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-325c6ab4-94bd-4631-8ba5-c57528bf94c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:38.481444 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c005f-8391-485b-8786-b6568994517a admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:38.486261 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89933c2-cef6-458d-bc8b-ad9044fdf8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:38.487089 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89933c2-cef6-458d-bc8b-ad9044fdf8a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:38.487375 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89933c2-cef6-458d-bc8b-ad9044fdf8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:38.487655 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89933c2-cef6-458d-bc8b-ad9044fdf8a8 admin admin] PATH_INFO: `/v3/users/967d5285cbd443bc83f0330fa5867032` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:38.488753 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89933c2-cef6-458d-bc8b-ad9044fdf8a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=967d5285cbd443bc83f0330fa5867032)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:38.495547 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c6ab4-94bd-4631-8ba5-c57528bf94c6 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:38.499011 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d6a8d-e7cf-4aad-ab0b-b4292a41b728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:38.499659 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d6a8d-e7cf-4aad-ab0b-b4292a41b728 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:38.500049 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d6a8d-e7cf-4aad-ab0b-b4292a41b728 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:38.500379 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d6a8d-e7cf-4aad-ab0b-b4292a41b728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:38.509979 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d6a8d-e7cf-4aad-ab0b-b4292a41b728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:38.515705 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89933c2-cef6-458d-bc8b-ad9044fdf8a8 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:38.537701 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d6a8d-e7cf-4aad-ab0b-b4292a41b728 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:38.546429 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1192/2380] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:55:38 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:55:38.571253 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f89933c2-cef6-458d-bc8b-ad9044fdf8a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '967d5285cbd443bc83f0330fa5867032'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:38.571888 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f89933c2-cef6-458d-bc8b-ad9044fdf8a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '967d5285cbd443bc83f0330fa5867032'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:38.579669 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f89933c2-cef6-458d-bc8b-ad9044fdf8a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '967d5285cbd443bc83f0330fa5867032'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:38.592234 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f89933c2-cef6-458d-bc8b-ad9044fdf8a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '967d5285cbd443bc83f0330fa5867032'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:38.600287 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f89933c2-cef6-458d-bc8b-ad9044fdf8a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '967d5285cbd443bc83f0330fa5867032'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:38.609902 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1189/2381] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:55:38 2021] DELETE /identity/v3/users/967d5285cbd443bc83f0330fa5867032 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:55:38.612114 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fbc00-c88f-4c9d-a968-5c1fac06af2c None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:38.612265 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fbc00-c88f-4c9d-a968-5c1fac06af2c None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:38.612547 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fbc00-c88f-4c9d-a968-5c1fac06af2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:38.638457 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-557fbc00-c88f-4c9d-a968-5c1fac06af2c None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:38.639904 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-557fbc00-c88f-4c9d-a968-5c1fac06af2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:38.710745 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1193/2382] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:55:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:55:38.722557 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89933c2-cef6-458d-bc8b-ad9044fdf8a8 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:38.723910 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-f89933c2-cef6-458d-bc8b-ad9044fdf8a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:38.802385 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89933c2-cef6-458d-bc8b-ad9044fdf8a8 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:38.809261 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46dcf7-0ff1-48a4-946f-6b07ffb7c557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:38.811045 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46dcf7-0ff1-48a4-946f-6b07ffb7c557 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:38.811410 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46dcf7-0ff1-48a4-946f-6b07ffb7c557 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:38.811776 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46dcf7-0ff1-48a4-946f-6b07ffb7c557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:38.824944 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46dcf7-0ff1-48a4-946f-6b07ffb7c557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:38.855468 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46dcf7-0ff1-48a4-946f-6b07ffb7c557 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:38.867680 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1190/2383] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:55:38 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:55:39.160334 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fbc00-c88f-4c9d-a968-5c1fac06af2c None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:39.161673 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-557fbc00-c88f-4c9d-a968-5c1fac06af2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:39.174836 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fbc00-c88f-4c9d-a968-5c1fac06af2c None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:39.179643 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a312bf-408a-4f76-864b-b2e48d1b0bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:39.180504 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a312bf-408a-4f76-864b-b2e48d1b0bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:39.180796 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a312bf-408a-4f76-864b-b2e48d1b0bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:39.181070 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a312bf-408a-4f76-864b-b2e48d1b0bd5 admin admin] PATH_INFO: `/v3/projects/80103f212ac841a59726a303563f9180` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:39.182131 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a312bf-408a-4f76-864b-b2e48d1b0bd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80103f212ac841a59726a303563f9180)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:39.212118 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a312bf-408a-4f76-864b-b2e48d1b0bd5 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:39.265288 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c9a312bf-408a-4f76-864b-b2e48d1b0bd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80103f212ac841a59726a303563f9180', 'request_id': 'req-c9a312bf-408a-4f76-864b-b2e48d1b0bd5'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:39.272598 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c9a312bf-408a-4f76-864b-b2e48d1b0bd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80103f212ac841a59726a303563f9180', 'request_id': 'req-c9a312bf-408a-4f76-864b-b2e48d1b0bd5'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:39.284198 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c9a312bf-408a-4f76-864b-b2e48d1b0bd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80103f212ac841a59726a303563f9180', 'request_id': 'req-c9a312bf-408a-4f76-864b-b2e48d1b0bd5'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:39.294396 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c9a312bf-408a-4f76-864b-b2e48d1b0bd5 admin admin] The token cache is being invalidate because project 80103f212ac841a59726a303563f9180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:55:39.294698 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c9a312bf-408a-4f76-864b-b2e48d1b0bd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:39.295319 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c9a312bf-408a-4f76-864b-b2e48d1b0bd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:39.296926 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1194/2384] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:55:39 2021] DELETE /identity/v3/projects/80103f212ac841a59726a303563f9180 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:55:39.300663 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46dcf7-0ff1-48a4-946f-6b07ffb7c557 service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:39.310393 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46dcf7-0ff1-48a4-946f-6b07ffb7c557 service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:39.352548 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a312bf-408a-4f76-864b-b2e48d1b0bd5 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:39.354023 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c9a312bf-408a-4f76-864b-b2e48d1b0bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:39.381504 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540b02d-e4ed-4161-9048-0a0d736b9600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:39.382443 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540b02d-e4ed-4161-9048-0a0d736b9600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:39.382866 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540b02d-e4ed-4161-9048-0a0d736b9600 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:39.383227 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540b02d-e4ed-4161-9048-0a0d736b9600 admin admin] PATH_INFO: `/v3/users/f31772b7d257409a9c400dbfa7ee0a12` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:39.384370 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540b02d-e4ed-4161-9048-0a0d736b9600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f31772b7d257409a9c400dbfa7ee0a12)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:39.410374 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540b02d-e4ed-4161-9048-0a0d736b9600 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:39.425831 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a312bf-408a-4f76-864b-b2e48d1b0bd5 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:39.430605 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef964be7-d7a9-435a-895e-bcf656c9b9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:39.431416 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef964be7-d7a9-435a-895e-bcf656c9b9c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:39.431708 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef964be7-d7a9-435a-895e-bcf656c9b9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:39.431975 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef964be7-d7a9-435a-895e-bcf656c9b9c6 admin admin] PATH_INFO: `/v3/projects/b82d8e5fb4c648019d4b3875da92adfd` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:39.433068 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef964be7-d7a9-435a-895e-bcf656c9b9c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b82d8e5fb4c648019d4b3875da92adfd)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:39.460041 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef964be7-d7a9-435a-895e-bcf656c9b9c6 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:39.461327 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4540b02d-e4ed-4161-9048-0a0d736b9600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f31772b7d257409a9c400dbfa7ee0a12'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:39.461934 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4540b02d-e4ed-4161-9048-0a0d736b9600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f31772b7d257409a9c400dbfa7ee0a12'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:39.469437 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4540b02d-e4ed-4161-9048-0a0d736b9600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f31772b7d257409a9c400dbfa7ee0a12'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:39.481509 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4540b02d-e4ed-4161-9048-0a0d736b9600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f31772b7d257409a9c400dbfa7ee0a12'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:39.488675 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-4540b02d-e4ed-4161-9048-0a0d736b9600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f31772b7d257409a9c400dbfa7ee0a12'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:39.495713 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1191/2385] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:55:39 2021] DELETE /identity/v3/users/f31772b7d257409a9c400dbfa7ee0a12 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:55:39.510430 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ef964be7-d7a9-435a-895e-bcf656c9b9c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b82d8e5fb4c648019d4b3875da92adfd', 'request_id': 'req-ef964be7-d7a9-435a-895e-bcf656c9b9c6'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:39.517677 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ef964be7-d7a9-435a-895e-bcf656c9b9c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b82d8e5fb4c648019d4b3875da92adfd', 'request_id': 'req-ef964be7-d7a9-435a-895e-bcf656c9b9c6'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:39.529908 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ef964be7-d7a9-435a-895e-bcf656c9b9c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b82d8e5fb4c648019d4b3875da92adfd', 'request_id': 'req-ef964be7-d7a9-435a-895e-bcf656c9b9c6'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:39.540432 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ef964be7-d7a9-435a-895e-bcf656c9b9c6 admin admin] The token cache is being invalidate because project b82d8e5fb4c648019d4b3875da92adfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:55:39.540829 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ef964be7-d7a9-435a-895e-bcf656c9b9c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:39.541782 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ef964be7-d7a9-435a-895e-bcf656c9b9c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:39.543531 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1195/2386] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:55:39 2021] DELETE /identity/v3/projects/b82d8e5fb4c648019d4b3875da92adfd => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:55:39.550084 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee402d4e-54a1-476b-97cf-191a386a6b4b None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:39.550443 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee402d4e-54a1-476b-97cf-191a386a6b4b None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:39.550871 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee402d4e-54a1-476b-97cf-191a386a6b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:39.577037 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-ee402d4e-54a1-476b-97cf-191a386a6b4b None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:39.578436 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-ee402d4e-54a1-476b-97cf-191a386a6b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:39.652369 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1192/2387] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:55:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:39.660466 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3276e-b2f0-4707-bc43-38f316f2e30a None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:39.660830 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3276e-b2f0-4707-bc43-38f316f2e30a None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:39.661114 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3276e-b2f0-4707-bc43-38f316f2e30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:39.684344 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-ade3276e-b2f0-4707-bc43-38f316f2e30a None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:39.685753 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-ade3276e-b2f0-4707-bc43-38f316f2e30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:39.699585 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1196/2388] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:55:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:39.703656 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee402d4e-54a1-476b-97cf-191a386a6b4b None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:39.713080 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee402d4e-54a1-476b-97cf-191a386a6b4b None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:39.717315 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b62e7b-4f4c-4a0a-8e8f-f8172ed8a2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:39.717893 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b62e7b-4f4c-4a0a-8e8f-f8172ed8a2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:39.718179 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b62e7b-4f4c-4a0a-8e8f-f8172ed8a2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:39.718454 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b62e7b-4f4c-4a0a-8e8f-f8172ed8a2e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:39.719284 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b62e7b-4f4c-4a0a-8e8f-f8172ed8a2e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:55:39.719626 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b62e7b-4f4c-4a0a-8e8f-f8172ed8a2e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:39.745448 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b62e7b-4f4c-4a0a-8e8f-f8172ed8a2e0 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:39.758946 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1193/2389] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:55:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:55:39.763243 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3276e-b2f0-4707-bc43-38f316f2e30a None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:39.773769 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3276e-b2f0-4707-bc43-38f316f2e30a None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:39.778320 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5cc70-d9b3-4f64-b281-56068076783e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:39.779035 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5cc70-d9b3-4f64-b281-56068076783e admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:39.779399 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5cc70-d9b3-4f64-b281-56068076783e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:39.779811 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5cc70-d9b3-4f64-b281-56068076783e admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:39.780523 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5cc70-d9b3-4f64-b281-56068076783e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:39.807415 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5cc70-d9b3-4f64-b281-56068076783e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:39.841574 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1197/2390] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:55:39 2021] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:55:39.845645 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b62e7b-4f4c-4a0a-8e8f-f8172ed8a2e0 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:39.858370 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b62e7b-4f4c-4a0a-8e8f-f8172ed8a2e0 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:39.875790 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5cc70-d9b3-4f64-b281-56068076783e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:39.877679 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-12f5cc70-d9b3-4f64-b281-56068076783e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:39.936346 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718280a-a1e8-41e8-83e9-b7b197e6a304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:39.936952 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718280a-a1e8-41e8-83e9-b7b197e6a304 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:39.937241 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718280a-a1e8-41e8-83e9-b7b197e6a304 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:39.937608 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718280a-a1e8-41e8-83e9-b7b197e6a304 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:39.938255 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718280a-a1e8-41e8-83e9-b7b197e6a304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:39.957712 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5cc70-d9b3-4f64-b281-56068076783e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:39.962979 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f922135-5a56-450f-86c8-0184281da422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:39.963942 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f922135-5a56-450f-86c8-0184281da422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:39.964381 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f922135-5a56-450f-86c8-0184281da422 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:39.964813 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f922135-5a56-450f-86c8-0184281da422 admin admin] PATH_INFO: `/v3/projects/5334203f290245b88d5c5a1018b39849` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:39.965220 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718280a-a1e8-41e8-83e9-b7b197e6a304 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:39.966228 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f922135-5a56-450f-86c8-0184281da422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5334203f290245b88d5c5a1018b39849)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:39.985559 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1194/2391] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:55:39 2021] POST /identity/v3/users => generated 286 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:55:39.989589 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718280a-a1e8-41e8-83e9-b7b197e6a304 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:39.994479 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f922135-5a56-450f-86c8-0184281da422 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:39.999362 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718280a-a1e8-41e8-83e9-b7b197e6a304 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:40.003816 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809d696-5153-4fb4-8590-10d38f128c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:40.004578 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809d696-5153-4fb4-8590-10d38f128c13 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:40.004936 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809d696-5153-4fb4-8590-10d38f128c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:40.005288 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809d696-5153-4fb4-8590-10d38f128c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:40.006863 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a809d696-5153-4fb4-8590-10d38f128c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:40.034008 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a809d696-5153-4fb4-8590-10d38f128c13 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:40.044598 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1195/2392] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:55:39 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:55:40.047132 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-5f922135-5a56-450f-86c8-0184281da422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5334203f290245b88d5c5a1018b39849', 'request_id': 'req-5f922135-5a56-450f-86c8-0184281da422'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:40.048529 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809d696-5153-4fb4-8590-10d38f128c13 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:40.056011 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-5f922135-5a56-450f-86c8-0184281da422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5334203f290245b88d5c5a1018b39849', 'request_id': 'req-5f922135-5a56-450f-86c8-0184281da422'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:40.058845 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809d696-5153-4fb4-8590-10d38f128c13 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:40.067797 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-5f922135-5a56-450f-86c8-0184281da422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5334203f290245b88d5c5a1018b39849', 'request_id': 'req-5f922135-5a56-450f-86c8-0184281da422'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:40.080169 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-5f922135-5a56-450f-86c8-0184281da422 admin admin] The token cache is being invalidate because project 5334203f290245b88d5c5a1018b39849 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:55:40.080609 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-5f922135-5a56-450f-86c8-0184281da422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:40.081333 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-5f922135-5a56-450f-86c8-0184281da422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:40.083231 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1198/2393] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:55:39 2021] DELETE /identity/v3/projects/5334203f290245b88d5c5a1018b39849 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:55:40.088639 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ed473-a5e8-45f6-bb0a-98c6e30f3554 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:40.088937 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ed473-a5e8-45f6-bb0a-98c6e30f3554 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:40.089227 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ed473-a5e8-45f6-bb0a-98c6e30f3554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:40.115362 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-1c9ed473-a5e8-45f6-bb0a-98c6e30f3554 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:40.116786 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-1c9ed473-a5e8-45f6-bb0a-98c6e30f3554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:40.124947 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc868ea6-c1ca-4d38-b42e-d111b7bb7d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:40.125777 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc868ea6-c1ca-4d38-b42e-d111b7bb7d8e admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:40.126063 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc868ea6-c1ca-4d38-b42e-d111b7bb7d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:40.126733 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc868ea6-c1ca-4d38-b42e-d111b7bb7d8e admin admin] PATH_INFO: `/v3/projects/fc1b3281fc834cd68995c2b6fd67f2a4/users/662cb05d5a264e9ab56a11a5ca8a1eb3/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:40.146681 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc868ea6-c1ca-4d38-b42e-d111b7bb7d8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc1b3281fc834cd68995c2b6fd67f2a4, user_id=662cb05d5a264e9ab56a11a5ca8a1eb3, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:40.174798 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc868ea6-c1ca-4d38-b42e-d111b7bb7d8e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:40.191713 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1199/2394] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:55:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:55:40.191928 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1196/2395] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:55:40 2021] PUT /identity/v3/projects/fc1b3281fc834cd68995c2b6fd67f2a4/users/662cb05d5a264e9ab56a11a5ca8a1eb3/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:55:40.194024 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf04bdb-e939-4a29-a22d-75b5a9c79f83 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:40.194188 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98f47f-47bf-4c24-b0a1-e2cb04c2cbc4 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:40.194530 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98f47f-47bf-4c24-b0a1-e2cb04c2cbc4 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:40.194679 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf04bdb-e939-4a29-a22d-75b5a9c79f83 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:40.194907 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf04bdb-e939-4a29-a22d-75b5a9c79f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:40.195004 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98f47f-47bf-4c24-b0a1-e2cb04c2cbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:40.217946 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-5f98f47f-47bf-4c24-b0a1-e2cb04c2cbc4 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:40.218168 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-7bf04bdb-e939-4a29-a22d-75b5a9c79f83 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:40.219134 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-5f98f47f-47bf-4c24-b0a1-e2cb04c2cbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:40.219279 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-7bf04bdb-e939-4a29-a22d-75b5a9c79f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:40.290366 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1197/2396] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:55:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:40.295413 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1200/2397] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:55:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:55:40.296510 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf04bdb-e939-4a29-a22d-75b5a9c79f83 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:40.300695 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98f47f-47bf-4c24-b0a1-e2cb04c2cbc4 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:40.302471 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-5f98f47f-47bf-4c24-b0a1-e2cb04c2cbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:40.306325 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf04bdb-e939-4a29-a22d-75b5a9c79f83 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:40.311878 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffdeb7-e310-4a8a-a232-162bcefeafec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:40.313013 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffdeb7-e310-4a8a-a232-162bcefeafec admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:40.313528 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffdeb7-e310-4a8a-a232-162bcefeafec admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:40.313891 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffdeb7-e310-4a8a-a232-162bcefeafec admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:40.314684 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bffdeb7-e310-4a8a-a232-162bcefeafec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:55:40.315056 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bffdeb7-e310-4a8a-a232-162bcefeafec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:40.353498 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bffdeb7-e310-4a8a-a232-162bcefeafec admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:40.371046 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1198/2398] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:55:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:55:40.372522 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98f47f-47bf-4c24-b0a1-e2cb04c2cbc4 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:40.374094 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffdeb7-e310-4a8a-a232-162bcefeafec admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:40.376082 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af15640-490b-436d-8f7a-398da952ef89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:40.376660 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af15640-490b-436d-8f7a-398da952ef89 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:40.376939 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af15640-490b-436d-8f7a-398da952ef89 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:40.377220 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af15640-490b-436d-8f7a-398da952ef89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:40.384275 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffdeb7-e310-4a8a-a232-162bcefeafec admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:40.387531 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af15640-490b-436d-8f7a-398da952ef89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:40.388901 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ed7a1-0f95-4ec0-9bff-a34dde864d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:40.389486 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ed7a1-0f95-4ec0-9bff-a34dde864d31 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:40.389779 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ed7a1-0f95-4ec0-9bff-a34dde864d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:40.390063 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ed7a1-0f95-4ec0-9bff-a34dde864d31 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:40.390730 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ed7a1-0f95-4ec0-9bff-a34dde864d31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:40.413775 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af15640-490b-436d-8f7a-398da952ef89 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:40.416612 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ed7a1-0f95-4ec0-9bff-a34dde864d31 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:40.426831 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1201/2399] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:55:40 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:55:40.450037 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1199/2400] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:55:40 2021] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:55:40.454585 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af15640-490b-436d-8f7a-398da952ef89 service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:40.464479 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af15640-490b-436d-8f7a-398da952ef89 service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:40.533300 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f32876-22d4-4c66-8cf7-fbdf0ebc236d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:40.533909 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f32876-22d4-4c66-8cf7-fbdf0ebc236d admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:40.534210 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f32876-22d4-4c66-8cf7-fbdf0ebc236d admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:40.534583 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f32876-22d4-4c66-8cf7-fbdf0ebc236d admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:40.535249 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f32876-22d4-4c66-8cf7-fbdf0ebc236d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:40.564639 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f32876-22d4-4c66-8cf7-fbdf0ebc236d admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:40.590843 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1202/2401] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:55:40 2021] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:55:40.592714 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ed7a1-0f95-4ec0-9bff-a34dde864d31 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:40.604524 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ed7a1-0f95-4ec0-9bff-a34dde864d31 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:40.609811 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e3a84-9ebf-4122-af6a-93050dec9328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:40.610286 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e3a84-9ebf-4122-af6a-93050dec9328 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:40.610572 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e3a84-9ebf-4122-af6a-93050dec9328 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:40.610947 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e3a84-9ebf-4122-af6a-93050dec9328 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:40.611745 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e3a84-9ebf-4122-af6a-93050dec9328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:40.644093 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e3a84-9ebf-4122-af6a-93050dec9328 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:40.654163 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1200/2402] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:55:40 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:55:40.655211 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f32876-22d4-4c66-8cf7-fbdf0ebc236d admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:40.670278 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f32876-22d4-4c66-8cf7-fbdf0ebc236d admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:40.676585 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b0e7f-9e8b-4ff6-a8f0-939fe34bbd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:40.678870 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b0e7f-9e8b-4ff6-a8f0-939fe34bbd17 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:40.679607 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b0e7f-9e8b-4ff6-a8f0-939fe34bbd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:40.680154 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b0e7f-9e8b-4ff6-a8f0-939fe34bbd17 admin admin] PATH_INFO: `/v3/projects/d697fb687c384432b3b6bc94f132109c/users/9d51b92eaff649b89459a7b7a8a00d53/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:40.713772 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b0e7f-9e8b-4ff6-a8f0-939fe34bbd17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d697fb687c384432b3b6bc94f132109c, user_id=9d51b92eaff649b89459a7b7a8a00d53, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:40.751210 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b0e7f-9e8b-4ff6-a8f0-939fe34bbd17 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:40.767606 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1203/2403] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:55:40 2021] PUT /identity/v3/projects/d697fb687c384432b3b6bc94f132109c/users/9d51b92eaff649b89459a7b7a8a00d53/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:55:40.777796 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea79acc-4980-4ce6-ac7c-1ce9fcc29a12 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:40.778347 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea79acc-4980-4ce6-ac7c-1ce9fcc29a12 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:40.778880 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea79acc-4980-4ce6-ac7c-1ce9fcc29a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:40.819455 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-6ea79acc-4980-4ce6-ac7c-1ce9fcc29a12 None None] MFA Rules not processed for user `9d51b92eaff649b89459a7b7a8a00d53`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:40.820644 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-6ea79acc-4980-4ce6-ac7c-1ce9fcc29a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:40.897646 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1201/2404] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:55:40 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:40.901656 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b0e7f-9e8b-4ff6-a8f0-939fe34bbd17 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:40.979291 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b0e7f-9e8b-4ff6-a8f0-939fe34bbd17 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:40.984382 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67e6de-95ce-4f9c-bfa2-4f4558619da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:40.985089 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67e6de-95ce-4f9c-bfa2-4f4558619da4 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:40.985449 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67e6de-95ce-4f9c-bfa2-4f4558619da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:40.985826 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67e6de-95ce-4f9c-bfa2-4f4558619da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:40.987041 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67e6de-95ce-4f9c-bfa2-4f4558619da4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:41.018016 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67e6de-95ce-4f9c-bfa2-4f4558619da4 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:41.048221 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1204/2405] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:55:40 2021] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:55:41.049699 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea79acc-4980-4ce6-ac7c-1ce9fcc29a12 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:41.060624 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea79acc-4980-4ce6-ac7c-1ce9fcc29a12 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:41.123987 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e32434-b5e0-4c49-b5e8-66ba9d83ce36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:41.124595 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e32434-b5e0-4c49-b5e8-66ba9d83ce36 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:41.124915 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e32434-b5e0-4c49-b5e8-66ba9d83ce36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:41.125201 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e32434-b5e0-4c49-b5e8-66ba9d83ce36 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:41.125870 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e32434-b5e0-4c49-b5e8-66ba9d83ce36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:41.152563 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e32434-b5e0-4c49-b5e8-66ba9d83ce36 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:41.173653 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1202/2406] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:55:41 2021] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:55:41.178298 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67e6de-95ce-4f9c-bfa2-4f4558619da4 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:41.191124 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67e6de-95ce-4f9c-bfa2-4f4558619da4 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:41.197190 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea1bad-2cf4-42bd-9fab-4395d6251e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:41.197792 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea1bad-2cf4-42bd-9fab-4395d6251e88 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:41.198080 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea1bad-2cf4-42bd-9fab-4395d6251e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:41.198359 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea1bad-2cf4-42bd-9fab-4395d6251e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:41.199472 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea1bad-2cf4-42bd-9fab-4395d6251e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:41.229356 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea1bad-2cf4-42bd-9fab-4395d6251e88 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:41.243525 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1205/2407] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:55:41 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:55:41.246939 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e32434-b5e0-4c49-b5e8-66ba9d83ce36 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:41.256930 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e32434-b5e0-4c49-b5e8-66ba9d83ce36 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:41.262083 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556cf33-ff4f-4d84-bb0c-3a8f6d3d147b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:41.262958 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556cf33-ff4f-4d84-bb0c-3a8f6d3d147b admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:41.263246 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556cf33-ff4f-4d84-bb0c-3a8f6d3d147b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:41.263533 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556cf33-ff4f-4d84-bb0c-3a8f6d3d147b admin admin] PATH_INFO: `/v3/projects/877f2696f16e416e976d4d14140ae866/users/87561ea99f5f41239932327cbaab5df8/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:41.292160 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556cf33-ff4f-4d84-bb0c-3a8f6d3d147b admin admin] RBAC: Authorizing `identity:create_grant(project_id=877f2696f16e416e976d4d14140ae866, user_id=87561ea99f5f41239932327cbaab5df8, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:41.319502 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556cf33-ff4f-4d84-bb0c-3a8f6d3d147b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:41.335425 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1203/2408] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:55:41 2021] PUT /identity/v3/projects/877f2696f16e416e976d4d14140ae866/users/87561ea99f5f41239932327cbaab5df8/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:55:41.339724 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea1bad-2cf4-42bd-9fab-4395d6251e88 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:41.353232 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea1bad-2cf4-42bd-9fab-4395d6251e88 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:41.427940 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bbc44-42ba-4ae6-ae60-0f082bdf4b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:41.428707 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bbc44-42ba-4ae6-ae60-0f082bdf4b78 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:41.429052 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bbc44-42ba-4ae6-ae60-0f082bdf4b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:41.429336 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bbc44-42ba-4ae6-ae60-0f082bdf4b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:41.430222 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4bbc44-42ba-4ae6-ae60-0f082bdf4b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:41.455835 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4bbc44-42ba-4ae6-ae60-0f082bdf4b78 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:41.468208 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1206/2409] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:55:41 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:55:41.472378 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556cf33-ff4f-4d84-bb0c-3a8f6d3d147b admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:41.482949 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556cf33-ff4f-4d84-bb0c-3a8f6d3d147b admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:41.487163 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33503b63-6c9d-4852-9893-3b3956ac5162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:41.488002 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33503b63-6c9d-4852-9893-3b3956ac5162 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:41.488288 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33503b63-6c9d-4852-9893-3b3956ac5162 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:41.488572 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33503b63-6c9d-4852-9893-3b3956ac5162 admin admin] PATH_INFO: `/v3/projects/877f2696f16e416e976d4d14140ae866/users/87561ea99f5f41239932327cbaab5df8/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:41.491122 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33503b63-6c9d-4852-9893-3b3956ac5162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=877f2696f16e416e976d4d14140ae866, user_id=87561ea99f5f41239932327cbaab5df8, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:41.517409 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33503b63-6c9d-4852-9893-3b3956ac5162 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:41.528961 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1204/2410] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:55:41 2021] PUT /identity/v3/projects/877f2696f16e416e976d4d14140ae866/users/87561ea99f5f41239932327cbaab5df8/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:55:41.532741 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bbc44-42ba-4ae6-ae60-0f082bdf4b78 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:41.545855 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bbc44-42ba-4ae6-ae60-0f082bdf4b78 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:41.614183 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb9de9-25d2-4aee-ada7-fd1e84182ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:41.615262 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb9de9-25d2-4aee-ada7-fd1e84182ddf admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:41.615856 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb9de9-25d2-4aee-ada7-fd1e84182ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:41.616064 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb9de9-25d2-4aee-ada7-fd1e84182ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:41.616937 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb9de9-25d2-4aee-ada7-fd1e84182ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:41.643187 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb9de9-25d2-4aee-ada7-fd1e84182ddf admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:41.654461 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1207/2411] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:55:41 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:55:41.658665 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33503b63-6c9d-4852-9893-3b3956ac5162 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:41.670464 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33503b63-6c9d-4852-9893-3b3956ac5162 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:41.674769 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f8e6f-8f83-4143-87ca-73c09daa1642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:41.675925 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f8e6f-8f83-4143-87ca-73c09daa1642 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:41.676369 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f8e6f-8f83-4143-87ca-73c09daa1642 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:41.676643 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f8e6f-8f83-4143-87ca-73c09daa1642 admin admin] PATH_INFO: `/v3/projects/877f2696f16e416e976d4d14140ae866/users/87561ea99f5f41239932327cbaab5df8/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:41.679068 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f8e6f-8f83-4143-87ca-73c09daa1642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=877f2696f16e416e976d4d14140ae866, user_id=87561ea99f5f41239932327cbaab5df8, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:41.709757 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f8e6f-8f83-4143-87ca-73c09daa1642 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:41.728121 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1205/2412] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:55:41 2021] PUT /identity/v3/projects/877f2696f16e416e976d4d14140ae866/users/87561ea99f5f41239932327cbaab5df8/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:55:41.739541 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc7a76-2824-4ae9-b61d-b26484bb089a None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:41.739933 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc7a76-2824-4ae9-b61d-b26484bb089a None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:41.740318 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc7a76-2824-4ae9-b61d-b26484bb089a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:41.781849 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-a1fc7a76-2824-4ae9-b61d-b26484bb089a None None] MFA Rules not processed for user `87561ea99f5f41239932327cbaab5df8`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:41.784178 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-a1fc7a76-2824-4ae9-b61d-b26484bb089a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:41.966705 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1208/2413] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:55:41 2021] POST /identity/v3/auth/tokens => generated 3745 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:41.971529 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f8e6f-8f83-4143-87ca-73c09daa1642 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:41.973924 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-2b4f8e6f-8f83-4143-87ca-73c09daa1642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:42.096687 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f8e6f-8f83-4143-87ca-73c09daa1642 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:42.113916 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54316940-03a2-4d3a-b460-5b8feb16e4aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:42.114524 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54316940-03a2-4d3a-b460-5b8feb16e4aa service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:42.115543 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54316940-03a2-4d3a-b460-5b8feb16e4aa service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:42.115846 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54316940-03a2-4d3a-b460-5b8feb16e4aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:42.140164 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54316940-03a2-4d3a-b460-5b8feb16e4aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:42.177986 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54316940-03a2-4d3a-b460-5b8feb16e4aa service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:42.189352 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1206/2414] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:55:41 2021] GET /identity/v3/auth/tokens => generated 3745 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:55:42.315572 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc7a76-2824-4ae9-b61d-b26484bb089a None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:42.326580 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc7a76-2824-4ae9-b61d-b26484bb089a None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:42.330427 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a4217-8396-4506-a5f0-4f3cd52749a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:42.331171 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a4217-8396-4506-a5f0-4f3cd52749a0 service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:42.331554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a4217-8396-4506-a5f0-4f3cd52749a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:42.331930 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a4217-8396-4506-a5f0-4f3cd52749a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:42.406024 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a4217-8396-4506-a5f0-4f3cd52749a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:42.435142 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a4217-8396-4506-a5f0-4f3cd52749a0 service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:42.445250 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1209/2415] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:55:42 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:55:48.287313 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098da854-ef4d-48df-9796-f7dac8d1666b None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:48.288169 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098da854-ef4d-48df-9796-f7dac8d1666b None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:48.288169 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098da854-ef4d-48df-9796-f7dac8d1666b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:48.331301 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-098da854-ef4d-48df-9796-f7dac8d1666b None None] MFA Rules not processed for user `662cb05d5a264e9ab56a11a5ca8a1eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:48.332565 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-098da854-ef4d-48df-9796-f7dac8d1666b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:48.404500 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1207/2416] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:55:48 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:48.409037 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a4217-8396-4506-a5f0-4f3cd52749a0 service cinder] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:48.410375 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-a59a4217-8396-4506-a5f0-4f3cd52749a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:48.484050 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a4217-8396-4506-a5f0-4f3cd52749a0 service cinder] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:48.488108 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a23b05-c232-456e-a343-a229095f9e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:48.488696 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a23b05-c232-456e-a343-a229095f9e06 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:48.488982 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a23b05-c232-456e-a343-a229095f9e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:48.489263 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a23b05-c232-456e-a343-a229095f9e06 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:48.490574 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a23b05-c232-456e-a343-a229095f9e06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:48.515786 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a23b05-c232-456e-a343-a229095f9e06 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:48.541877 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1210/2417] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:55:48 2021] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:55:48.545978 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098da854-ef4d-48df-9796-f7dac8d1666b None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:48.556619 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098da854-ef4d-48df-9796-f7dac8d1666b None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:48.619384 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de2c82-cd29-4a17-8a07-6b3be7702228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:48.620108 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de2c82-cd29-4a17-8a07-6b3be7702228 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:48.620466 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de2c82-cd29-4a17-8a07-6b3be7702228 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:48.620833 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de2c82-cd29-4a17-8a07-6b3be7702228 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:48.621538 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de2c82-cd29-4a17-8a07-6b3be7702228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:48.648481 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de2c82-cd29-4a17-8a07-6b3be7702228 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:48.672436 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1208/2418] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:55:48 2021] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:55:48.676428 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a23b05-c232-456e-a343-a229095f9e06 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:48.687318 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a23b05-c232-456e-a343-a229095f9e06 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:48.691559 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2aef05-b7ff-4c6b-a15c-143a1f589695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:48.692149 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2aef05-b7ff-4c6b-a15c-143a1f589695 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:48.692438 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2aef05-b7ff-4c6b-a15c-143a1f589695 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:48.693578 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2aef05-b7ff-4c6b-a15c-143a1f589695 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:48.694284 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2aef05-b7ff-4c6b-a15c-143a1f589695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:48.719639 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2aef05-b7ff-4c6b-a15c-143a1f589695 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:48.734870 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1211/2419] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:55:48 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:55:48.736006 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de2c82-cd29-4a17-8a07-6b3be7702228 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:48.746872 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de2c82-cd29-4a17-8a07-6b3be7702228 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:48.751408 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148406b-d944-4acb-8e17-78602e00dc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:48.752244 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148406b-d944-4acb-8e17-78602e00dc9a admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:48.752530 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148406b-d944-4acb-8e17-78602e00dc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:48.752811 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148406b-d944-4acb-8e17-78602e00dc9a admin admin] PATH_INFO: `/v3/projects/6d21c3a01cf640d18210aada5d270cdc/users/4335ebf161604e54a12b50942d16b574/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:48.774984 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148406b-d944-4acb-8e17-78602e00dc9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d21c3a01cf640d18210aada5d270cdc, user_id=4335ebf161604e54a12b50942d16b574, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:48.802426 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148406b-d944-4acb-8e17-78602e00dc9a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:48.816995 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1209/2420] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:55:48 2021] PUT /identity/v3/projects/6d21c3a01cf640d18210aada5d270cdc/users/4335ebf161604e54a12b50942d16b574/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:55:48.821611 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2aef05-b7ff-4c6b-a15c-143a1f589695 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:48.836601 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2aef05-b7ff-4c6b-a15c-143a1f589695 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:48.905965 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7007c3-9269-4102-844a-d315669d6f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:48.906568 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7007c3-9269-4102-844a-d315669d6f83 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:48.906894 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7007c3-9269-4102-844a-d315669d6f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:48.907176 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7007c3-9269-4102-844a-d315669d6f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:48.907868 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7007c3-9269-4102-844a-d315669d6f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:48.933704 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7007c3-9269-4102-844a-d315669d6f83 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:48.944755 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1212/2421] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:55:48 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:55:48.948945 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148406b-d944-4acb-8e17-78602e00dc9a admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:48.959257 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148406b-d944-4acb-8e17-78602e00dc9a admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:48.963736 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972eceaa-7220-447f-9c0f-3a52a9ffdd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:48.964585 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eceaa-7220-447f-9c0f-3a52a9ffdd2d admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:48.964871 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eceaa-7220-447f-9c0f-3a52a9ffdd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:48.965369 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eceaa-7220-447f-9c0f-3a52a9ffdd2d admin admin] PATH_INFO: `/v3/projects/6d21c3a01cf640d18210aada5d270cdc/users/4335ebf161604e54a12b50942d16b574/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:48.967728 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972eceaa-7220-447f-9c0f-3a52a9ffdd2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d21c3a01cf640d18210aada5d270cdc, user_id=4335ebf161604e54a12b50942d16b574, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:48.995794 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972eceaa-7220-447f-9c0f-3a52a9ffdd2d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:49.006521 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1210/2422] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:55:48 2021] PUT /identity/v3/projects/6d21c3a01cf640d18210aada5d270cdc/users/4335ebf161604e54a12b50942d16b574/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:55:49.010137 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7007c3-9269-4102-844a-d315669d6f83 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:49.019844 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7007c3-9269-4102-844a-d315669d6f83 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:49.089988 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf2608-b09c-47f5-8b11-045dc15a65f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:49.090955 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf2608-b09c-47f5-8b11-045dc15a65f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:49.091411 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf2608-b09c-47f5-8b11-045dc15a65f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:49.091900 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf2608-b09c-47f5-8b11-045dc15a65f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:49.092799 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf2608-b09c-47f5-8b11-045dc15a65f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:49.120397 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf2608-b09c-47f5-8b11-045dc15a65f7 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:49.133423 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1213/2423] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:55:49 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:55:49.137543 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972eceaa-7220-447f-9c0f-3a52a9ffdd2d admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:49.147506 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972eceaa-7220-447f-9c0f-3a52a9ffdd2d admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:49.151729 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5868a-c426-489c-95e8-c5a2145b328c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:49.152555 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5868a-c426-489c-95e8-c5a2145b328c admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:49.152840 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5868a-c426-489c-95e8-c5a2145b328c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:49.153119 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5868a-c426-489c-95e8-c5a2145b328c admin admin] PATH_INFO: `/v3/projects/6d21c3a01cf640d18210aada5d270cdc/users/4335ebf161604e54a12b50942d16b574/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:49.154950 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5868a-c426-489c-95e8-c5a2145b328c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d21c3a01cf640d18210aada5d270cdc, user_id=4335ebf161604e54a12b50942d16b574, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:49.182627 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5868a-c426-489c-95e8-c5a2145b328c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:49.197173 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1211/2424] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:55:49 2021] PUT /identity/v3/projects/6d21c3a01cf640d18210aada5d270cdc/users/4335ebf161604e54a12b50942d16b574/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:55:54.487834 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf2608-b09c-47f5-8b11-045dc15a65f7 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:54.490551 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-7baf2608-b09c-47f5-8b11-045dc15a65f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:54.503016 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf2608-b09c-47f5-8b11-045dc15a65f7 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:54.571848 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79ff68-a2d4-41ab-9ee3-a5131611e659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:54.572652 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79ff68-a2d4-41ab-9ee3-a5131611e659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:54.572940 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79ff68-a2d4-41ab-9ee3-a5131611e659 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:54.573222 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79ff68-a2d4-41ab-9ee3-a5131611e659 admin admin] PATH_INFO: `/v3/users/571a3b9c133a4831b3e2f97b588db5bb` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:54.574319 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79ff68-a2d4-41ab-9ee3-a5131611e659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=571a3b9c133a4831b3e2f97b588db5bb)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:54.601598 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79ff68-a2d4-41ab-9ee3-a5131611e659 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:54.657078 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4c79ff68-a2d4-41ab-9ee3-a5131611e659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '571a3b9c133a4831b3e2f97b588db5bb'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:54.671525 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4c79ff68-a2d4-41ab-9ee3-a5131611e659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '571a3b9c133a4831b3e2f97b588db5bb'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:54.672318 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4c79ff68-a2d4-41ab-9ee3-a5131611e659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '571a3b9c133a4831b3e2f97b588db5bb'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:54.683107 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4c79ff68-a2d4-41ab-9ee3-a5131611e659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '571a3b9c133a4831b3e2f97b588db5bb'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:54.693208 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4c79ff68-a2d4-41ab-9ee3-a5131611e659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '571a3b9c133a4831b3e2f97b588db5bb'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:54.719278 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1214/2425] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:55:54 2021] DELETE /identity/v3/users/571a3b9c133a4831b3e2f97b588db5bb => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:55:55.239226 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5868a-c426-489c-95e8-c5a2145b328c admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:55.245546 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-47d5868a-c426-489c-95e8-c5a2145b328c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:55.260340 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5868a-c426-489c-95e8-c5a2145b328c admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:55.331334 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a6443-d4aa-4a8e-823f-a4a12951210b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:55.332127 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a6443-d4aa-4a8e-823f-a4a12951210b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:55.332419 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a6443-d4aa-4a8e-823f-a4a12951210b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:55.332792 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a6443-d4aa-4a8e-823f-a4a12951210b admin admin] PATH_INFO: `/v3/projects/bee7e931feeb451ba07870c825abc1ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:55.335182 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a6443-d4aa-4a8e-823f-a4a12951210b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bee7e931feeb451ba07870c825abc1ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:55.370489 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a6443-d4aa-4a8e-823f-a4a12951210b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:55.433540 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-102a6443-d4aa-4a8e-823f-a4a12951210b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bee7e931feeb451ba07870c825abc1ae', 'request_id': 'req-102a6443-d4aa-4a8e-823f-a4a12951210b'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:55.443685 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-102a6443-d4aa-4a8e-823f-a4a12951210b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bee7e931feeb451ba07870c825abc1ae', 'request_id': 'req-102a6443-d4aa-4a8e-823f-a4a12951210b'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:55.453567 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-102a6443-d4aa-4a8e-823f-a4a12951210b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bee7e931feeb451ba07870c825abc1ae', 'request_id': 'req-102a6443-d4aa-4a8e-823f-a4a12951210b'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:55.474932 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-102a6443-d4aa-4a8e-823f-a4a12951210b admin admin] The token cache is being invalidate because project bee7e931feeb451ba07870c825abc1ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:55:55.475494 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-102a6443-d4aa-4a8e-823f-a4a12951210b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:55.477101 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-102a6443-d4aa-4a8e-823f-a4a12951210b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:55:55.478701 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1212/2426] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:55:55 2021] DELETE /identity/v3/projects/bee7e931feeb451ba07870c825abc1ae => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:55:55.485475 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3f94f-4575-4ad5-9ba4-91477a0f8aac None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:55.487473 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3f94f-4575-4ad5-9ba4-91477a0f8aac None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:55.488083 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3f94f-4575-4ad5-9ba4-91477a0f8aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:55.521825 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-cce3f94f-4575-4ad5-9ba4-91477a0f8aac None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:55.523916 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-cce3f94f-4575-4ad5-9ba4-91477a0f8aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:55.617350 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1215/2427] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:55:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:55.625085 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2611d16-4390-43bb-a69c-a429df73dfd2 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:55.625558 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2611d16-4390-43bb-a69c-a429df73dfd2 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:55.627094 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2611d16-4390-43bb-a69c-a429df73dfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:55.705544 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-f2611d16-4390-43bb-a69c-a429df73dfd2 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:55.707824 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-f2611d16-4390-43bb-a69c-a429df73dfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:55.719407 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1213/2428] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:55:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:55:55.724454 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3f94f-4575-4ad5-9ba4-91477a0f8aac None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:55.737377 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3f94f-4575-4ad5-9ba4-91477a0f8aac None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:55.751880 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452305d-28f5-472c-8eda-6842a2a012d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:55.753025 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452305d-28f5-472c-8eda-6842a2a012d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:55.753488 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452305d-28f5-472c-8eda-6842a2a012d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:55.753870 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452305d-28f5-472c-8eda-6842a2a012d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:55.755750 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452305d-28f5-472c-8eda-6842a2a012d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:55:55.756359 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452305d-28f5-472c-8eda-6842a2a012d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:55.809329 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452305d-28f5-472c-8eda-6842a2a012d5 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:55.838473 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1216/2429] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:55:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 20:55:55.840569 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2611d16-4390-43bb-a69c-a429df73dfd2 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:55.863817 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2611d16-4390-43bb-a69c-a429df73dfd2 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:55.882180 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc39409-a2ff-4ce1-aed7-d50386510434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:55.882815 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc39409-a2ff-4ce1-aed7-d50386510434 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:55.883131 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc39409-a2ff-4ce1-aed7-d50386510434 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:55.883382 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc39409-a2ff-4ce1-aed7-d50386510434 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:55.884034 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc39409-a2ff-4ce1-aed7-d50386510434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:55.936849 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc39409-a2ff-4ce1-aed7-d50386510434 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:56.017332 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452305d-28f5-472c-8eda-6842a2a012d5 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:56.020052 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1214/2430] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:55:55 2021] POST /identity/v3/projects => generated 387 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:55:56.030816 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452305d-28f5-472c-8eda-6842a2a012d5 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:56.113463 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a7aaa-aeef-42ae-9b4f-b6aded21e399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:56.114681 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a7aaa-aeef-42ae-9b4f-b6aded21e399 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:56.115023 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a7aaa-aeef-42ae-9b4f-b6aded21e399 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:56.115309 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a7aaa-aeef-42ae-9b4f-b6aded21e399 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:56.117163 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a7aaa-aeef-42ae-9b4f-b6aded21e399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:56.153984 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a7aaa-aeef-42ae-9b4f-b6aded21e399 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:56.188997 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1217/2431] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:55:56 2021] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:55:56.195176 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc39409-a2ff-4ce1-aed7-d50386510434 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:56.207997 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc39409-a2ff-4ce1-aed7-d50386510434 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:56.213153 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf15ed-d249-46f7-819a-12f93201a588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:56.213869 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf15ed-d249-46f7-819a-12f93201a588 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:56.214893 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf15ed-d249-46f7-819a-12f93201a588 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:56.215272 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf15ed-d249-46f7-819a-12f93201a588 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:56.216423 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf15ed-d249-46f7-819a-12f93201a588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:56.263082 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf15ed-d249-46f7-819a-12f93201a588 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:56.287155 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1215/2432] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:55:56 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:55:56.293399 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a7aaa-aeef-42ae-9b4f-b6aded21e399 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:56.321899 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a7aaa-aeef-42ae-9b4f-b6aded21e399 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:56.338532 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa2552-f83e-4cba-8e53-0abf949dd0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:56.339634 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa2552-f83e-4cba-8e53-0abf949dd0d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:56.340019 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa2552-f83e-4cba-8e53-0abf949dd0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:56.340476 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa2552-f83e-4cba-8e53-0abf949dd0d9 admin admin] PATH_INFO: `/v3/projects/c57d417a00fc4d18b249a80a29223706/users/82536fd1a7004505b9c79b6bc570d9e4/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:56.373553 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa2552-f83e-4cba-8e53-0abf949dd0d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c57d417a00fc4d18b249a80a29223706, user_id=82536fd1a7004505b9c79b6bc570d9e4, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:56.407364 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa2552-f83e-4cba-8e53-0abf949dd0d9 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:56.438468 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f02a8-06b2-43f1-b674-c218fcf79e26 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:56.438878 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f02a8-06b2-43f1-b674-c218fcf79e26 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:56.439173 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f02a8-06b2-43f1-b674-c218fcf79e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:56.440441 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1218/2433] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:55:56 2021] PUT /identity/v3/projects/c57d417a00fc4d18b249a80a29223706/users/82536fd1a7004505b9c79b6bc570d9e4/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:55:56.469976 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-241f02a8-06b2-43f1-b674-c218fcf79e26 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:56.471095 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-241f02a8-06b2-43f1-b674-c218fcf79e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:56.558618 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1216/2434] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:55:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:56.565379 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa2552-f83e-4cba-8e53-0abf949dd0d9 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:56.567457 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-5baa2552-f83e-4cba-8e53-0abf949dd0d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:56.662497 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa2552-f83e-4cba-8e53-0abf949dd0d9 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:56.666206 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7a274-cdc2-4651-83fe-e86883d80492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:56.666993 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7a274-cdc2-4651-83fe-e86883d80492 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:56.667437 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7a274-cdc2-4651-83fe-e86883d80492 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:56.667887 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7a274-cdc2-4651-83fe-e86883d80492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:56.679772 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7a274-cdc2-4651-83fe-e86883d80492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:56.710771 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7a274-cdc2-4651-83fe-e86883d80492 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:56.742391 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1219/2435] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:55:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:55:57.426067 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b055fa-38e8-46c5-a8bb-f4ec29446ea4 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:57.427155 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b055fa-38e8-46c5-a8bb-f4ec29446ea4 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:57.427244 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b055fa-38e8-46c5-a8bb-f4ec29446ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:57.472290 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-f5b055fa-38e8-46c5-a8bb-f4ec29446ea4 None None] MFA Rules not processed for user `4335ebf161604e54a12b50942d16b574`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:55:57.475019 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-f5b055fa-38e8-46c5-a8bb-f4ec29446ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:57.580460 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1217/2436] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:55:57 2021] POST /identity/v3/auth/tokens => generated 3747 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:55:57.594194 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7a274-cdc2-4651-83fe-e86883d80492 service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:55:57.595757 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-f2a7a274-cdc2-4651-83fe-e86883d80492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:57.725325 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7a274-cdc2-4651-83fe-e86883d80492 service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:55:57.735372 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45739ec3-87fa-496a-8623-1d1ee5341eeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:55:57.736216 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45739ec3-87fa-496a-8623-1d1ee5341eeb service nova] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:55:57.736576 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45739ec3-87fa-496a-8623-1d1ee5341eeb service nova] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:55:57.737324 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45739ec3-87fa-496a-8623-1d1ee5341eeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:55:57.740226 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-45739ec3-87fa-496a-8623-1d1ee5341eeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:55:57.824351 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45739ec3-87fa-496a-8623-1d1ee5341eeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:55:57.860873 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45739ec3-87fa-496a-8623-1d1ee5341eeb service nova] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:55:57.872539 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1220/2437] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:55:57 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:56:00.402515 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4693f6-bfea-4fe2-ad1e-03e85a0691b4 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:00.403080 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4693f6-bfea-4fe2-ad1e-03e85a0691b4 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:00.403307 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4693f6-bfea-4fe2-ad1e-03e85a0691b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:00.448329 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-6a4693f6-bfea-4fe2-ad1e-03e85a0691b4 None None] MFA Rules not processed for user `662cb05d5a264e9ab56a11a5ca8a1eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:56:00.453104 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-6a4693f6-bfea-4fe2-ad1e-03e85a0691b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:56:00.471212 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1218/2438] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:56:00 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:56:03.542610 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a06d7-3d68-4bcd-881a-0176a9e602b3 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:03.543116 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a06d7-3d68-4bcd-881a-0176a9e602b3 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:03.543212 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a06d7-3d68-4bcd-881a-0176a9e602b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:03.659407 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-054a06d7-3d68-4bcd-881a-0176a9e602b3 None None] MFA Rules not processed for user `82536fd1a7004505b9c79b6bc570d9e4`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:56:03.661249 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-054a06d7-3d68-4bcd-881a-0176a9e602b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:56:03.733309 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1221/2439] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:56:03 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:56:03.745605 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4693f6-bfea-4fe2-ad1e-03e85a0691b4 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:56:03.758289 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4693f6-bfea-4fe2-ad1e-03e85a0691b4 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:56:03.763410 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea0429-fa95-40ec-8a92-8bb2c544ebd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:56:03.764265 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea0429-fa95-40ec-8a92-8bb2c544ebd7 service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:03.768826 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea0429-fa95-40ec-8a92-8bb2c544ebd7 service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:03.768826 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea0429-fa95-40ec-8a92-8bb2c544ebd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:03.773309 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea0429-fa95-40ec-8a92-8bb2c544ebd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:56:03.799416 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea0429-fa95-40ec-8a92-8bb2c544ebd7 service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:56:03.810112 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1219/2440] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:56:03 2021] GET /identity/v3/auth/tokens => generated 3694 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:56:05.832017 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10c5dc-b1f2-4dda-bec3-4020239e5c42 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:05.834098 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10c5dc-b1f2-4dda-bec3-4020239e5c42 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:05.834629 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10c5dc-b1f2-4dda-bec3-4020239e5c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:05.879417 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-8b10c5dc-b1f2-4dda-bec3-4020239e5c42 None None] MFA Rules not processed for user `82536fd1a7004505b9c79b6bc570d9e4`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:56:05.881337 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-8b10c5dc-b1f2-4dda-bec3-4020239e5c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:56:05.889010 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1222/2441] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:56:05 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:56:55.362123 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea0429-fa95-40ec-8a92-8bb2c544ebd7 service nova] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:56:55.363627 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-36ea0429-fa95-40ec-8a92-8bb2c544ebd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:56:55.375950 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea0429-fa95-40ec-8a92-8bb2c544ebd7 service nova] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:56:55.380754 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc61bfd-6090-425d-b3e8-87956898d8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:56:55.381538 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc61bfd-6090-425d-b3e8-87956898d8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:55.381826 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc61bfd-6090-425d-b3e8-87956898d8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:55.382106 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc61bfd-6090-425d-b3e8-87956898d8b4 admin admin] PATH_INFO: `/v3/users/9d51b92eaff649b89459a7b7a8a00d53` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:55.383213 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc61bfd-6090-425d-b3e8-87956898d8b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d51b92eaff649b89459a7b7a8a00d53)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:56:55.409150 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc61bfd-6090-425d-b3e8-87956898d8b4 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:56:55.457630 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-7fc61bfd-6090-425d-b3e8-87956898d8b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d51b92eaff649b89459a7b7a8a00d53'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:56:55.458246 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-7fc61bfd-6090-425d-b3e8-87956898d8b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d51b92eaff649b89459a7b7a8a00d53'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:56:55.465655 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-7fc61bfd-6090-425d-b3e8-87956898d8b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d51b92eaff649b89459a7b7a8a00d53'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:56:55.477310 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-7fc61bfd-6090-425d-b3e8-87956898d8b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d51b92eaff649b89459a7b7a8a00d53'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:56:55.484309 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-7fc61bfd-6090-425d-b3e8-87956898d8b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d51b92eaff649b89459a7b7a8a00d53'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:56:55.490780 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1220/2442] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:56:55 2021] DELETE /identity/v3/users/9d51b92eaff649b89459a7b7a8a00d53 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:56:55.495450 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c78ef-25a9-4be1-aadf-e9df2d9b0583 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:55.495949 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c78ef-25a9-4be1-aadf-e9df2d9b0583 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:55.496119 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c78ef-25a9-4be1-aadf-e9df2d9b0583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:55.517986 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-e33c78ef-25a9-4be1-aadf-e9df2d9b0583 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:56:55.519162 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-e33c78ef-25a9-4be1-aadf-e9df2d9b0583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:56:55.581663 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1223/2443] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:56:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:56:55.591651 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc61bfd-6090-425d-b3e8-87956898d8b4 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:56:55.592941 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-7fc61bfd-6090-425d-b3e8-87956898d8b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:56:55.657294 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc61bfd-6090-425d-b3e8-87956898d8b4 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:56:55.661383 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5d425-6c1d-4476-bb92-d1d221a5e6f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:56:55.661954 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5d425-6c1d-4476-bb92-d1d221a5e6f5 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:55.662238 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5d425-6c1d-4476-bb92-d1d221a5e6f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:55.662516 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5d425-6c1d-4476-bb92-d1d221a5e6f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:55.671113 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5d425-6c1d-4476-bb92-d1d221a5e6f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:56:55.698622 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5d425-6c1d-4476-bb92-d1d221a5e6f5 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:56:55.709212 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1221/2444] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:56:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:56:56.083175 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c78ef-25a9-4be1-aadf-e9df2d9b0583 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:56:56.084511 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-e33c78ef-25a9-4be1-aadf-e9df2d9b0583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:56:56.095941 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c78ef-25a9-4be1-aadf-e9df2d9b0583 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:56:56.100115 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7a3ba-bdcd-42ab-9133-0b467d6306df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:56:56.100889 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7a3ba-bdcd-42ab-9133-0b467d6306df admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:56.101182 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7a3ba-bdcd-42ab-9133-0b467d6306df admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:56.101463 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7a3ba-bdcd-42ab-9133-0b467d6306df admin admin] PATH_INFO: `/v3/projects/d697fb687c384432b3b6bc94f132109c` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:56.102522 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb7a3ba-bdcd-42ab-9133-0b467d6306df admin admin] RBAC: Authorizing `identity:delete_project(project_id=d697fb687c384432b3b6bc94f132109c)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:56:56.127888 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb7a3ba-bdcd-42ab-9133-0b467d6306df admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:56:56.177117 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ceb7a3ba-bdcd-42ab-9133-0b467d6306df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd697fb687c384432b3b6bc94f132109c', 'request_id': 'req-ceb7a3ba-bdcd-42ab-9133-0b467d6306df'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:56:56.183536 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ceb7a3ba-bdcd-42ab-9133-0b467d6306df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd697fb687c384432b3b6bc94f132109c', 'request_id': 'req-ceb7a3ba-bdcd-42ab-9133-0b467d6306df'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:56:56.194506 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ceb7a3ba-bdcd-42ab-9133-0b467d6306df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd697fb687c384432b3b6bc94f132109c', 'request_id': 'req-ceb7a3ba-bdcd-42ab-9133-0b467d6306df'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:56:56.203863 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ceb7a3ba-bdcd-42ab-9133-0b467d6306df admin admin] The token cache is being invalidate because project d697fb687c384432b3b6bc94f132109c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:56:56.204147 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ceb7a3ba-bdcd-42ab-9133-0b467d6306df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:56:56.205268 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ceb7a3ba-bdcd-42ab-9133-0b467d6306df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:56:56.206713 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1224/2445] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:56:56 2021] DELETE /identity/v3/projects/d697fb687c384432b3b6bc94f132109c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:56:56.210709 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5d425-6c1d-4476-bb92-d1d221a5e6f5 service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:56:56.220726 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5d425-6c1d-4476-bb92-d1d221a5e6f5 service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:56:56.282104 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb2509-4729-407b-8335-ad891333c056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:56:56.282932 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb2509-4729-407b-8335-ad891333c056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:56.283216 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb2509-4729-407b-8335-ad891333c056 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:56.283495 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb2509-4729-407b-8335-ad891333c056 admin admin] PATH_INFO: `/v3/users/87561ea99f5f41239932327cbaab5df8` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:56.284580 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb2509-4729-407b-8335-ad891333c056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87561ea99f5f41239932327cbaab5df8)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:56:56.310524 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb2509-4729-407b-8335-ad891333c056 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:56:56.357292 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-76fb2509-4729-407b-8335-ad891333c056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87561ea99f5f41239932327cbaab5df8'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:56:56.357925 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-76fb2509-4729-407b-8335-ad891333c056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87561ea99f5f41239932327cbaab5df8'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:56:56.365841 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-76fb2509-4729-407b-8335-ad891333c056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87561ea99f5f41239932327cbaab5df8'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:56:56.378003 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-76fb2509-4729-407b-8335-ad891333c056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87561ea99f5f41239932327cbaab5df8'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:56:56.384868 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-76fb2509-4729-407b-8335-ad891333c056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87561ea99f5f41239932327cbaab5df8'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:56:56.390596 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1222/2446] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:56:56 2021] DELETE /identity/v3/users/87561ea99f5f41239932327cbaab5df8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:56:56.738034 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7a3ba-bdcd-42ab-9133-0b467d6306df admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:56:56.739467 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-ceb7a3ba-bdcd-42ab-9133-0b467d6306df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:56:56.756951 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7a3ba-bdcd-42ab-9133-0b467d6306df admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:56:56.818577 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776f972-bacb-45e5-aaa8-a2e606c212a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:56:56.819393 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776f972-bacb-45e5-aaa8-a2e606c212a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:56.819676 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776f972-bacb-45e5-aaa8-a2e606c212a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:56.819954 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776f972-bacb-45e5-aaa8-a2e606c212a6 admin admin] PATH_INFO: `/v3/projects/877f2696f16e416e976d4d14140ae866` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:56.821026 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776f972-bacb-45e5-aaa8-a2e606c212a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=877f2696f16e416e976d4d14140ae866)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:56:56.848977 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776f972-bacb-45e5-aaa8-a2e606c212a6 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:56:56.899995 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-8776f972-bacb-45e5-aaa8-a2e606c212a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '877f2696f16e416e976d4d14140ae866', 'request_id': 'req-8776f972-bacb-45e5-aaa8-a2e606c212a6'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:56:56.908613 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-8776f972-bacb-45e5-aaa8-a2e606c212a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '877f2696f16e416e976d4d14140ae866', 'request_id': 'req-8776f972-bacb-45e5-aaa8-a2e606c212a6'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:56:56.932926 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-8776f972-bacb-45e5-aaa8-a2e606c212a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '877f2696f16e416e976d4d14140ae866', 'request_id': 'req-8776f972-bacb-45e5-aaa8-a2e606c212a6'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:56:56.935452 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-8776f972-bacb-45e5-aaa8-a2e606c212a6 admin admin] The token cache is being invalidate because project 877f2696f16e416e976d4d14140ae866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:56:56.935734 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-8776f972-bacb-45e5-aaa8-a2e606c212a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:56:56.936344 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-8776f972-bacb-45e5-aaa8-a2e606c212a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:56:56.937730 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1225/2447] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:56:56 2021] DELETE /identity/v3/projects/877f2696f16e416e976d4d14140ae866 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:56:56.944706 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53dbe4-4e75-4a37-80d2-458572f073bb None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:56.945019 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53dbe4-4e75-4a37-80d2-458572f073bb None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:56.945351 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53dbe4-4e75-4a37-80d2-458572f073bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:56.967724 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-9e53dbe4-4e75-4a37-80d2-458572f073bb None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:56:56.968859 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-9e53dbe4-4e75-4a37-80d2-458572f073bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:56:57.033811 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1223/2448] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:56:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:56:57.042860 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490148c5-1f75-4453-bb0a-a43de6b7d0c8 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:57.043154 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490148c5-1f75-4453-bb0a-a43de6b7d0c8 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:57.043434 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490148c5-1f75-4453-bb0a-a43de6b7d0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:57.065211 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-490148c5-1f75-4453-bb0a-a43de6b7d0c8 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:56:57.067136 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-490148c5-1f75-4453-bb0a-a43de6b7d0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:56:57.074153 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1226/2449] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:56:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:56:57.078267 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53dbe4-4e75-4a37-80d2-458572f073bb None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:56:57.088136 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53dbe4-4e75-4a37-80d2-458572f073bb None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:56:57.092271 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba6b51-fa80-44c5-bbc3-d319f480e0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:56:57.092852 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba6b51-fa80-44c5-bbc3-d319f480e0ac admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:57.093141 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba6b51-fa80-44c5-bbc3-d319f480e0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:57.093423 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba6b51-fa80-44c5-bbc3-d319f480e0ac admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:57.094109 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba6b51-fa80-44c5-bbc3-d319f480e0ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:56:57.094405 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba6b51-fa80-44c5-bbc3-d319f480e0ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:56:57.120320 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba6b51-fa80-44c5-bbc3-d319f480e0ac admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:56:57.133050 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1224/2450] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:56:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:56:57.137271 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490148c5-1f75-4453-bb0a-a43de6b7d0c8 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:56:57.146724 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490148c5-1f75-4453-bb0a-a43de6b7d0c8 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:56:57.150808 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dff660-75ba-4a8b-8508-950d77f6154c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:56:57.151378 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dff660-75ba-4a8b-8508-950d77f6154c admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:57.151665 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dff660-75ba-4a8b-8508-950d77f6154c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:57.151947 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dff660-75ba-4a8b-8508-950d77f6154c admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:57.152566 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dff660-75ba-4a8b-8508-950d77f6154c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:56:57.178860 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dff660-75ba-4a8b-8508-950d77f6154c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:56:57.205834 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1227/2451] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:56:57 2021] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:56:57.210070 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba6b51-fa80-44c5-bbc3-d319f480e0ac admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:56:57.219383 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba6b51-fa80-44c5-bbc3-d319f480e0ac admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:56:57.280578 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12945799-7f7c-44ea-a2d9-ac049b48fb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:56:57.281176 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12945799-7f7c-44ea-a2d9-ac049b48fb18 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:57.281459 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12945799-7f7c-44ea-a2d9-ac049b48fb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:57.281735 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12945799-7f7c-44ea-a2d9-ac049b48fb18 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:57.282371 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12945799-7f7c-44ea-a2d9-ac049b48fb18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:56:57.308145 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12945799-7f7c-44ea-a2d9-ac049b48fb18 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:56:57.327960 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1225/2452] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:56:57 2021] POST /identity/v3/users => generated 285 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:56:57.332594 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dff660-75ba-4a8b-8508-950d77f6154c admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:56:57.342359 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dff660-75ba-4a8b-8508-950d77f6154c admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:56:57.346498 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfd44e-720c-4bd0-bbf7-17bcb11faf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:56:57.347107 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfd44e-720c-4bd0-bbf7-17bcb11faf43 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:57.347395 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfd44e-720c-4bd0-bbf7-17bcb11faf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:57.347675 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfd44e-720c-4bd0-bbf7-17bcb11faf43 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:57.348355 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfd44e-720c-4bd0-bbf7-17bcb11faf43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:56:57.373310 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfd44e-720c-4bd0-bbf7-17bcb11faf43 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:56:57.384061 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1228/2453] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:56:57 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:56:57.388067 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12945799-7f7c-44ea-a2d9-ac049b48fb18 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:56:57.398140 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12945799-7f7c-44ea-a2d9-ac049b48fb18 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:56:57.402281 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6261643-91bd-43d0-822b-43d5567c755d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:56:57.403127 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6261643-91bd-43d0-822b-43d5567c755d admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:57.403416 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6261643-91bd-43d0-822b-43d5567c755d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:57.403695 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6261643-91bd-43d0-822b-43d5567c755d admin admin] PATH_INFO: `/v3/projects/81c73a53731e48678403aebc93092a90/users/e921d078254b4f60a2729449b6bd61cf/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:57.422820 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6261643-91bd-43d0-822b-43d5567c755d admin admin] RBAC: Authorizing `identity:create_grant(project_id=81c73a53731e48678403aebc93092a90, user_id=e921d078254b4f60a2729449b6bd61cf, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:56:57.449959 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6261643-91bd-43d0-822b-43d5567c755d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:56:57.463425 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1226/2454] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:56:57 2021] PUT /identity/v3/projects/81c73a53731e48678403aebc93092a90/users/e921d078254b4f60a2729449b6bd61cf/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:56:57.473371 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07482ee8-98c4-488c-8324-257c8ede66d9 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:57.473666 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07482ee8-98c4-488c-8324-257c8ede66d9 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:57.473950 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07482ee8-98c4-488c-8324-257c8ede66d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:57.509003 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-07482ee8-98c4-488c-8324-257c8ede66d9 None None] MFA Rules not processed for user `e921d078254b4f60a2729449b6bd61cf`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:56:57.510154 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-07482ee8-98c4-488c-8324-257c8ede66d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:56:57.580691 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1229/2455] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:56:57 2021] POST /identity/v3/auth/tokens => generated 3676 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:56:57.585107 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6261643-91bd-43d0-822b-43d5567c755d admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:56:57.654052 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6261643-91bd-43d0-822b-43d5567c755d admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:56:57.658261 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a7f15-de64-4ea6-929e-e312534c2020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:56:57.658899 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a7f15-de64-4ea6-929e-e312534c2020 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:57.659186 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a7f15-de64-4ea6-929e-e312534c2020 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:57.659493 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a7f15-de64-4ea6-929e-e312534c2020 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:57.660136 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a7f15-de64-4ea6-929e-e312534c2020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:56:57.686293 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a7f15-de64-4ea6-929e-e312534c2020 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:56:57.726251 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1227/2456] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:56:57 2021] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:56:57.728319 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07482ee8-98c4-488c-8324-257c8ede66d9 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:56:57.739129 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07482ee8-98c4-488c-8324-257c8ede66d9 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:56:57.799755 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51bc11-93ca-4ae7-a904-fc60e2077a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:56:57.800341 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51bc11-93ca-4ae7-a904-fc60e2077a00 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:57.800623 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51bc11-93ca-4ae7-a904-fc60e2077a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:57.800905 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51bc11-93ca-4ae7-a904-fc60e2077a00 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:57.801529 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51bc11-93ca-4ae7-a904-fc60e2077a00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:56:57.826938 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51bc11-93ca-4ae7-a904-fc60e2077a00 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:56:57.848318 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1230/2457] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:56:57 2021] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:56:57.852392 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a7f15-de64-4ea6-929e-e312534c2020 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:56:57.862448 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a7f15-de64-4ea6-929e-e312534c2020 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:56:57.866633 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c900a-e17d-4ed7-abf2-e7b1a8895657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:56:57.867248 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c900a-e17d-4ed7-abf2-e7b1a8895657 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:57.867534 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c900a-e17d-4ed7-abf2-e7b1a8895657 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:57.867813 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c900a-e17d-4ed7-abf2-e7b1a8895657 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:57.868503 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c900a-e17d-4ed7-abf2-e7b1a8895657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:56:57.894689 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c900a-e17d-4ed7-abf2-e7b1a8895657 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:56:57.906086 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1228/2458] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:56:57 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:56:57.911023 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51bc11-93ca-4ae7-a904-fc60e2077a00 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:56:57.920402 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51bc11-93ca-4ae7-a904-fc60e2077a00 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:56:57.925192 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63edb3-420a-4c22-8399-b0f7cf3c516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:56:57.925992 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63edb3-420a-4c22-8399-b0f7cf3c516a admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:57.926277 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63edb3-420a-4c22-8399-b0f7cf3c516a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:57.926555 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63edb3-420a-4c22-8399-b0f7cf3c516a admin admin] PATH_INFO: `/v3/projects/4eb6cdbf4f664333a4274cff1eb7bdc3/users/b6e4bc2190fa48e2b847a652fe478f80/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:57.947185 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63edb3-420a-4c22-8399-b0f7cf3c516a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb6cdbf4f664333a4274cff1eb7bdc3, user_id=b6e4bc2190fa48e2b847a652fe478f80, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:56:57.973737 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63edb3-420a-4c22-8399-b0f7cf3c516a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:56:57.987052 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1231/2459] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:56:57 2021] PUT /identity/v3/projects/4eb6cdbf4f664333a4274cff1eb7bdc3/users/b6e4bc2190fa48e2b847a652fe478f80/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:56:57.991155 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c900a-e17d-4ed7-abf2-e7b1a8895657 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:56:58.000428 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c900a-e17d-4ed7-abf2-e7b1a8895657 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:56:58.061583 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1170af-c74f-467a-be5e-ccb985784b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:56:58.062182 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1170af-c74f-467a-be5e-ccb985784b42 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:58.062469 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1170af-c74f-467a-be5e-ccb985784b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:58.062781 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1170af-c74f-467a-be5e-ccb985784b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:58.063466 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1170af-c74f-467a-be5e-ccb985784b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:56:58.090065 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1170af-c74f-467a-be5e-ccb985784b42 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:56:58.101240 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1229/2460] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:56:57 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:56:58.105183 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63edb3-420a-4c22-8399-b0f7cf3c516a admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:56:58.115827 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63edb3-420a-4c22-8399-b0f7cf3c516a admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:56:58.120086 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75799c4d-a882-4ca7-ae1e-8254fb8ac55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:56:58.120888 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75799c4d-a882-4ca7-ae1e-8254fb8ac55d admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:58.121177 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75799c4d-a882-4ca7-ae1e-8254fb8ac55d admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:58.121458 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75799c4d-a882-4ca7-ae1e-8254fb8ac55d admin admin] PATH_INFO: `/v3/projects/4eb6cdbf4f664333a4274cff1eb7bdc3/users/b6e4bc2190fa48e2b847a652fe478f80/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:58.123247 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75799c4d-a882-4ca7-ae1e-8254fb8ac55d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb6cdbf4f664333a4274cff1eb7bdc3, user_id=b6e4bc2190fa48e2b847a652fe478f80, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:56:58.149917 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75799c4d-a882-4ca7-ae1e-8254fb8ac55d admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:56:58.160496 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1232/2461] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:56:58 2021] PUT /identity/v3/projects/4eb6cdbf4f664333a4274cff1eb7bdc3/users/b6e4bc2190fa48e2b847a652fe478f80/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:56:58.164221 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1170af-c74f-467a-be5e-ccb985784b42 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:56:58.174236 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1170af-c74f-467a-be5e-ccb985784b42 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:56:58.238172 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2094430-eddf-439b-8053-4897521c141b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:56:58.238828 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2094430-eddf-439b-8053-4897521c141b admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:58.239113 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2094430-eddf-439b-8053-4897521c141b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:58.239394 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2094430-eddf-439b-8053-4897521c141b admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:58.240083 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2094430-eddf-439b-8053-4897521c141b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:56:58.267112 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2094430-eddf-439b-8053-4897521c141b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:56:58.279357 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1230/2462] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:56:58 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:56:58.284105 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75799c4d-a882-4ca7-ae1e-8254fb8ac55d admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:56:58.294011 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75799c4d-a882-4ca7-ae1e-8254fb8ac55d admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:56:58.299133 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76967716-90b2-46b8-823b-81598012cfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:56:58.299950 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76967716-90b2-46b8-823b-81598012cfde admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:58.300237 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76967716-90b2-46b8-823b-81598012cfde admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:58.300521 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76967716-90b2-46b8-823b-81598012cfde admin admin] PATH_INFO: `/v3/projects/4eb6cdbf4f664333a4274cff1eb7bdc3/users/b6e4bc2190fa48e2b847a652fe478f80/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:58.302488 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76967716-90b2-46b8-823b-81598012cfde admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb6cdbf4f664333a4274cff1eb7bdc3, user_id=b6e4bc2190fa48e2b847a652fe478f80, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:56:58.333424 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76967716-90b2-46b8-823b-81598012cfde admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:56:58.349466 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1233/2463] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:56:58 2021] PUT /identity/v3/projects/4eb6cdbf4f664333a4274cff1eb7bdc3/users/b6e4bc2190fa48e2b847a652fe478f80/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:56:58.359669 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8db2e-704c-4342-9133-62c3d6717e7e None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:58.360048 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8db2e-704c-4342-9133-62c3d6717e7e None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:58.360334 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8db2e-704c-4342-9133-62c3d6717e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:58.395834 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-c9c8db2e-704c-4342-9133-62c3d6717e7e None None] MFA Rules not processed for user `b6e4bc2190fa48e2b847a652fe478f80`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:56:58.396990 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-c9c8db2e-704c-4342-9133-62c3d6717e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:56:58.470569 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1231/2464] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:56:58 2021] POST /identity/v3/auth/tokens => generated 3739 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:56:58.479994 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76967716-90b2-46b8-823b-81598012cfde admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:56:58.481572 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-76967716-90b2-46b8-823b-81598012cfde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:56:58.546052 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76967716-90b2-46b8-823b-81598012cfde admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:56:58.549542 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab95da-ff86-4bf0-bf63-a4326ee51d15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:56:58.550115 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab95da-ff86-4bf0-bf63-a4326ee51d15 service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:58.550396 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab95da-ff86-4bf0-bf63-a4326ee51d15 service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:58.550700 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab95da-ff86-4bf0-bf63-a4326ee51d15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:58.559428 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab95da-ff86-4bf0-bf63-a4326ee51d15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:56:58.585214 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab95da-ff86-4bf0-bf63-a4326ee51d15 service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:56:58.595852 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1234/2465] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:56:58 2021] GET /identity/v3/auth/tokens => generated 3739 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:56:59.379377 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5b70e-292d-453e-bfcf-824160195d34 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:56:59.379666 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5b70e-292d-453e-bfcf-824160195d34 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:56:59.380178 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5b70e-292d-453e-bfcf-824160195d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:56:59.401765 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-a9e5b70e-292d-453e-bfcf-824160195d34 None None] MFA Rules not processed for user `abea74c48ef444f5b8dd15fdc4ce5a71`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:56:59.402941 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-a9e5b70e-292d-453e-bfcf-824160195d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:56:59.472877 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1232/2466] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:56:59 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:57:00.503621 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab95da-ff86-4bf0-bf63-a4326ee51d15 service cinder] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:00.594610 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab95da-ff86-4bf0-bf63-a4326ee51d15 service cinder] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:00.599353 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a7562-9fdf-4d34-92ef-b7c074db7a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:00.612170 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a7562-9fdf-4d34-92ef-b7c074db7a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:00.612591 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a7562-9fdf-4d34-92ef-b7c074db7a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:00.612972 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a7562-9fdf-4d34-92ef-b7c074db7a5c admin admin] PATH_INFO: `/v3/users/e921d078254b4f60a2729449b6bd61cf` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:00.615433 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a7562-9fdf-4d34-92ef-b7c074db7a5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e921d078254b4f60a2729449b6bd61cf)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:00.666443 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a7562-9fdf-4d34-92ef-b7c074db7a5c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:00.739666 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-de3a7562-9fdf-4d34-92ef-b7c074db7a5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e921d078254b4f60a2729449b6bd61cf'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:00.760104 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-de3a7562-9fdf-4d34-92ef-b7c074db7a5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e921d078254b4f60a2729449b6bd61cf'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:00.761039 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-de3a7562-9fdf-4d34-92ef-b7c074db7a5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e921d078254b4f60a2729449b6bd61cf'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:00.773185 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-de3a7562-9fdf-4d34-92ef-b7c074db7a5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e921d078254b4f60a2729449b6bd61cf'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:00.789390 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-de3a7562-9fdf-4d34-92ef-b7c074db7a5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e921d078254b4f60a2729449b6bd61cf'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:00.804293 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1235/2467] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:57:00 2021] DELETE /identity/v3/users/e921d078254b4f60a2729449b6bd61cf => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:57:00.809154 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728f425-34f5-44a2-a63a-6d110db9d454 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:00.809987 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728f425-34f5-44a2-a63a-6d110db9d454 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:00.810566 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728f425-34f5-44a2-a63a-6d110db9d454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:00.841666 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-0728f425-34f5-44a2-a63a-6d110db9d454 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:57:00.843514 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-0728f425-34f5-44a2-a63a-6d110db9d454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:00.946972 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1233/2468] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:57:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:57:00.960760 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a7562-9fdf-4d34-92ef-b7c074db7a5c admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:00.963006 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-de3a7562-9fdf-4d34-92ef-b7c074db7a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:01.056857 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a7562-9fdf-4d34-92ef-b7c074db7a5c admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:01.062164 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4baac-d898-429c-a025-c1171729baca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:01.062891 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4baac-d898-429c-a025-c1171729baca service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:01.063187 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4baac-d898-429c-a025-c1171729baca service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:01.064066 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4baac-d898-429c-a025-c1171729baca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:01.076265 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4baac-d898-429c-a025-c1171729baca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:01.103931 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4baac-d898-429c-a025-c1171729baca service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:01.114765 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1236/2469] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:57:00 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:57:01.525970 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728f425-34f5-44a2-a63a-6d110db9d454 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:01.527637 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-0728f425-34f5-44a2-a63a-6d110db9d454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:01.545178 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728f425-34f5-44a2-a63a-6d110db9d454 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:01.549798 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c5d2d-7cb3-4ae3-b4d4-dbc6c806a842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:01.550811 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c5d2d-7cb3-4ae3-b4d4-dbc6c806a842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:01.551307 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c5d2d-7cb3-4ae3-b4d4-dbc6c806a842 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:01.551864 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c5d2d-7cb3-4ae3-b4d4-dbc6c806a842 admin admin] PATH_INFO: `/v3/projects/81c73a53731e48678403aebc93092a90` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:01.552953 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c5d2d-7cb3-4ae3-b4d4-dbc6c806a842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81c73a53731e48678403aebc93092a90)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:01.582092 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c5d2d-7cb3-4ae3-b4d4-dbc6c806a842 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:01.648472 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6c5c5d2d-7cb3-4ae3-b4d4-dbc6c806a842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81c73a53731e48678403aebc93092a90', 'request_id': 'req-6c5c5d2d-7cb3-4ae3-b4d4-dbc6c806a842'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:01.658838 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6c5c5d2d-7cb3-4ae3-b4d4-dbc6c806a842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81c73a53731e48678403aebc93092a90', 'request_id': 'req-6c5c5d2d-7cb3-4ae3-b4d4-dbc6c806a842'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:01.667522 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6c5c5d2d-7cb3-4ae3-b4d4-dbc6c806a842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81c73a53731e48678403aebc93092a90', 'request_id': 'req-6c5c5d2d-7cb3-4ae3-b4d4-dbc6c806a842'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:01.692899 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6c5c5d2d-7cb3-4ae3-b4d4-dbc6c806a842 admin admin] The token cache is being invalidate because project 81c73a53731e48678403aebc93092a90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:57:01.693370 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6c5c5d2d-7cb3-4ae3-b4d4-dbc6c806a842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:01.694335 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6c5c5d2d-7cb3-4ae3-b4d4-dbc6c806a842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:01.696089 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1234/2470] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:57:01 2021] DELETE /identity/v3/projects/81c73a53731e48678403aebc93092a90 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:57:01.700009 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4baac-d898-429c-a025-c1171729baca service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:01.711500 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4baac-d898-429c-a025-c1171729baca service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:01.798126 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081d557-f1a0-4471-8463-f1a9cf185450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:01.799041 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081d557-f1a0-4471-8463-f1a9cf185450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:01.799431 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081d557-f1a0-4471-8463-f1a9cf185450 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:01.799831 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081d557-f1a0-4471-8463-f1a9cf185450 admin admin] PATH_INFO: `/v3/users/b6e4bc2190fa48e2b847a652fe478f80` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:01.801015 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081d557-f1a0-4471-8463-f1a9cf185450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6e4bc2190fa48e2b847a652fe478f80)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:01.849982 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081d557-f1a0-4471-8463-f1a9cf185450 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:01.939996 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-1081d557-f1a0-4471-8463-f1a9cf185450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6e4bc2190fa48e2b847a652fe478f80'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:01.952061 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-1081d557-f1a0-4471-8463-f1a9cf185450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6e4bc2190fa48e2b847a652fe478f80'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:01.952762 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-1081d557-f1a0-4471-8463-f1a9cf185450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6e4bc2190fa48e2b847a652fe478f80'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:01.960953 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-1081d557-f1a0-4471-8463-f1a9cf185450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6e4bc2190fa48e2b847a652fe478f80'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:01.967907 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-1081d557-f1a0-4471-8463-f1a9cf185450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6e4bc2190fa48e2b847a652fe478f80'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:01.973960 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1237/2471] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:57:01 2021] DELETE /identity/v3/users/b6e4bc2190fa48e2b847a652fe478f80 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:57:02.345612 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c5d2d-7cb3-4ae3-b4d4-dbc6c806a842 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:02.347778 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-6c5c5d2d-7cb3-4ae3-b4d4-dbc6c806a842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:02.363258 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c5d2d-7cb3-4ae3-b4d4-dbc6c806a842 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:02.428460 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010fa4fa-cbec-4be4-b04f-56be675e0180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:02.429249 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fa4fa-cbec-4be4-b04f-56be675e0180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:02.429533 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fa4fa-cbec-4be4-b04f-56be675e0180 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:02.429812 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fa4fa-cbec-4be4-b04f-56be675e0180 admin admin] PATH_INFO: `/v3/projects/4eb6cdbf4f664333a4274cff1eb7bdc3` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:02.430909 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010fa4fa-cbec-4be4-b04f-56be675e0180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eb6cdbf4f664333a4274cff1eb7bdc3)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:02.460013 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010fa4fa-cbec-4be4-b04f-56be675e0180 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:02.512257 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-010fa4fa-cbec-4be4-b04f-56be675e0180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eb6cdbf4f664333a4274cff1eb7bdc3', 'request_id': 'req-010fa4fa-cbec-4be4-b04f-56be675e0180'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:02.519594 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-010fa4fa-cbec-4be4-b04f-56be675e0180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eb6cdbf4f664333a4274cff1eb7bdc3', 'request_id': 'req-010fa4fa-cbec-4be4-b04f-56be675e0180'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:02.534731 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-010fa4fa-cbec-4be4-b04f-56be675e0180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eb6cdbf4f664333a4274cff1eb7bdc3', 'request_id': 'req-010fa4fa-cbec-4be4-b04f-56be675e0180'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:02.551810 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-010fa4fa-cbec-4be4-b04f-56be675e0180 admin admin] The token cache is being invalidate because project 4eb6cdbf4f664333a4274cff1eb7bdc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:57:02.552096 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-010fa4fa-cbec-4be4-b04f-56be675e0180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:02.552714 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-010fa4fa-cbec-4be4-b04f-56be675e0180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:02.554151 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1235/2472] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:57:02 2021] DELETE /identity/v3/projects/4eb6cdbf4f664333a4274cff1eb7bdc3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:57:02.560165 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4810e6-d82a-4344-a1ad-4812c2cc7dc8 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:02.560535 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4810e6-d82a-4344-a1ad-4812c2cc7dc8 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:02.560889 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4810e6-d82a-4344-a1ad-4812c2cc7dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:02.584476 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-5d4810e6-d82a-4344-a1ad-4812c2cc7dc8 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:57:02.585848 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-5d4810e6-d82a-4344-a1ad-4812c2cc7dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:02.653145 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1238/2473] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:57:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:57:02.662815 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259a1cb-5b41-4994-a12b-41ec38538ea1 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:02.663112 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259a1cb-5b41-4994-a12b-41ec38538ea1 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:02.663395 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259a1cb-5b41-4994-a12b-41ec38538ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:02.686085 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-0259a1cb-5b41-4994-a12b-41ec38538ea1 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:57:02.687263 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-0259a1cb-5b41-4994-a12b-41ec38538ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:02.695339 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1236/2474] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:57:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:57:02.699374 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4810e6-d82a-4344-a1ad-4812c2cc7dc8 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:02.709483 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4810e6-d82a-4344-a1ad-4812c2cc7dc8 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:02.713877 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ea1d6-a46a-42e6-a29f-8fc564a338ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:02.714601 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ea1d6-a46a-42e6-a29f-8fc564a338ba admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:02.714977 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ea1d6-a46a-42e6-a29f-8fc564a338ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:02.715327 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ea1d6-a46a-42e6-a29f-8fc564a338ba admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:02.716081 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ea1d6-a46a-42e6-a29f-8fc564a338ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:57:02.716466 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ea1d6-a46a-42e6-a29f-8fc564a338ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:02.753553 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ea1d6-a46a-42e6-a29f-8fc564a338ba admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:02.773542 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1239/2475] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:57:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:57:02.774675 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259a1cb-5b41-4994-a12b-41ec38538ea1 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:02.784025 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259a1cb-5b41-4994-a12b-41ec38538ea1 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:02.788702 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27a10a-ec7f-4884-a7ac-30163e6542ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:02.789295 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27a10a-ec7f-4884-a7ac-30163e6542ab admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:02.789587 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27a10a-ec7f-4884-a7ac-30163e6542ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:02.789872 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27a10a-ec7f-4884-a7ac-30163e6542ab admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:02.790508 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27a10a-ec7f-4884-a7ac-30163e6542ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:02.818302 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27a10a-ec7f-4884-a7ac-30163e6542ab admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:02.850159 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1237/2476] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:57:02 2021] POST /identity/v3/projects => generated 401 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:57:02.854693 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ea1d6-a46a-42e6-a29f-8fc564a338ba admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:02.865893 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ea1d6-a46a-42e6-a29f-8fc564a338ba admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:02.932123 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92185d4d-f5c0-40f7-ae24-bb99457a0d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:02.932730 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92185d4d-f5c0-40f7-ae24-bb99457a0d01 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:02.933023 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92185d4d-f5c0-40f7-ae24-bb99457a0d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:02.933441 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92185d4d-f5c0-40f7-ae24-bb99457a0d01 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:02.934089 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92185d4d-f5c0-40f7-ae24-bb99457a0d01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:02.961206 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92185d4d-f5c0-40f7-ae24-bb99457a0d01 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:02.983558 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1240/2477] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:57:02 2021] POST /identity/v3/users => generated 301 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:57:02.988125 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27a10a-ec7f-4884-a7ac-30163e6542ab admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:02.998478 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27a10a-ec7f-4884-a7ac-30163e6542ab admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:03.003482 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b68df2-493f-47b4-886d-3f08fe68b024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:03.004090 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b68df2-493f-47b4-886d-3f08fe68b024 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:03.004380 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b68df2-493f-47b4-886d-3f08fe68b024 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:03.004669 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b68df2-493f-47b4-886d-3f08fe68b024 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:03.005356 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b68df2-493f-47b4-886d-3f08fe68b024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:03.031537 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b68df2-493f-47b4-886d-3f08fe68b024 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:03.043187 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1238/2478] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:57:02 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:57:03.047555 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92185d4d-f5c0-40f7-ae24-bb99457a0d01 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:03.059178 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92185d4d-f5c0-40f7-ae24-bb99457a0d01 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:03.063579 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd34679-eecd-402b-8e3f-61af66ca6a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:03.064396 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd34679-eecd-402b-8e3f-61af66ca6a25 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:03.064686 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd34679-eecd-402b-8e3f-61af66ca6a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:03.064975 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd34679-eecd-402b-8e3f-61af66ca6a25 admin admin] PATH_INFO: `/v3/projects/3ad1d157ad0d4e1d8bc3dcb876a22199/users/babcdbeef8034757a39bc78b59c2093a/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:03.085832 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd34679-eecd-402b-8e3f-61af66ca6a25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ad1d157ad0d4e1d8bc3dcb876a22199, user_id=babcdbeef8034757a39bc78b59c2093a, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:03.113493 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd34679-eecd-402b-8e3f-61af66ca6a25 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:03.127149 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1241/2479] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:57:03 2021] PUT /identity/v3/projects/3ad1d157ad0d4e1d8bc3dcb876a22199/users/babcdbeef8034757a39bc78b59c2093a/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:57:03.137288 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01055e59-cf78-4860-9d82-26252fd13c07 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:03.137588 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01055e59-cf78-4860-9d82-26252fd13c07 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:03.138608 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01055e59-cf78-4860-9d82-26252fd13c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:03.179631 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-01055e59-cf78-4860-9d82-26252fd13c07 None None] MFA Rules not processed for user `babcdbeef8034757a39bc78b59c2093a`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:57:03.180696 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-01055e59-cf78-4860-9d82-26252fd13c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:03.263442 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1239/2480] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:57:03 2021] POST /identity/v3/auth/tokens => generated 3708 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:57:03.268820 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd34679-eecd-402b-8e3f-61af66ca6a25 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:03.338242 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd34679-eecd-402b-8e3f-61af66ca6a25 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:03.342629 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e3dc2-bbc6-4f01-9d65-b77ba7e44785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:03.343241 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e3dc2-bbc6-4f01-9d65-b77ba7e44785 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:03.343530 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e3dc2-bbc6-4f01-9d65-b77ba7e44785 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:03.343810 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e3dc2-bbc6-4f01-9d65-b77ba7e44785 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:03.344455 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e3dc2-bbc6-4f01-9d65-b77ba7e44785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:03.371182 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e3dc2-bbc6-4f01-9d65-b77ba7e44785 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:03.397888 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1242/2481] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:57:03 2021] POST /identity/v3/projects => generated 401 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:57:03.401907 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01055e59-cf78-4860-9d82-26252fd13c07 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:03.412188 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01055e59-cf78-4860-9d82-26252fd13c07 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:03.478594 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5393516-31a8-467a-bb8f-f1186e1ce49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:03.479151 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5393516-31a8-467a-bb8f-f1186e1ce49e admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:03.479441 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5393516-31a8-467a-bb8f-f1186e1ce49e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:03.479725 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5393516-31a8-467a-bb8f-f1186e1ce49e admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:03.480410 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5393516-31a8-467a-bb8f-f1186e1ce49e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:03.507025 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5393516-31a8-467a-bb8f-f1186e1ce49e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:03.528079 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1240/2482] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:57:03 2021] POST /identity/v3/users => generated 307 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:57:03.532696 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e3dc2-bbc6-4f01-9d65-b77ba7e44785 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:03.555865 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e3dc2-bbc6-4f01-9d65-b77ba7e44785 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:03.561335 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6beb5-ce59-4280-804a-e1ae71fab470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:03.562181 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6beb5-ce59-4280-804a-e1ae71fab470 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:03.562539 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6beb5-ce59-4280-804a-e1ae71fab470 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:03.563384 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6beb5-ce59-4280-804a-e1ae71fab470 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:03.564125 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6beb5-ce59-4280-804a-e1ae71fab470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:03.591528 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6beb5-ce59-4280-804a-e1ae71fab470 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:03.604718 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1243/2483] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:57:03 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:57:03.608931 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5393516-31a8-467a-bb8f-f1186e1ce49e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:03.619688 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5393516-31a8-467a-bb8f-f1186e1ce49e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:03.625222 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc5e65-ae36-464d-9ba2-2a47d39d306a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:03.629420 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc5e65-ae36-464d-9ba2-2a47d39d306a admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:03.629873 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc5e65-ae36-464d-9ba2-2a47d39d306a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:03.630700 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc5e65-ae36-464d-9ba2-2a47d39d306a admin admin] PATH_INFO: `/v3/projects/cf7984f4e6db4636920e01a31161f69e/users/91bf5d538dda4e38bf888a0a9f805f9c/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:03.651796 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc5e65-ae36-464d-9ba2-2a47d39d306a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf7984f4e6db4636920e01a31161f69e, user_id=91bf5d538dda4e38bf888a0a9f805f9c, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:03.681329 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc5e65-ae36-464d-9ba2-2a47d39d306a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:03.696984 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1241/2484] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:57:03 2021] PUT /identity/v3/projects/cf7984f4e6db4636920e01a31161f69e/users/91bf5d538dda4e38bf888a0a9f805f9c/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:57:03.700930 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6beb5-ce59-4280-804a-e1ae71fab470 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:03.711072 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6beb5-ce59-4280-804a-e1ae71fab470 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:03.785989 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67c96b-2c88-47c2-8f7b-8e33a6c63607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:03.786640 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67c96b-2c88-47c2-8f7b-8e33a6c63607 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:03.787029 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67c96b-2c88-47c2-8f7b-8e33a6c63607 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:03.787384 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67c96b-2c88-47c2-8f7b-8e33a6c63607 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:03.788160 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67c96b-2c88-47c2-8f7b-8e33a6c63607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:03.815711 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67c96b-2c88-47c2-8f7b-8e33a6c63607 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:03.830714 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1244/2485] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:57:03 2021] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:57:03.834173 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc5e65-ae36-464d-9ba2-2a47d39d306a admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:03.897072 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc5e65-ae36-464d-9ba2-2a47d39d306a admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:03.903432 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbb2a2-5eb1-490a-9190-f339b65db159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:03.904260 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbb2a2-5eb1-490a-9190-f339b65db159 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:03.904572 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbb2a2-5eb1-490a-9190-f339b65db159 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:03.904885 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbb2a2-5eb1-490a-9190-f339b65db159 admin admin] PATH_INFO: `/v3/projects/cf7984f4e6db4636920e01a31161f69e/users/91bf5d538dda4e38bf888a0a9f805f9c/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:03.906959 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbb2a2-5eb1-490a-9190-f339b65db159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf7984f4e6db4636920e01a31161f69e, user_id=91bf5d538dda4e38bf888a0a9f805f9c, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:03.936201 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbb2a2-5eb1-490a-9190-f339b65db159 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:03.947751 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1242/2486] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:57:03 2021] PUT /identity/v3/projects/cf7984f4e6db4636920e01a31161f69e/users/91bf5d538dda4e38bf888a0a9f805f9c/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:57:03.951654 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67c96b-2c88-47c2-8f7b-8e33a6c63607 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:03.961961 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67c96b-2c88-47c2-8f7b-8e33a6c63607 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:04.025627 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56453ed7-ab41-4926-b599-b32840ba9636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:04.026223 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56453ed7-ab41-4926-b599-b32840ba9636 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:04.026516 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56453ed7-ab41-4926-b599-b32840ba9636 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:04.026835 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56453ed7-ab41-4926-b599-b32840ba9636 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:04.027521 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56453ed7-ab41-4926-b599-b32840ba9636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:04.054071 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56453ed7-ab41-4926-b599-b32840ba9636 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:04.065650 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1245/2487] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:57:03 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:57:04.069768 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbb2a2-5eb1-490a-9190-f339b65db159 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:04.079747 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbb2a2-5eb1-490a-9190-f339b65db159 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:04.084036 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6998f8-5332-4cb0-a2b0-78385060208b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:04.084876 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6998f8-5332-4cb0-a2b0-78385060208b admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:04.085166 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6998f8-5332-4cb0-a2b0-78385060208b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:04.085448 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6998f8-5332-4cb0-a2b0-78385060208b admin admin] PATH_INFO: `/v3/projects/cf7984f4e6db4636920e01a31161f69e/users/91bf5d538dda4e38bf888a0a9f805f9c/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:04.087247 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6998f8-5332-4cb0-a2b0-78385060208b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf7984f4e6db4636920e01a31161f69e, user_id=91bf5d538dda4e38bf888a0a9f805f9c, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:04.115112 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6998f8-5332-4cb0-a2b0-78385060208b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:04.131236 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1243/2488] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:57:04 2021] PUT /identity/v3/projects/cf7984f4e6db4636920e01a31161f69e/users/91bf5d538dda4e38bf888a0a9f805f9c/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:57:04.141264 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7503665-fc79-4b1d-93a4-c3a93e6abfd1 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:04.141588 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7503665-fc79-4b1d-93a4-c3a93e6abfd1 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:04.141874 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7503665-fc79-4b1d-93a4-c3a93e6abfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:04.189064 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-e7503665-fc79-4b1d-93a4-c3a93e6abfd1 None None] MFA Rules not processed for user `91bf5d538dda4e38bf888a0a9f805f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:57:04.190214 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-e7503665-fc79-4b1d-93a4-c3a93e6abfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:04.270169 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1246/2489] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:57:04 2021] POST /identity/v3/auth/tokens => generated 3775 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:57:04.279406 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6998f8-5332-4cb0-a2b0-78385060208b admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:04.281009 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-bf6998f8-5332-4cb0-a2b0-78385060208b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:04.347582 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6998f8-5332-4cb0-a2b0-78385060208b admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:04.350999 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25445ce1-6629-4390-89bd-7d5cebf0c898 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:04.351593 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25445ce1-6629-4390-89bd-7d5cebf0c898 service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:04.351883 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25445ce1-6629-4390-89bd-7d5cebf0c898 service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:04.352168 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25445ce1-6629-4390-89bd-7d5cebf0c898 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:04.361773 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25445ce1-6629-4390-89bd-7d5cebf0c898 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:04.387437 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25445ce1-6629-4390-89bd-7d5cebf0c898 service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:04.397996 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1244/2490] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:57:04 2021] GET /identity/v3/auth/tokens => generated 3775 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:57:04.507319 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7503665-fc79-4b1d-93a4-c3a93e6abfd1 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:04.517337 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7503665-fc79-4b1d-93a4-c3a93e6abfd1 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:04.521028 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373ab0b-894e-459c-89c5-4890d9db258b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:04.521983 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373ab0b-894e-459c-89c5-4890d9db258b service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:04.522363 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373ab0b-894e-459c-89c5-4890d9db258b service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:04.522805 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373ab0b-894e-459c-89c5-4890d9db258b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:04.595063 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373ab0b-894e-459c-89c5-4890d9db258b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:04.621046 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373ab0b-894e-459c-89c5-4890d9db258b service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:04.632022 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1247/2491] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:57:04 2021] GET /identity/v3/auth/tokens => generated 3708 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:57:05.026360 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25445ce1-6629-4390-89bd-7d5cebf0c898 service cinder] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:05.027851 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-25445ce1-6629-4390-89bd-7d5cebf0c898 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:05.113809 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25445ce1-6629-4390-89bd-7d5cebf0c898 service cinder] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:05.115061 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c69487-8bcf-4810-8afe-4257a631d04d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:05.115636 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c69487-8bcf-4810-8afe-4257a631d04d service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:05.115925 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c69487-8bcf-4810-8afe-4257a631d04d service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:05.116202 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c69487-8bcf-4810-8afe-4257a631d04d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:05.118009 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-f7c69487-8bcf-4810-8afe-4257a631d04d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:05.199876 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c69487-8bcf-4810-8afe-4257a631d04d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:05.226416 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c69487-8bcf-4810-8afe-4257a631d04d service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:05.237786 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1245/2492] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:57:05 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:57:07.456022 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373ab0b-894e-459c-89c5-4890d9db258b service cinder] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:07.457460 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-a373ab0b-894e-459c-89c5-4890d9db258b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:07.468715 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373ab0b-894e-459c-89c5-4890d9db258b service cinder] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:07.472848 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f862878-d2f3-4e9a-bf17-2a2daa97571d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:07.473406 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f862878-d2f3-4e9a-bf17-2a2daa97571d service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:07.473694 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f862878-d2f3-4e9a-bf17-2a2daa97571d service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:07.473977 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f862878-d2f3-4e9a-bf17-2a2daa97571d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:07.475568 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-2f862878-d2f3-4e9a-bf17-2a2daa97571d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:07.487897 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f862878-d2f3-4e9a-bf17-2a2daa97571d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:07.512719 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f862878-d2f3-4e9a-bf17-2a2daa97571d service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:07.523677 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1248/2493] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:57:07 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:57:09.294297 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c69487-8bcf-4810-8afe-4257a631d04d service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:09.361374 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c69487-8bcf-4810-8afe-4257a631d04d service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:09.365683 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85d7a5-5378-4224-aa0b-ca488a46571d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:09.366510 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85d7a5-5378-4224-aa0b-ca488a46571d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:09.366823 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85d7a5-5378-4224-aa0b-ca488a46571d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:09.367105 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85d7a5-5378-4224-aa0b-ca488a46571d admin admin] PATH_INFO: `/v3/users/babcdbeef8034757a39bc78b59c2093a` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:09.368170 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85d7a5-5378-4224-aa0b-ca488a46571d admin admin] RBAC: Authorizing `identity:delete_user(user_id=babcdbeef8034757a39bc78b59c2093a)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:09.394818 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85d7a5-5378-4224-aa0b-ca488a46571d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:09.440566 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-8f85d7a5-5378-4224-aa0b-ca488a46571d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'babcdbeef8034757a39bc78b59c2093a'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:09.441421 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-8f85d7a5-5378-4224-aa0b-ca488a46571d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'babcdbeef8034757a39bc78b59c2093a'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:09.448703 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-8f85d7a5-5378-4224-aa0b-ca488a46571d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'babcdbeef8034757a39bc78b59c2093a'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:09.460390 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-8f85d7a5-5378-4224-aa0b-ca488a46571d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'babcdbeef8034757a39bc78b59c2093a'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:09.467036 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-8f85d7a5-5378-4224-aa0b-ca488a46571d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'babcdbeef8034757a39bc78b59c2093a'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:09.473314 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1246/2494] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:57:09 2021] DELETE /identity/v3/users/babcdbeef8034757a39bc78b59c2093a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:57:09.477663 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471daec0-01db-4f48-8b7a-4818f38b428f None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:09.478147 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471daec0-01db-4f48-8b7a-4818f38b428f None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:09.478309 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471daec0-01db-4f48-8b7a-4818f38b428f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:09.500218 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-471daec0-01db-4f48-8b7a-4818f38b428f None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:57:09.501999 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-471daec0-01db-4f48-8b7a-4818f38b428f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:09.564273 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1249/2495] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:57:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:57:09.574286 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85d7a5-5378-4224-aa0b-ca488a46571d admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:09.575608 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-8f85d7a5-5378-4224-aa0b-ca488a46571d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:09.638293 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85d7a5-5378-4224-aa0b-ca488a46571d admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:09.641587 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b083142-824d-4634-98c0-a8b4946f0a4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:09.642158 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b083142-824d-4634-98c0-a8b4946f0a4e service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:09.642449 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b083142-824d-4634-98c0-a8b4946f0a4e service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:09.642760 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b083142-824d-4634-98c0-a8b4946f0a4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:09.651330 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b083142-824d-4634-98c0-a8b4946f0a4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:09.677161 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b083142-824d-4634-98c0-a8b4946f0a4e service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:09.686042 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1247/2496] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:57:09 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:57:10.041475 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471daec0-01db-4f48-8b7a-4818f38b428f None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:10.042845 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-471daec0-01db-4f48-8b7a-4818f38b428f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:10.054796 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471daec0-01db-4f48-8b7a-4818f38b428f None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:10.059156 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506c02e-2966-4b6d-b942-6888cdff359f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:10.059966 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506c02e-2966-4b6d-b942-6888cdff359f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:10.060255 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506c02e-2966-4b6d-b942-6888cdff359f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:10.060537 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506c02e-2966-4b6d-b942-6888cdff359f admin admin] PATH_INFO: `/v3/projects/3ad1d157ad0d4e1d8bc3dcb876a22199` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:10.061618 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506c02e-2966-4b6d-b942-6888cdff359f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ad1d157ad0d4e1d8bc3dcb876a22199)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:10.087928 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506c02e-2966-4b6d-b942-6888cdff359f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:10.138370 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-5506c02e-2966-4b6d-b942-6888cdff359f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ad1d157ad0d4e1d8bc3dcb876a22199', 'request_id': 'req-5506c02e-2966-4b6d-b942-6888cdff359f'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:10.151983 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-5506c02e-2966-4b6d-b942-6888cdff359f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ad1d157ad0d4e1d8bc3dcb876a22199', 'request_id': 'req-5506c02e-2966-4b6d-b942-6888cdff359f'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:10.163919 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-5506c02e-2966-4b6d-b942-6888cdff359f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ad1d157ad0d4e1d8bc3dcb876a22199', 'request_id': 'req-5506c02e-2966-4b6d-b942-6888cdff359f'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:10.175244 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-5506c02e-2966-4b6d-b942-6888cdff359f admin admin] The token cache is being invalidate because project 3ad1d157ad0d4e1d8bc3dcb876a22199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:57:10.175534 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-5506c02e-2966-4b6d-b942-6888cdff359f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:10.176143 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-5506c02e-2966-4b6d-b942-6888cdff359f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:10.177634 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1250/2497] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:57:10 2021] DELETE /identity/v3/projects/3ad1d157ad0d4e1d8bc3dcb876a22199 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:57:10.181697 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b083142-824d-4634-98c0-a8b4946f0a4e service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:10.190916 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b083142-824d-4634-98c0-a8b4946f0a4e service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:10.252698 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f43aa-263d-4fb6-929e-006510f5d173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:10.253487 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f43aa-263d-4fb6-929e-006510f5d173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:10.253774 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f43aa-263d-4fb6-929e-006510f5d173 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:10.254053 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f43aa-263d-4fb6-929e-006510f5d173 admin admin] PATH_INFO: `/v3/users/91bf5d538dda4e38bf888a0a9f805f9c` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:10.255168 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f43aa-263d-4fb6-929e-006510f5d173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91bf5d538dda4e38bf888a0a9f805f9c)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:10.280816 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f43aa-263d-4fb6-929e-006510f5d173 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:10.335784 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-155f43aa-263d-4fb6-929e-006510f5d173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91bf5d538dda4e38bf888a0a9f805f9c'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:10.336409 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-155f43aa-263d-4fb6-929e-006510f5d173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91bf5d538dda4e38bf888a0a9f805f9c'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:10.345855 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-155f43aa-263d-4fb6-929e-006510f5d173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91bf5d538dda4e38bf888a0a9f805f9c'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:10.361761 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-155f43aa-263d-4fb6-929e-006510f5d173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91bf5d538dda4e38bf888a0a9f805f9c'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:10.373778 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-155f43aa-263d-4fb6-929e-006510f5d173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91bf5d538dda4e38bf888a0a9f805f9c'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:10.381191 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1248/2498] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:57:10 2021] DELETE /identity/v3/users/91bf5d538dda4e38bf888a0a9f805f9c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:57:10.741880 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506c02e-2966-4b6d-b942-6888cdff359f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:10.743781 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-5506c02e-2966-4b6d-b942-6888cdff359f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:10.755595 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506c02e-2966-4b6d-b942-6888cdff359f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:10.818658 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b3803-2477-4799-a88e-8cdd34151edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:10.819465 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b3803-2477-4799-a88e-8cdd34151edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:10.819755 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b3803-2477-4799-a88e-8cdd34151edc admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:10.820036 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b3803-2477-4799-a88e-8cdd34151edc admin admin] PATH_INFO: `/v3/projects/cf7984f4e6db4636920e01a31161f69e` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:10.821112 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b3803-2477-4799-a88e-8cdd34151edc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf7984f4e6db4636920e01a31161f69e)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:10.847130 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b3803-2477-4799-a88e-8cdd34151edc admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:10.898114 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ed0b3803-2477-4799-a88e-8cdd34151edc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf7984f4e6db4636920e01a31161f69e', 'request_id': 'req-ed0b3803-2477-4799-a88e-8cdd34151edc'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:10.905141 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ed0b3803-2477-4799-a88e-8cdd34151edc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf7984f4e6db4636920e01a31161f69e', 'request_id': 'req-ed0b3803-2477-4799-a88e-8cdd34151edc'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:10.918519 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ed0b3803-2477-4799-a88e-8cdd34151edc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf7984f4e6db4636920e01a31161f69e', 'request_id': 'req-ed0b3803-2477-4799-a88e-8cdd34151edc'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:10.928700 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ed0b3803-2477-4799-a88e-8cdd34151edc admin admin] The token cache is being invalidate because project cf7984f4e6db4636920e01a31161f69e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:57:10.928982 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ed0b3803-2477-4799-a88e-8cdd34151edc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:10.929583 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ed0b3803-2477-4799-a88e-8cdd34151edc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:10.931011 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1251/2499] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:57:10 2021] DELETE /identity/v3/projects/cf7984f4e6db4636920e01a31161f69e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:57:10.936903 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1518b-64eb-4b35-90f5-b08aa3930175 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:10.937202 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1518b-64eb-4b35-90f5-b08aa3930175 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:10.937487 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1518b-64eb-4b35-90f5-b08aa3930175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:10.959646 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-7cd1518b-64eb-4b35-90f5-b08aa3930175 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:57:10.960778 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-7cd1518b-64eb-4b35-90f5-b08aa3930175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:11.025532 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1249/2500] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:57:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:57:11.033680 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c64a75-6916-444c-8b70-2356196501d9 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:11.033970 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c64a75-6916-444c-8b70-2356196501d9 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:11.034278 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c64a75-6916-444c-8b70-2356196501d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:11.056615 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-36c64a75-6916-444c-8b70-2356196501d9 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:57:11.057767 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-36c64a75-6916-444c-8b70-2356196501d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:11.065889 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1252/2501] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:57:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:57:11.070355 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1518b-64eb-4b35-90f5-b08aa3930175 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:11.079801 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1518b-64eb-4b35-90f5-b08aa3930175 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:11.084043 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e306f4-573a-4e26-a97e-dac4e413f630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:11.084629 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e306f4-573a-4e26-a97e-dac4e413f630 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:11.084916 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e306f4-573a-4e26-a97e-dac4e413f630 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:11.085198 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e306f4-573a-4e26-a97e-dac4e413f630 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:11.085889 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e306f4-573a-4e26-a97e-dac4e413f630 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:57:11.086189 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e306f4-573a-4e26-a97e-dac4e413f630 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:11.111937 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e306f4-573a-4e26-a97e-dac4e413f630 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:11.125167 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1250/2502] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:57:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:57:11.130127 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c64a75-6916-444c-8b70-2356196501d9 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:11.138935 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c64a75-6916-444c-8b70-2356196501d9 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:11.143131 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca601e4-1205-4143-b5cd-5ea052b2d182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:11.143703 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca601e4-1205-4143-b5cd-5ea052b2d182 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:11.143987 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca601e4-1205-4143-b5cd-5ea052b2d182 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:11.144264 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca601e4-1205-4143-b5cd-5ea052b2d182 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:11.144889 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca601e4-1205-4143-b5cd-5ea052b2d182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:11.170338 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca601e4-1205-4143-b5cd-5ea052b2d182 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:11.200332 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1253/2503] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:57:11 2021] POST /identity/v3/projects => generated 389 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:57:11.204403 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e306f4-573a-4e26-a97e-dac4e413f630 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:11.214248 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e306f4-573a-4e26-a97e-dac4e413f630 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:11.283316 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e91a07-7681-47e8-afba-bced00260b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:11.283900 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e91a07-7681-47e8-afba-bced00260b8f admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:11.284185 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e91a07-7681-47e8-afba-bced00260b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:11.284464 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e91a07-7681-47e8-afba-bced00260b8f admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:11.285096 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e91a07-7681-47e8-afba-bced00260b8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:11.311194 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e91a07-7681-47e8-afba-bced00260b8f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:11.331836 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1251/2504] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:57:11 2021] POST /identity/v3/users => generated 295 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:57:11.336008 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca601e4-1205-4143-b5cd-5ea052b2d182 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:11.346325 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca601e4-1205-4143-b5cd-5ea052b2d182 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:11.350441 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7841e-4d11-4aec-a1c8-5e67546eb903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:11.351061 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7841e-4d11-4aec-a1c8-5e67546eb903 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:11.351344 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7841e-4d11-4aec-a1c8-5e67546eb903 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:11.351618 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7841e-4d11-4aec-a1c8-5e67546eb903 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:11.352298 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7841e-4d11-4aec-a1c8-5e67546eb903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:11.377393 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7841e-4d11-4aec-a1c8-5e67546eb903 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:11.387760 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1254/2505] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:57:11 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:57:11.392879 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e91a07-7681-47e8-afba-bced00260b8f admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:11.402510 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e91a07-7681-47e8-afba-bced00260b8f admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:11.407717 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480a796-0cec-497a-9378-916c96a9f2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:11.408619 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480a796-0cec-497a-9378-916c96a9f2b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:11.408973 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480a796-0cec-497a-9378-916c96a9f2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:11.409318 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480a796-0cec-497a-9378-916c96a9f2b4 admin admin] PATH_INFO: `/v3/projects/171f38796f334802b05c55430b78a727/users/23c5f42c2ba94c31a7a7278efeafb7f4/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:11.431056 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480a796-0cec-497a-9378-916c96a9f2b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=171f38796f334802b05c55430b78a727, user_id=23c5f42c2ba94c31a7a7278efeafb7f4, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:11.459343 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480a796-0cec-497a-9378-916c96a9f2b4 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:11.474118 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1252/2506] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:57:11 2021] PUT /identity/v3/projects/171f38796f334802b05c55430b78a727/users/23c5f42c2ba94c31a7a7278efeafb7f4/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:57:11.484401 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0f170-d0af-4913-928e-4f1345e3bebf None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:11.484799 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0f170-d0af-4913-928e-4f1345e3bebf None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:11.485563 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0f170-d0af-4913-928e-4f1345e3bebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:11.522937 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-f7d0f170-d0af-4913-928e-4f1345e3bebf None None] MFA Rules not processed for user `23c5f42c2ba94c31a7a7278efeafb7f4`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:57:11.524083 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-f7d0f170-d0af-4913-928e-4f1345e3bebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:11.597087 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1255/2507] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:57:11 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:57:11.601487 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480a796-0cec-497a-9378-916c96a9f2b4 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:11.678587 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480a796-0cec-497a-9378-916c96a9f2b4 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:11.682698 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9506fcf-3a35-442d-913d-b1f12b5a35f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:11.683285 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9506fcf-3a35-442d-913d-b1f12b5a35f5 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:11.683572 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9506fcf-3a35-442d-913d-b1f12b5a35f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:11.683853 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9506fcf-3a35-442d-913d-b1f12b5a35f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:11.684488 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9506fcf-3a35-442d-913d-b1f12b5a35f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:11.710094 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9506fcf-3a35-442d-913d-b1f12b5a35f5 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:11.735704 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1253/2508] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:57:11 2021] POST /identity/v3/projects => generated 389 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:57:11.739882 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0f170-d0af-4913-928e-4f1345e3bebf None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:11.749815 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0f170-d0af-4913-928e-4f1345e3bebf None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:11.809740 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e5506-3648-4531-af60-8ad66e199ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:11.810330 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e5506-3648-4531-af60-8ad66e199ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:11.810619 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e5506-3648-4531-af60-8ad66e199ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:11.810921 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e5506-3648-4531-af60-8ad66e199ee1 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:11.811552 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e5506-3648-4531-af60-8ad66e199ee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:11.837744 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e5506-3648-4531-af60-8ad66e199ee1 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:11.860494 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1256/2509] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:57:11 2021] POST /identity/v3/users => generated 301 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:57:11.861739 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9506fcf-3a35-442d-913d-b1f12b5a35f5 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:11.871668 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9506fcf-3a35-442d-913d-b1f12b5a35f5 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:11.875989 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a32c9d-4938-475b-a08d-f2ed298596d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:11.876609 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a32c9d-4938-475b-a08d-f2ed298596d2 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:11.876900 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a32c9d-4938-475b-a08d-f2ed298596d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:11.877181 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a32c9d-4938-475b-a08d-f2ed298596d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:11.877871 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a32c9d-4938-475b-a08d-f2ed298596d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:11.910136 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a32c9d-4938-475b-a08d-f2ed298596d2 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:11.920874 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1254/2510] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:57:11 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:57:11.925218 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e5506-3648-4531-af60-8ad66e199ee1 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:11.934809 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e5506-3648-4531-af60-8ad66e199ee1 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:11.938975 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6736b9-1e57-4be6-a16c-135a1dcc5911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:11.939797 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6736b9-1e57-4be6-a16c-135a1dcc5911 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:11.940082 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6736b9-1e57-4be6-a16c-135a1dcc5911 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:11.940362 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6736b9-1e57-4be6-a16c-135a1dcc5911 admin admin] PATH_INFO: `/v3/projects/9f543c28916a4f38884737c14800b824/users/78cbb68c1d714cf185110b852b2821dd/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:11.960172 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6736b9-1e57-4be6-a16c-135a1dcc5911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f543c28916a4f38884737c14800b824, user_id=78cbb68c1d714cf185110b852b2821dd, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:11.987510 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6736b9-1e57-4be6-a16c-135a1dcc5911 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:12.000372 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1257/2511] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:57:11 2021] PUT /identity/v3/projects/9f543c28916a4f38884737c14800b824/users/78cbb68c1d714cf185110b852b2821dd/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:57:12.004778 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a32c9d-4938-475b-a08d-f2ed298596d2 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:12.014101 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a32c9d-4938-475b-a08d-f2ed298596d2 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:12.075511 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93705d-c613-4ee7-9e67-bdc1ee8d1649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:12.076107 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93705d-c613-4ee7-9e67-bdc1ee8d1649 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:12.076395 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93705d-c613-4ee7-9e67-bdc1ee8d1649 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:12.076677 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93705d-c613-4ee7-9e67-bdc1ee8d1649 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:12.077366 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93705d-c613-4ee7-9e67-bdc1ee8d1649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:12.102594 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93705d-c613-4ee7-9e67-bdc1ee8d1649 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:12.113144 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1255/2512] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:57:12 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:57:12.117306 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6736b9-1e57-4be6-a16c-135a1dcc5911 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:12.127899 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6736b9-1e57-4be6-a16c-135a1dcc5911 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:12.132110 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a49539-d9f2-43c3-b97d-c2693a8ac1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:12.132942 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a49539-d9f2-43c3-b97d-c2693a8ac1a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:12.133228 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a49539-d9f2-43c3-b97d-c2693a8ac1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:12.133509 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a49539-d9f2-43c3-b97d-c2693a8ac1a0 admin admin] PATH_INFO: `/v3/projects/9f543c28916a4f38884737c14800b824/users/78cbb68c1d714cf185110b852b2821dd/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:12.135293 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a49539-d9f2-43c3-b97d-c2693a8ac1a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f543c28916a4f38884737c14800b824, user_id=78cbb68c1d714cf185110b852b2821dd, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:12.161370 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a49539-d9f2-43c3-b97d-c2693a8ac1a0 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:12.171292 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1258/2513] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:57:12 2021] PUT /identity/v3/projects/9f543c28916a4f38884737c14800b824/users/78cbb68c1d714cf185110b852b2821dd/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:57:12.175542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93705d-c613-4ee7-9e67-bdc1ee8d1649 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:12.185083 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93705d-c613-4ee7-9e67-bdc1ee8d1649 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:12.248858 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb0349-b8c1-4162-9fd8-525961250616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:12.249449 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb0349-b8c1-4162-9fd8-525961250616 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:12.249736 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb0349-b8c1-4162-9fd8-525961250616 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:12.250015 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb0349-b8c1-4162-9fd8-525961250616 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:12.250935 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb0349-b8c1-4162-9fd8-525961250616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:12.276233 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb0349-b8c1-4162-9fd8-525961250616 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:12.286491 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1256/2514] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:57:12 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:57:12.290556 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a49539-d9f2-43c3-b97d-c2693a8ac1a0 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:12.300918 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a49539-d9f2-43c3-b97d-c2693a8ac1a0 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:12.305158 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392da6f-cabb-4cbc-99a2-a6442d8b4978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:12.305954 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392da6f-cabb-4cbc-99a2-a6442d8b4978 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:12.306238 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392da6f-cabb-4cbc-99a2-a6442d8b4978 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:12.306518 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392da6f-cabb-4cbc-99a2-a6442d8b4978 admin admin] PATH_INFO: `/v3/projects/9f543c28916a4f38884737c14800b824/users/78cbb68c1d714cf185110b852b2821dd/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:12.308300 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392da6f-cabb-4cbc-99a2-a6442d8b4978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f543c28916a4f38884737c14800b824, user_id=78cbb68c1d714cf185110b852b2821dd, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:12.335030 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392da6f-cabb-4cbc-99a2-a6442d8b4978 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:12.348976 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1259/2515] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:57:12 2021] PUT /identity/v3/projects/9f543c28916a4f38884737c14800b824/users/78cbb68c1d714cf185110b852b2821dd/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:57:12.360329 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e971b9b-9840-44c0-9b07-4fc9c3325367 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:12.360751 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e971b9b-9840-44c0-9b07-4fc9c3325367 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:12.361038 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e971b9b-9840-44c0-9b07-4fc9c3325367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:12.400373 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-9e971b9b-9840-44c0-9b07-4fc9c3325367 None None] MFA Rules not processed for user `78cbb68c1d714cf185110b852b2821dd`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:57:12.401527 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-9e971b9b-9840-44c0-9b07-4fc9c3325367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:12.478922 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1257/2516] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:57:12 2021] POST /identity/v3/auth/tokens => generated 3763 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:57:12.489162 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392da6f-cabb-4cbc-99a2-a6442d8b4978 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:12.490915 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-4392da6f-cabb-4cbc-99a2-a6442d8b4978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:12.559095 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392da6f-cabb-4cbc-99a2-a6442d8b4978 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:12.563583 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82118db3-daf0-4704-a73c-76ce7a2237c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:12.564406 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82118db3-daf0-4704-a73c-76ce7a2237c2 service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:12.564818 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82118db3-daf0-4704-a73c-76ce7a2237c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:12.565217 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82118db3-daf0-4704-a73c-76ce7a2237c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:12.575767 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82118db3-daf0-4704-a73c-76ce7a2237c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:12.602062 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82118db3-daf0-4704-a73c-76ce7a2237c2 service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:12.613225 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1260/2517] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:57:12 2021] GET /identity/v3/auth/tokens => generated 3763 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:57:12.750844 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e971b9b-9840-44c0-9b07-4fc9c3325367 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:12.824489 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e971b9b-9840-44c0-9b07-4fc9c3325367 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:12.829326 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71186195-dfcf-4881-b78c-415dfebc788d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:12.830228 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71186195-dfcf-4881-b78c-415dfebc788d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:12.830797 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71186195-dfcf-4881-b78c-415dfebc788d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:12.831307 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71186195-dfcf-4881-b78c-415dfebc788d admin admin] PATH_INFO: `/v3/users/23c5f42c2ba94c31a7a7278efeafb7f4` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:12.832756 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71186195-dfcf-4881-b78c-415dfebc788d admin admin] RBAC: Authorizing `identity:delete_user(user_id=23c5f42c2ba94c31a7a7278efeafb7f4)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:12.863187 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71186195-dfcf-4881-b78c-415dfebc788d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:12.928487 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-71186195-dfcf-4881-b78c-415dfebc788d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23c5f42c2ba94c31a7a7278efeafb7f4'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:12.928719 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-71186195-dfcf-4881-b78c-415dfebc788d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23c5f42c2ba94c31a7a7278efeafb7f4'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:12.938591 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-71186195-dfcf-4881-b78c-415dfebc788d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23c5f42c2ba94c31a7a7278efeafb7f4'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:12.958064 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-71186195-dfcf-4881-b78c-415dfebc788d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23c5f42c2ba94c31a7a7278efeafb7f4'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:12.959310 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-71186195-dfcf-4881-b78c-415dfebc788d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23c5f42c2ba94c31a7a7278efeafb7f4'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:12.965275 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1258/2518] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:57:12 2021] DELETE /identity/v3/users/23c5f42c2ba94c31a7a7278efeafb7f4 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:57:12.970111 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03863a9f-e724-447b-9103-04d4d481fe09 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:12.970692 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03863a9f-e724-447b-9103-04d4d481fe09 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:12.970692 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03863a9f-e724-447b-9103-04d4d481fe09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:12.993491 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-03863a9f-e724-447b-9103-04d4d481fe09 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:57:12.994717 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-03863a9f-e724-447b-9103-04d4d481fe09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:13.075546 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1261/2519] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:57:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:57:13.086684 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71186195-dfcf-4881-b78c-415dfebc788d admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:13.088233 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-71186195-dfcf-4881-b78c-415dfebc788d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:13.153336 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71186195-dfcf-4881-b78c-415dfebc788d admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:13.157360 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e3dc9-9342-4be8-8358-c23b9753a657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:13.157937 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e3dc9-9342-4be8-8358-c23b9753a657 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:13.158231 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e3dc9-9342-4be8-8358-c23b9753a657 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:13.158703 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e3dc9-9342-4be8-8358-c23b9753a657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:13.167767 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e3dc9-9342-4be8-8358-c23b9753a657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:13.194484 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e3dc9-9342-4be8-8358-c23b9753a657 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:13.204857 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1259/2520] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:57:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:57:13.645199 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03863a9f-e724-447b-9103-04d4d481fe09 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:13.646602 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-03863a9f-e724-447b-9103-04d4d481fe09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:13.658560 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03863a9f-e724-447b-9103-04d4d481fe09 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:13.663608 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c2d0a-944e-44fa-b1dd-c721288fd6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:13.664391 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c2d0a-944e-44fa-b1dd-c721288fd6c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:13.664672 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c2d0a-944e-44fa-b1dd-c721288fd6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:13.664949 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c2d0a-944e-44fa-b1dd-c721288fd6c2 admin admin] PATH_INFO: `/v3/projects/171f38796f334802b05c55430b78a727` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:13.666035 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c2d0a-944e-44fa-b1dd-c721288fd6c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=171f38796f334802b05c55430b78a727)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:13.693007 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c2d0a-944e-44fa-b1dd-c721288fd6c2 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:13.745182 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-9a8c2d0a-944e-44fa-b1dd-c721288fd6c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '171f38796f334802b05c55430b78a727', 'request_id': 'req-9a8c2d0a-944e-44fa-b1dd-c721288fd6c2'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:13.753166 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-9a8c2d0a-944e-44fa-b1dd-c721288fd6c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '171f38796f334802b05c55430b78a727', 'request_id': 'req-9a8c2d0a-944e-44fa-b1dd-c721288fd6c2'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:13.764098 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-9a8c2d0a-944e-44fa-b1dd-c721288fd6c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '171f38796f334802b05c55430b78a727', 'request_id': 'req-9a8c2d0a-944e-44fa-b1dd-c721288fd6c2'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:13.775271 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-9a8c2d0a-944e-44fa-b1dd-c721288fd6c2 admin admin] The token cache is being invalidate because project 171f38796f334802b05c55430b78a727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:57:13.775271 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-9a8c2d0a-944e-44fa-b1dd-c721288fd6c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:13.775905 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-9a8c2d0a-944e-44fa-b1dd-c721288fd6c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:13.777350 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1262/2521] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:57:13 2021] DELETE /identity/v3/projects/171f38796f334802b05c55430b78a727 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:57:13.781479 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e3dc9-9342-4be8-8358-c23b9753a657 service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:13.791242 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e3dc9-9342-4be8-8358-c23b9753a657 service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:13.865266 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fc9cd-3b2e-4b08-9528-4db4caed4503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:13.866427 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fc9cd-3b2e-4b08-9528-4db4caed4503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:13.866919 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fc9cd-3b2e-4b08-9528-4db4caed4503 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:13.867383 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fc9cd-3b2e-4b08-9528-4db4caed4503 admin admin] PATH_INFO: `/v3/users/78cbb68c1d714cf185110b852b2821dd` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:13.868674 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fc9cd-3b2e-4b08-9528-4db4caed4503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78cbb68c1d714cf185110b852b2821dd)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:13.896524 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fc9cd-3b2e-4b08-9528-4db4caed4503 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:13.952307 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-539fc9cd-3b2e-4b08-9528-4db4caed4503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78cbb68c1d714cf185110b852b2821dd'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:13.952930 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-539fc9cd-3b2e-4b08-9528-4db4caed4503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78cbb68c1d714cf185110b852b2821dd'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:13.961905 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-539fc9cd-3b2e-4b08-9528-4db4caed4503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78cbb68c1d714cf185110b852b2821dd'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:13.974630 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-539fc9cd-3b2e-4b08-9528-4db4caed4503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78cbb68c1d714cf185110b852b2821dd'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:13.982042 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-539fc9cd-3b2e-4b08-9528-4db4caed4503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78cbb68c1d714cf185110b852b2821dd'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:13.989505 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1260/2522] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:57:13 2021] DELETE /identity/v3/users/78cbb68c1d714cf185110b852b2821dd => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:57:14.441832 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c2d0a-944e-44fa-b1dd-c721288fd6c2 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:14.443238 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-9a8c2d0a-944e-44fa-b1dd-c721288fd6c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:14.456172 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c2d0a-944e-44fa-b1dd-c721288fd6c2 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:14.518465 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cac12-e663-4a9e-86c8-d682f7d3f024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:14.519192 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cac12-e663-4a9e-86c8-d682f7d3f024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:14.519481 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cac12-e663-4a9e-86c8-d682f7d3f024 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:14.519761 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cac12-e663-4a9e-86c8-d682f7d3f024 admin admin] PATH_INFO: `/v3/projects/9f543c28916a4f38884737c14800b824` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:14.520831 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cac12-e663-4a9e-86c8-d682f7d3f024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f543c28916a4f38884737c14800b824)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:14.546863 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cac12-e663-4a9e-86c8-d682f7d3f024 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:14.595183 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-9e7cac12-e663-4a9e-86c8-d682f7d3f024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f543c28916a4f38884737c14800b824', 'request_id': 'req-9e7cac12-e663-4a9e-86c8-d682f7d3f024'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:14.601750 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-9e7cac12-e663-4a9e-86c8-d682f7d3f024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f543c28916a4f38884737c14800b824', 'request_id': 'req-9e7cac12-e663-4a9e-86c8-d682f7d3f024'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:14.613218 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-9e7cac12-e663-4a9e-86c8-d682f7d3f024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f543c28916a4f38884737c14800b824', 'request_id': 'req-9e7cac12-e663-4a9e-86c8-d682f7d3f024'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:14.623171 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-9e7cac12-e663-4a9e-86c8-d682f7d3f024 admin admin] The token cache is being invalidate because project 9f543c28916a4f38884737c14800b824 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:57:14.623455 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-9e7cac12-e663-4a9e-86c8-d682f7d3f024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:14.624046 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-9e7cac12-e663-4a9e-86c8-d682f7d3f024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:14.626158 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1263/2523] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:57:14 2021] DELETE /identity/v3/projects/9f543c28916a4f38884737c14800b824 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:57:14.631770 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89114c-f133-4128-9d9e-59a0c98f568d None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:14.632089 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89114c-f133-4128-9d9e-59a0c98f568d None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:14.632371 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89114c-f133-4128-9d9e-59a0c98f568d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:14.656538 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-ad89114c-f133-4128-9d9e-59a0c98f568d None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:57:14.658061 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-ad89114c-f133-4128-9d9e-59a0c98f568d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:14.720519 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1261/2524] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:57:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:57:14.728639 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708243c5-132f-4b2b-90fb-c4087da0abee None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:14.728937 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708243c5-132f-4b2b-90fb-c4087da0abee None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:14.729219 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708243c5-132f-4b2b-90fb-c4087da0abee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:14.751277 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-708243c5-132f-4b2b-90fb-c4087da0abee None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:57:14.752394 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-708243c5-132f-4b2b-90fb-c4087da0abee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:14.759174 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1264/2525] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:57:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:57:14.763070 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89114c-f133-4128-9d9e-59a0c98f568d None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:14.772661 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89114c-f133-4128-9d9e-59a0c98f568d None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:14.776671 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336cda9-0230-437a-bcbd-e22d0347f367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:14.777237 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336cda9-0230-437a-bcbd-e22d0347f367 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:14.777521 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336cda9-0230-437a-bcbd-e22d0347f367 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:14.777796 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336cda9-0230-437a-bcbd-e22d0347f367 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:14.778470 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336cda9-0230-437a-bcbd-e22d0347f367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:57:14.778804 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336cda9-0230-437a-bcbd-e22d0347f367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:14.803973 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336cda9-0230-437a-bcbd-e22d0347f367 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:14.817149 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1262/2526] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:57:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:57:14.821272 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708243c5-132f-4b2b-90fb-c4087da0abee None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:14.830683 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708243c5-132f-4b2b-90fb-c4087da0abee None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:14.835900 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f905d3-782a-48ad-a573-9f6361a410f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:14.836486 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f905d3-782a-48ad-a573-9f6361a410f1 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:14.836799 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f905d3-782a-48ad-a573-9f6361a410f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:14.837050 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f905d3-782a-48ad-a573-9f6361a410f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:14.837672 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f905d3-782a-48ad-a573-9f6361a410f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:14.864163 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f905d3-782a-48ad-a573-9f6361a410f1 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:14.896909 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1265/2527] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:57:14 2021] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:57:14.901361 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336cda9-0230-437a-bcbd-e22d0347f367 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:14.915312 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336cda9-0230-437a-bcbd-e22d0347f367 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:14.981126 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7267ccb-64f6-40fe-b360-91cbc6b11f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:14.982327 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7267ccb-64f6-40fe-b360-91cbc6b11f7c admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:14.982912 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7267ccb-64f6-40fe-b360-91cbc6b11f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:14.983435 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7267ccb-64f6-40fe-b360-91cbc6b11f7c admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:14.985693 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7267ccb-64f6-40fe-b360-91cbc6b11f7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:15.014269 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7267ccb-64f6-40fe-b360-91cbc6b11f7c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:15.038828 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1263/2528] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:57:14 2021] POST /identity/v3/users => generated 287 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:57:15.040167 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f905d3-782a-48ad-a573-9f6361a410f1 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:15.050941 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f905d3-782a-48ad-a573-9f6361a410f1 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:15.056239 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25040cfc-3554-4078-a450-83f01a102481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:15.056835 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25040cfc-3554-4078-a450-83f01a102481 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:15.057193 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25040cfc-3554-4078-a450-83f01a102481 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:15.057395 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25040cfc-3554-4078-a450-83f01a102481 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:15.058231 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25040cfc-3554-4078-a450-83f01a102481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:15.084613 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25040cfc-3554-4078-a450-83f01a102481 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:15.095662 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1266/2529] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:57:15 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:57:15.099611 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7267ccb-64f6-40fe-b360-91cbc6b11f7c admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:15.110690 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7267ccb-64f6-40fe-b360-91cbc6b11f7c admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:15.116775 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297758d7-86bb-4cc1-9b74-1e8df4ad4120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:15.117838 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297758d7-86bb-4cc1-9b74-1e8df4ad4120 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:15.118215 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297758d7-86bb-4cc1-9b74-1e8df4ad4120 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:15.118596 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297758d7-86bb-4cc1-9b74-1e8df4ad4120 admin admin] PATH_INFO: `/v3/projects/38e687b5548f4971b8a53c302a099f74/users/f39bcd88bed9489993a2a5a976040360/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:15.143527 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297758d7-86bb-4cc1-9b74-1e8df4ad4120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38e687b5548f4971b8a53c302a099f74, user_id=f39bcd88bed9489993a2a5a976040360, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:15.171329 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297758d7-86bb-4cc1-9b74-1e8df4ad4120 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:15.189722 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1264/2530] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:57:15 2021] PUT /identity/v3/projects/38e687b5548f4971b8a53c302a099f74/users/f39bcd88bed9489993a2a5a976040360/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:57:15.200176 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58916d-7251-42dc-b9c4-63a2e34317c0 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:15.200623 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58916d-7251-42dc-b9c4-63a2e34317c0 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:15.201022 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58916d-7251-42dc-b9c4-63a2e34317c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:15.249536 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-fe58916d-7251-42dc-b9c4-63a2e34317c0 None None] MFA Rules not processed for user `f39bcd88bed9489993a2a5a976040360`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:57:15.251088 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-fe58916d-7251-42dc-b9c4-63a2e34317c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:15.333950 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1267/2531] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:57:15 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:57:15.344788 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297758d7-86bb-4cc1-9b74-1e8df4ad4120 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:15.346414 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-297758d7-86bb-4cc1-9b74-1e8df4ad4120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:15.413376 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297758d7-86bb-4cc1-9b74-1e8df4ad4120 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:15.416838 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9502c5-b382-4fbe-b183-3239590172ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:15.417502 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9502c5-b382-4fbe-b183-3239590172ed service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:15.417797 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9502c5-b382-4fbe-b183-3239590172ed service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:15.418081 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9502c5-b382-4fbe-b183-3239590172ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:15.426995 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9502c5-b382-4fbe-b183-3239590172ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:15.457473 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9502c5-b382-4fbe-b183-3239590172ed service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:15.467393 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1265/2532] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:57:15 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:57:15.494088 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58916d-7251-42dc-b9c4-63a2e34317c0 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:15.570591 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58916d-7251-42dc-b9c4-63a2e34317c0 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:15.574799 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1141bc6-92d5-40af-a69e-d2c1682406df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:15.575600 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1141bc6-92d5-40af-a69e-d2c1682406df admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:15.575894 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1141bc6-92d5-40af-a69e-d2c1682406df admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:15.576176 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1141bc6-92d5-40af-a69e-d2c1682406df admin admin] PATH_INFO: `/v3/users/f39bcd88bed9489993a2a5a976040360` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:15.577305 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1141bc6-92d5-40af-a69e-d2c1682406df admin admin] RBAC: Authorizing `identity:delete_user(user_id=f39bcd88bed9489993a2a5a976040360)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:15.603027 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1141bc6-92d5-40af-a69e-d2c1682406df admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:15.652751 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-f1141bc6-92d5-40af-a69e-d2c1682406df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f39bcd88bed9489993a2a5a976040360'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:15.664962 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-f1141bc6-92d5-40af-a69e-d2c1682406df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f39bcd88bed9489993a2a5a976040360'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:15.665614 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-f1141bc6-92d5-40af-a69e-d2c1682406df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f39bcd88bed9489993a2a5a976040360'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:15.673070 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-f1141bc6-92d5-40af-a69e-d2c1682406df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f39bcd88bed9489993a2a5a976040360'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:15.680730 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-f1141bc6-92d5-40af-a69e-d2c1682406df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f39bcd88bed9489993a2a5a976040360'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:15.687926 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1268/2533] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:57:15 2021] DELETE /identity/v3/users/f39bcd88bed9489993a2a5a976040360 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:57:15.693052 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f455e-3fdf-46b8-9385-768ee914ecc1 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:15.693421 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f455e-3fdf-46b8-9385-768ee914ecc1 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:15.693707 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f455e-3fdf-46b8-9385-768ee914ecc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:15.715800 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-8d1f455e-3fdf-46b8-9385-768ee914ecc1 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:57:15.716934 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-8d1f455e-3fdf-46b8-9385-768ee914ecc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:15.780697 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1266/2534] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:57:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:57:15.791709 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1141bc6-92d5-40af-a69e-d2c1682406df admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:15.793056 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-f1141bc6-92d5-40af-a69e-d2c1682406df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:15.860439 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1141bc6-92d5-40af-a69e-d2c1682406df admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:15.864259 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9b1ed-2818-4d92-860e-3be547b86297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:15.864831 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9b1ed-2818-4d92-860e-3be547b86297 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:15.865115 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9b1ed-2818-4d92-860e-3be547b86297 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:15.865394 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9b1ed-2818-4d92-860e-3be547b86297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:15.874213 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9b1ed-2818-4d92-860e-3be547b86297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:15.899680 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9b1ed-2818-4d92-860e-3be547b86297 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:15.910498 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1269/2535] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:57:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:57:16.260341 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f455e-3fdf-46b8-9385-768ee914ecc1 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:16.261687 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-8d1f455e-3fdf-46b8-9385-768ee914ecc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:16.272985 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f455e-3fdf-46b8-9385-768ee914ecc1 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:16.277392 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022431b9-8d28-4c78-8a1c-89eb9296bcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:16.278170 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022431b9-8d28-4c78-8a1c-89eb9296bcc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:16.278480 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022431b9-8d28-4c78-8a1c-89eb9296bcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:16.278798 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022431b9-8d28-4c78-8a1c-89eb9296bcc9 admin admin] PATH_INFO: `/v3/projects/38e687b5548f4971b8a53c302a099f74` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:16.279847 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022431b9-8d28-4c78-8a1c-89eb9296bcc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38e687b5548f4971b8a53c302a099f74)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:16.307156 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022431b9-8d28-4c78-8a1c-89eb9296bcc9 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:16.362442 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-022431b9-8d28-4c78-8a1c-89eb9296bcc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38e687b5548f4971b8a53c302a099f74', 'request_id': 'req-022431b9-8d28-4c78-8a1c-89eb9296bcc9'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:16.369564 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-022431b9-8d28-4c78-8a1c-89eb9296bcc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38e687b5548f4971b8a53c302a099f74', 'request_id': 'req-022431b9-8d28-4c78-8a1c-89eb9296bcc9'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:16.375066 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-022431b9-8d28-4c78-8a1c-89eb9296bcc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38e687b5548f4971b8a53c302a099f74', 'request_id': 'req-022431b9-8d28-4c78-8a1c-89eb9296bcc9'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:16.391480 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-022431b9-8d28-4c78-8a1c-89eb9296bcc9 admin admin] The token cache is being invalidate because project 38e687b5548f4971b8a53c302a099f74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:57:16.391764 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-022431b9-8d28-4c78-8a1c-89eb9296bcc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:16.392373 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-022431b9-8d28-4c78-8a1c-89eb9296bcc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:16.393986 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1267/2536] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:57:16 2021] DELETE /identity/v3/projects/38e687b5548f4971b8a53c302a099f74 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:57:16.399501 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb72f1-1267-4435-a8f9-0d57593c526d None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:16.399795 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb72f1-1267-4435-a8f9-0d57593c526d None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:16.400078 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb72f1-1267-4435-a8f9-0d57593c526d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:16.423286 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-f6eb72f1-1267-4435-a8f9-0d57593c526d None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:57:16.424787 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-f6eb72f1-1267-4435-a8f9-0d57593c526d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:16.496854 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1270/2537] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:57:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:57:16.504102 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521a0a6-b76a-4853-9636-ae62d7df9d22 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:16.504394 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521a0a6-b76a-4853-9636-ae62d7df9d22 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:16.504679 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521a0a6-b76a-4853-9636-ae62d7df9d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:16.527194 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-b521a0a6-b76a-4853-9636-ae62d7df9d22 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:57:16.528430 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-b521a0a6-b76a-4853-9636-ae62d7df9d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:16.536374 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1268/2538] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:57:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:57:16.540359 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb72f1-1267-4435-a8f9-0d57593c526d None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:16.550554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb72f1-1267-4435-a8f9-0d57593c526d None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:16.555271 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c195e-02ca-4ee4-94ec-4f84cdc3f453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:16.555940 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c195e-02ca-4ee4-94ec-4f84cdc3f453 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:16.556244 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c195e-02ca-4ee4-94ec-4f84cdc3f453 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:16.556605 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c195e-02ca-4ee4-94ec-4f84cdc3f453 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:16.557295 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c195e-02ca-4ee4-94ec-4f84cdc3f453 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:57:16.557596 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c195e-02ca-4ee4-94ec-4f84cdc3f453 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:16.585926 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c195e-02ca-4ee4-94ec-4f84cdc3f453 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:16.601147 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1271/2539] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:57:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:57:16.605923 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521a0a6-b76a-4853-9636-ae62d7df9d22 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:16.616429 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521a0a6-b76a-4853-9636-ae62d7df9d22 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:16.623271 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26dfdb8-74a6-4547-86a0-c2e6d147e361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:16.624101 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26dfdb8-74a6-4547-86a0-c2e6d147e361 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:16.624543 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26dfdb8-74a6-4547-86a0-c2e6d147e361 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:16.624896 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26dfdb8-74a6-4547-86a0-c2e6d147e361 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:16.625718 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26dfdb8-74a6-4547-86a0-c2e6d147e361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:16.654435 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26dfdb8-74a6-4547-86a0-c2e6d147e361 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:16.696344 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1269/2540] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:57:16 2021] POST /identity/v3/projects => generated 389 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:57:16.700699 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c195e-02ca-4ee4-94ec-4f84cdc3f453 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:16.710578 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c195e-02ca-4ee4-94ec-4f84cdc3f453 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:16.817510 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4eb4b5-fac8-425a-96ce-918a211d01b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:16.818291 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4eb4b5-fac8-425a-96ce-918a211d01b1 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:16.818584 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4eb4b5-fac8-425a-96ce-918a211d01b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:16.823017 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4eb4b5-fac8-425a-96ce-918a211d01b1 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:16.823714 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4eb4b5-fac8-425a-96ce-918a211d01b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:16.850084 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4eb4b5-fac8-425a-96ce-918a211d01b1 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:16.872018 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1272/2541] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:57:16 2021] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:57:16.876788 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26dfdb8-74a6-4547-86a0-c2e6d147e361 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:16.887786 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26dfdb8-74a6-4547-86a0-c2e6d147e361 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:16.893030 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972404f2-bd66-4b77-b84a-0a1e5febaf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:16.893751 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972404f2-bd66-4b77-b84a-0a1e5febaf72 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:16.894115 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972404f2-bd66-4b77-b84a-0a1e5febaf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:16.894579 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972404f2-bd66-4b77-b84a-0a1e5febaf72 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:16.895378 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972404f2-bd66-4b77-b84a-0a1e5febaf72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:16.923449 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972404f2-bd66-4b77-b84a-0a1e5febaf72 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:16.939178 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1270/2542] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:57:16 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 20:57:16.941667 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4eb4b5-fac8-425a-96ce-918a211d01b1 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:16.953604 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4eb4b5-fac8-425a-96ce-918a211d01b1 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:16.958002 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043d375-8274-477d-b1d1-69ad18e2c39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:16.959204 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043d375-8274-477d-b1d1-69ad18e2c39c admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:16.959581 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043d375-8274-477d-b1d1-69ad18e2c39c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:16.959998 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043d375-8274-477d-b1d1-69ad18e2c39c admin admin] PATH_INFO: `/v3/projects/858534bbc98d4fc5bb18fa8e16bfe2ca/users/e349a13d463c4f9481d8f6d68fbfbd2c/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:16.981688 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043d375-8274-477d-b1d1-69ad18e2c39c admin admin] RBAC: Authorizing `identity:create_grant(project_id=858534bbc98d4fc5bb18fa8e16bfe2ca, user_id=e349a13d463c4f9481d8f6d68fbfbd2c, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:17.009861 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043d375-8274-477d-b1d1-69ad18e2c39c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:17.022767 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1273/2543] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:57:16 2021] PUT /identity/v3/projects/858534bbc98d4fc5bb18fa8e16bfe2ca/users/e349a13d463c4f9481d8f6d68fbfbd2c/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:57:17.033383 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a01683-32f4-4267-ba79-370fa8dfd6a8 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:17.033713 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a01683-32f4-4267-ba79-370fa8dfd6a8 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:17.034027 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a01683-32f4-4267-ba79-370fa8dfd6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:17.072263 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-17a01683-32f4-4267-ba79-370fa8dfd6a8 None None] MFA Rules not processed for user `e349a13d463c4f9481d8f6d68fbfbd2c`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:57:17.073409 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-17a01683-32f4-4267-ba79-370fa8dfd6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:17.159793 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1271/2544] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:57:17 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:57:17.173537 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043d375-8274-477d-b1d1-69ad18e2c39c admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:17.175342 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-b043d375-8274-477d-b1d1-69ad18e2c39c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:17.252840 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043d375-8274-477d-b1d1-69ad18e2c39c admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:17.256441 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad014845-453d-4309-b282-1e3e931c6ce8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:17.257625 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad014845-453d-4309-b282-1e3e931c6ce8 service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:17.257915 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad014845-453d-4309-b282-1e3e931c6ce8 service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:17.258195 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad014845-453d-4309-b282-1e3e931c6ce8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:17.275966 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad014845-453d-4309-b282-1e3e931c6ce8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:17.293324 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad014845-453d-4309-b282-1e3e931c6ce8 service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:17.303920 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1274/2545] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:57:17 2021] GET /identity/v3/auth/tokens => generated 3696 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:57:19.697463 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a01683-32f4-4267-ba79-370fa8dfd6a8 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:19.699008 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-17a01683-32f4-4267-ba79-370fa8dfd6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:19.768618 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a01683-32f4-4267-ba79-370fa8dfd6a8 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:19.771896 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1543a88-aab4-460c-b25c-c7d47a408c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:19.772468 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1543a88-aab4-460c-b25c-c7d47a408c68 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:19.772802 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1543a88-aab4-460c-b25c-c7d47a408c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:19.773111 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1543a88-aab4-460c-b25c-c7d47a408c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:19.774791 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-c1543a88-aab4-460c-b25c-c7d47a408c68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:19.848707 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1543a88-aab4-460c-b25c-c7d47a408c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:19.885400 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1543a88-aab4-460c-b25c-c7d47a408c68 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:19.897559 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1272/2546] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:57:19 2021] GET /identity/v3/auth/tokens => generated 3747 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:57:50.973289 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad014845-453d-4309-b282-1e3e931c6ce8 service cinder] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:51.044093 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad014845-453d-4309-b282-1e3e931c6ce8 service cinder] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:51.049588 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a99eac-9552-4079-9eb7-3d086c55d4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:51.050451 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a99eac-9552-4079-9eb7-3d086c55d4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:51.050794 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a99eac-9552-4079-9eb7-3d086c55d4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:51.051076 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a99eac-9552-4079-9eb7-3d086c55d4e6 admin admin] PATH_INFO: `/v3/users/e349a13d463c4f9481d8f6d68fbfbd2c` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:51.052170 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a99eac-9552-4079-9eb7-3d086c55d4e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e349a13d463c4f9481d8f6d68fbfbd2c)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:51.078731 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a99eac-9552-4079-9eb7-3d086c55d4e6 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:51.138497 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-22a99eac-9552-4079-9eb7-3d086c55d4e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e349a13d463c4f9481d8f6d68fbfbd2c'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:51.152065 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-22a99eac-9552-4079-9eb7-3d086c55d4e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e349a13d463c4f9481d8f6d68fbfbd2c'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:51.152758 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-22a99eac-9552-4079-9eb7-3d086c55d4e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e349a13d463c4f9481d8f6d68fbfbd2c'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:51.160720 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-22a99eac-9552-4079-9eb7-3d086c55d4e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e349a13d463c4f9481d8f6d68fbfbd2c'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:51.168943 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-22a99eac-9552-4079-9eb7-3d086c55d4e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e349a13d463c4f9481d8f6d68fbfbd2c'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:51.176617 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1275/2547] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:57:50 2021] DELETE /identity/v3/users/e349a13d463c4f9481d8f6d68fbfbd2c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:57:51.180952 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c06bc2-f98b-40a8-9d4b-0d690b1ae24d None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:51.181459 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c06bc2-f98b-40a8-9d4b-0d690b1ae24d None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:51.181564 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c06bc2-f98b-40a8-9d4b-0d690b1ae24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:51.208589 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-61c06bc2-f98b-40a8-9d4b-0d690b1ae24d None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:57:51.209741 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-61c06bc2-f98b-40a8-9d4b-0d690b1ae24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:51.355623 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1273/2548] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:57:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:57:51.365666 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a99eac-9552-4079-9eb7-3d086c55d4e6 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:51.367025 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-22a99eac-9552-4079-9eb7-3d086c55d4e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:51.436544 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a99eac-9552-4079-9eb7-3d086c55d4e6 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:51.439938 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6581f5-f1b8-48cb-a32a-02604bfe05f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:51.440766 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6581f5-f1b8-48cb-a32a-02604bfe05f0 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:51.441053 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6581f5-f1b8-48cb-a32a-02604bfe05f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:51.441339 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6581f5-f1b8-48cb-a32a-02604bfe05f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:51.449945 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6581f5-f1b8-48cb-a32a-02604bfe05f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:51.475594 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6581f5-f1b8-48cb-a32a-02604bfe05f0 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:51.485570 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1276/2549] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:57:51 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:57:51.853037 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c06bc2-f98b-40a8-9d4b-0d690b1ae24d None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:51.855270 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-61c06bc2-f98b-40a8-9d4b-0d690b1ae24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:51.867703 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c06bc2-f98b-40a8-9d4b-0d690b1ae24d None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:51.872514 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c2f51-d41e-43cb-b6a5-bb3caa1fdc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:51.873886 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c2f51-d41e-43cb-b6a5-bb3caa1fdc9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:51.874177 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c2f51-d41e-43cb-b6a5-bb3caa1fdc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:51.874614 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c2f51-d41e-43cb-b6a5-bb3caa1fdc9a admin admin] PATH_INFO: `/v3/projects/858534bbc98d4fc5bb18fa8e16bfe2ca` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:51.876480 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c2f51-d41e-43cb-b6a5-bb3caa1fdc9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=858534bbc98d4fc5bb18fa8e16bfe2ca)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:51.903841 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c2f51-d41e-43cb-b6a5-bb3caa1fdc9a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:51.961069 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-243c2f51-d41e-43cb-b6a5-bb3caa1fdc9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '858534bbc98d4fc5bb18fa8e16bfe2ca', 'request_id': 'req-243c2f51-d41e-43cb-b6a5-bb3caa1fdc9a'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:51.968641 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-243c2f51-d41e-43cb-b6a5-bb3caa1fdc9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '858534bbc98d4fc5bb18fa8e16bfe2ca', 'request_id': 'req-243c2f51-d41e-43cb-b6a5-bb3caa1fdc9a'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:51.973772 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-243c2f51-d41e-43cb-b6a5-bb3caa1fdc9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '858534bbc98d4fc5bb18fa8e16bfe2ca', 'request_id': 'req-243c2f51-d41e-43cb-b6a5-bb3caa1fdc9a'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:51.989666 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-243c2f51-d41e-43cb-b6a5-bb3caa1fdc9a admin admin] The token cache is being invalidate because project 858534bbc98d4fc5bb18fa8e16bfe2ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:57:51.989954 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-243c2f51-d41e-43cb-b6a5-bb3caa1fdc9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:51.990555 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-243c2f51-d41e-43cb-b6a5-bb3caa1fdc9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:57:51.992143 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1274/2550] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:57:51 2021] DELETE /identity/v3/projects/858534bbc98d4fc5bb18fa8e16bfe2ca => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:57:55.580280 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6581f5-f1b8-48cb-a32a-02604bfe05f0 service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:57:55.581570 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-3a6581f5-f1b8-48cb-a32a-02604bfe05f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:55.664256 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6581f5-f1b8-48cb-a32a-02604bfe05f0 service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:57:55.734898 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c5480-b81c-4db6-97bb-8eb6418fcf41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:57:55.735488 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c5480-b81c-4db6-97bb-8eb6418fcf41 service nova] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:57:55.735781 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c5480-b81c-4db6-97bb-8eb6418fcf41 service nova] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:57:55.736068 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c5480-b81c-4db6-97bb-8eb6418fcf41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:57:55.738565 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-7e1c5480-b81c-4db6-97bb-8eb6418fcf41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:57:55.752417 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c5480-b81c-4db6-97bb-8eb6418fcf41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:57:55.777907 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c5480-b81c-4db6-97bb-8eb6418fcf41 service nova] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:57:55.787882 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1277/2551] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:57:55 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:58:14.889845 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c2f51-d41e-43cb-b6a5-bb3caa1fdc9a admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:58:14.891351 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-243c2f51-d41e-43cb-b6a5-bb3caa1fdc9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:58:14.954338 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c2f51-d41e-43cb-b6a5-bb3caa1fdc9a admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:58:14.957626 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c912223-f6bf-4178-8104-2bede08059b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:58:14.958201 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c912223-f6bf-4178-8104-2bede08059b4 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:58:14.958484 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c912223-f6bf-4178-8104-2bede08059b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:58:14.958793 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c912223-f6bf-4178-8104-2bede08059b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:58:14.960428 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-7c912223-f6bf-4178-8104-2bede08059b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:58:14.969951 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c912223-f6bf-4178-8104-2bede08059b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:58:14.995126 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c912223-f6bf-4178-8104-2bede08059b4 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:58:15.004280 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1275/2552] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:58:14 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 20:58:20.610818 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c5480-b81c-4db6-97bb-8eb6418fcf41 service nova] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:58:20.612142 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-7e1c5480-b81c-4db6-97bb-8eb6418fcf41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:58:20.624756 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c5480-b81c-4db6-97bb-8eb6418fcf41 service nova] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:58:20.629700 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d3886-f6a9-4f77-85cf-03c3529b19e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:58:20.630260 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d3886-f6a9-4f77-85cf-03c3529b19e9 service nova] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:58:20.630548 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d3886-f6a9-4f77-85cf-03c3529b19e9 service nova] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:58:20.630859 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d3886-f6a9-4f77-85cf-03c3529b19e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:58:20.632405 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-309d3886-f6a9-4f77-85cf-03c3529b19e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:58:20.696354 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d3886-f6a9-4f77-85cf-03c3529b19e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:58:20.722031 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d3886-f6a9-4f77-85cf-03c3529b19e9 service nova] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:58:20.730942 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1278/2553] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:58:20 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:58:24.708166 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c912223-f6bf-4178-8104-2bede08059b4 service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:58:24.709492 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-7c912223-f6bf-4178-8104-2bede08059b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:58:24.780979 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c912223-f6bf-4178-8104-2bede08059b4 service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:58:24.785491 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730d0d6-27b2-4a50-b212-fdd25b7af34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:58:24.786410 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730d0d6-27b2-4a50-b212-fdd25b7af34d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:58:24.786736 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730d0d6-27b2-4a50-b212-fdd25b7af34d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:58:24.787023 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730d0d6-27b2-4a50-b212-fdd25b7af34d admin admin] PATH_INFO: `/v3/users/abea74c48ef444f5b8dd15fdc4ce5a71` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:58:24.788191 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730d0d6-27b2-4a50-b212-fdd25b7af34d admin admin] RBAC: Authorizing `identity:delete_user(user_id=abea74c48ef444f5b8dd15fdc4ce5a71)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:58:24.815346 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730d0d6-27b2-4a50-b212-fdd25b7af34d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:58:24.865542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f730d0d6-27b2-4a50-b212-fdd25b7af34d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abea74c48ef444f5b8dd15fdc4ce5a71'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:58:24.866146 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f730d0d6-27b2-4a50-b212-fdd25b7af34d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abea74c48ef444f5b8dd15fdc4ce5a71'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:58:24.873531 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f730d0d6-27b2-4a50-b212-fdd25b7af34d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abea74c48ef444f5b8dd15fdc4ce5a71'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:58:24.884765 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f730d0d6-27b2-4a50-b212-fdd25b7af34d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abea74c48ef444f5b8dd15fdc4ce5a71'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:58:24.892687 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-f730d0d6-27b2-4a50-b212-fdd25b7af34d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abea74c48ef444f5b8dd15fdc4ce5a71'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:58:24.899030 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1276/2554] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:58:24 2021] DELETE /identity/v3/users/abea74c48ef444f5b8dd15fdc4ce5a71 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:58:25.129781 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d3886-f6a9-4f77-85cf-03c3529b19e9 service nova] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:58:25.141467 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d3886-f6a9-4f77-85cf-03c3529b19e9 service nova] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:58:25.206958 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d6b0e-6469-4c29-933f-2afc00facb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:58:25.207885 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d6b0e-6469-4c29-933f-2afc00facb8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:58:25.208173 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d6b0e-6469-4c29-933f-2afc00facb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:58:25.208457 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d6b0e-6469-4c29-933f-2afc00facb8f admin admin] PATH_INFO: `/v3/projects/d835ac2b7b0e4c4aa5e9e9cdb3a4faa5` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:58:25.209529 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d6b0e-6469-4c29-933f-2afc00facb8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d835ac2b7b0e4c4aa5e9e9cdb3a4faa5)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:58:25.236530 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d6b0e-6469-4c29-933f-2afc00facb8f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:58:25.284654 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-650d6b0e-6469-4c29-933f-2afc00facb8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd835ac2b7b0e4c4aa5e9e9cdb3a4faa5', 'request_id': 'req-650d6b0e-6469-4c29-933f-2afc00facb8f'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:58:25.290770 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-650d6b0e-6469-4c29-933f-2afc00facb8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd835ac2b7b0e4c4aa5e9e9cdb3a4faa5', 'request_id': 'req-650d6b0e-6469-4c29-933f-2afc00facb8f'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:58:25.302159 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-650d6b0e-6469-4c29-933f-2afc00facb8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd835ac2b7b0e4c4aa5e9e9cdb3a4faa5', 'request_id': 'req-650d6b0e-6469-4c29-933f-2afc00facb8f'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:58:25.311832 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-650d6b0e-6469-4c29-933f-2afc00facb8f admin admin] The token cache is being invalidate because project d835ac2b7b0e4c4aa5e9e9cdb3a4faa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:58:25.312161 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-650d6b0e-6469-4c29-933f-2afc00facb8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:58:25.312773 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-650d6b0e-6469-4c29-933f-2afc00facb8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:58:25.314206 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1279/2555] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:58:25 2021] DELETE /identity/v3/projects/d835ac2b7b0e4c4aa5e9e9cdb3a4faa5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:58:25.320114 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751d710-3b01-4c9b-ac93-43e46a0265ea None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:58:25.320412 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751d710-3b01-4c9b-ac93-43e46a0265ea None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:58:25.320693 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751d710-3b01-4c9b-ac93-43e46a0265ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:58:25.344616 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-2751d710-3b01-4c9b-ac93-43e46a0265ea None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:58:25.345803 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-2751d710-3b01-4c9b-ac93-43e46a0265ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:58:25.411403 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1277/2556] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:58:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:58:25.419361 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e0481-4db1-4847-b827-9f3ff69ea788 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:58:25.419654 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e0481-4db1-4847-b827-9f3ff69ea788 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:58:25.419979 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e0481-4db1-4847-b827-9f3ff69ea788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:58:25.441694 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-440e0481-4db1-4847-b827-9f3ff69ea788 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:58:25.442896 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-440e0481-4db1-4847-b827-9f3ff69ea788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:58:25.451055 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1280/2557] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:58:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:58:25.455149 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751d710-3b01-4c9b-ac93-43e46a0265ea None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:58:25.464352 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751d710-3b01-4c9b-ac93-43e46a0265ea None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:58:25.469508 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c43336-eb45-4da3-8d8a-fae71fa9d653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:58:25.470125 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c43336-eb45-4da3-8d8a-fae71fa9d653 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:58:25.470409 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c43336-eb45-4da3-8d8a-fae71fa9d653 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:58:25.470775 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c43336-eb45-4da3-8d8a-fae71fa9d653 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:58:25.471466 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c43336-eb45-4da3-8d8a-fae71fa9d653 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 20:58:25.471760 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c43336-eb45-4da3-8d8a-fae71fa9d653 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:58:25.498384 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c43336-eb45-4da3-8d8a-fae71fa9d653 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:58:25.511385 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1278/2558] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 20:58:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 20:58:25.515741 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e0481-4db1-4847-b827-9f3ff69ea788 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:58:25.524425 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e0481-4db1-4847-b827-9f3ff69ea788 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:58:25.528802 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fa4a8-26d1-4e1c-90d1-5e7393dda17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:58:25.529423 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fa4a8-26d1-4e1c-90d1-5e7393dda17e admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:58:25.529714 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fa4a8-26d1-4e1c-90d1-5e7393dda17e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:58:25.529996 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fa4a8-26d1-4e1c-90d1-5e7393dda17e admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:58:25.530667 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55fa4a8-26d1-4e1c-90d1-5e7393dda17e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:58:25.556911 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55fa4a8-26d1-4e1c-90d1-5e7393dda17e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:58:25.584841 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1281/2559] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 20:58:25 2021] POST /identity/v3/projects => generated 397 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 20:58:25.588999 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c43336-eb45-4da3-8d8a-fae71fa9d653 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:58:25.598567 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c43336-eb45-4da3-8d8a-fae71fa9d653 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:58:25.663609 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663c8a5-bea5-4fd8-9c5e-79f0d930f0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:58:25.664193 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663c8a5-bea5-4fd8-9c5e-79f0d930f0e5 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:58:25.664476 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663c8a5-bea5-4fd8-9c5e-79f0d930f0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:58:25.664751 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663c8a5-bea5-4fd8-9c5e-79f0d930f0e5 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:58:25.665382 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663c8a5-bea5-4fd8-9c5e-79f0d930f0e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:58:25.692135 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663c8a5-bea5-4fd8-9c5e-79f0d930f0e5 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:58:25.711852 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1279/2560] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 20:58:25 2021] POST /identity/v3/users => generated 299 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 20:58:25.716506 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fa4a8-26d1-4e1c-90d1-5e7393dda17e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:58:25.726395 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fa4a8-26d1-4e1c-90d1-5e7393dda17e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:58:25.730749 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e85a8-32b8-40e7-b49d-f7e6a9b30423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:58:25.731936 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e85a8-32b8-40e7-b49d-f7e6a9b30423 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:58:25.732232 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e85a8-32b8-40e7-b49d-f7e6a9b30423 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:58:25.732516 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e85a8-32b8-40e7-b49d-f7e6a9b30423 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:58:25.733202 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e85a8-32b8-40e7-b49d-f7e6a9b30423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:58:25.758777 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e85a8-32b8-40e7-b49d-f7e6a9b30423 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:58:25.768795 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1282/2561] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 20:58:25 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 20:58:25.772879 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663c8a5-bea5-4fd8-9c5e-79f0d930f0e5 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:58:25.782992 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663c8a5-bea5-4fd8-9c5e-79f0d930f0e5 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:58:25.787155 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a985d1d-1d1d-442d-bf19-b22be3400685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:58:25.787952 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a985d1d-1d1d-442d-bf19-b22be3400685 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:58:25.788237 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a985d1d-1d1d-442d-bf19-b22be3400685 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:58:25.788514 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a985d1d-1d1d-442d-bf19-b22be3400685 admin admin] PATH_INFO: `/v3/projects/84ee2bdbbe0e423b8a83d0004f339d01/users/6a8f93fb066d4fd3aae147fbd4781ab3/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:58:25.808422 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a985d1d-1d1d-442d-bf19-b22be3400685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84ee2bdbbe0e423b8a83d0004f339d01, user_id=6a8f93fb066d4fd3aae147fbd4781ab3, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:58:25.836044 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a985d1d-1d1d-442d-bf19-b22be3400685 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:58:25.850719 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1280/2562] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 20:58:25 2021] PUT /identity/v3/projects/84ee2bdbbe0e423b8a83d0004f339d01/users/6a8f93fb066d4fd3aae147fbd4781ab3/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:58:25.860497 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ed331-9d82-4ca3-afa8-c82ca03df86a None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:58:25.860796 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ed331-9d82-4ca3-afa8-c82ca03df86a None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:58:25.861084 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ed331-9d82-4ca3-afa8-c82ca03df86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:58:25.899237 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-5a6ed331-9d82-4ca3-afa8-c82ca03df86a None None] MFA Rules not processed for user `6a8f93fb066d4fd3aae147fbd4781ab3`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:58:25.900456 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-5a6ed331-9d82-4ca3-afa8-c82ca03df86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:58:25.970064 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1283/2563] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:58:25 2021] POST /identity/v3/auth/tokens => generated 3704 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:58:25.979860 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a985d1d-1d1d-442d-bf19-b22be3400685 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:58:25.981448 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-3a985d1d-1d1d-442d-bf19-b22be3400685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:58:26.043388 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a985d1d-1d1d-442d-bf19-b22be3400685 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:58:26.047772 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210437c-05dc-4f4b-a580-910fcfd04371 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:58:26.048343 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210437c-05dc-4f4b-a580-910fcfd04371 service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:58:26.048636 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210437c-05dc-4f4b-a580-910fcfd04371 service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:58:26.048919 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210437c-05dc-4f4b-a580-910fcfd04371 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:58:26.056886 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210437c-05dc-4f4b-a580-910fcfd04371 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:58:26.083286 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210437c-05dc-4f4b-a580-910fcfd04371 service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:58:26.092058 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1281/2564] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:58:25 2021] GET /identity/v3/auth/tokens => generated 3704 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:58:35.812296 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ed331-9d82-4ca3-afa8-c82ca03df86a None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:58:35.881656 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ed331-9d82-4ca3-afa8-c82ca03df86a None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:58:35.885676 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f52fb9-6143-40d0-bf1b-f65c74ae385f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:58:35.886485 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f52fb9-6143-40d0-bf1b-f65c74ae385f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:58:35.887345 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f52fb9-6143-40d0-bf1b-f65c74ae385f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:58:35.887628 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f52fb9-6143-40d0-bf1b-f65c74ae385f admin admin] PATH_INFO: `/v3/users/6a8f93fb066d4fd3aae147fbd4781ab3` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:58:35.888785 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f52fb9-6143-40d0-bf1b-f65c74ae385f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a8f93fb066d4fd3aae147fbd4781ab3)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:58:35.915420 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f52fb9-6143-40d0-bf1b-f65c74ae385f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:58:35.963269 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-e7f52fb9-6143-40d0-bf1b-f65c74ae385f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a8f93fb066d4fd3aae147fbd4781ab3'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:58:35.975241 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-e7f52fb9-6143-40d0-bf1b-f65c74ae385f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a8f93fb066d4fd3aae147fbd4781ab3'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:58:35.975850 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-e7f52fb9-6143-40d0-bf1b-f65c74ae385f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a8f93fb066d4fd3aae147fbd4781ab3'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:58:35.983948 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-e7f52fb9-6143-40d0-bf1b-f65c74ae385f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a8f93fb066d4fd3aae147fbd4781ab3'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:58:35.990757 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-e7f52fb9-6143-40d0-bf1b-f65c74ae385f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a8f93fb066d4fd3aae147fbd4781ab3'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:58:35.997165 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1284/2565] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 20:58:35 2021] DELETE /identity/v3/users/6a8f93fb066d4fd3aae147fbd4781ab3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 20:58:36.001647 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7f19f-5797-4592-bc79-010e2f831bd1 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:58:36.002128 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7f19f-5797-4592-bc79-010e2f831bd1 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:58:36.002276 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7f19f-5797-4592-bc79-010e2f831bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:58:36.023746 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-ddf7f19f-5797-4592-bc79-010e2f831bd1 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:58:36.024809 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-ddf7f19f-5797-4592-bc79-010e2f831bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:58:36.088686 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1282/2566] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:58:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:58:36.099073 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f52fb9-6143-40d0-bf1b-f65c74ae385f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:58:36.100406 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-e7f52fb9-6143-40d0-bf1b-f65c74ae385f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:58:36.163548 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f52fb9-6143-40d0-bf1b-f65c74ae385f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:58:36.167062 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777834f-f05f-4989-94a3-106705149c74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:58:36.167628 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777834f-f05f-4989-94a3-106705149c74 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:58:36.168477 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777834f-f05f-4989-94a3-106705149c74 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:58:36.168753 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777834f-f05f-4989-94a3-106705149c74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:58:36.177296 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777834f-f05f-4989-94a3-106705149c74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:58:36.203501 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777834f-f05f-4989-94a3-106705149c74 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:58:36.212842 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1285/2567] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:58:36 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:58:36.561554 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7f19f-5797-4592-bc79-010e2f831bd1 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:58:36.562905 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-ddf7f19f-5797-4592-bc79-010e2f831bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:58:36.573952 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7f19f-5797-4592-bc79-010e2f831bd1 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:58:36.578575 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822e854-e35b-48a2-b470-e587a8ab8029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:58:36.579393 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822e854-e35b-48a2-b470-e587a8ab8029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:58:36.579680 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822e854-e35b-48a2-b470-e587a8ab8029 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:58:36.579957 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822e854-e35b-48a2-b470-e587a8ab8029 admin admin] PATH_INFO: `/v3/projects/84ee2bdbbe0e423b8a83d0004f339d01` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:58:36.581016 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822e854-e35b-48a2-b470-e587a8ab8029 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84ee2bdbbe0e423b8a83d0004f339d01)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:58:36.607561 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822e854-e35b-48a2-b470-e587a8ab8029 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:58:36.657586 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-0822e854-e35b-48a2-b470-e587a8ab8029 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84ee2bdbbe0e423b8a83d0004f339d01', 'request_id': 'req-0822e854-e35b-48a2-b470-e587a8ab8029'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:58:36.664628 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-0822e854-e35b-48a2-b470-e587a8ab8029 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84ee2bdbbe0e423b8a83d0004f339d01', 'request_id': 'req-0822e854-e35b-48a2-b470-e587a8ab8029'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:58:36.669847 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-0822e854-e35b-48a2-b470-e587a8ab8029 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84ee2bdbbe0e423b8a83d0004f339d01', 'request_id': 'req-0822e854-e35b-48a2-b470-e587a8ab8029'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:58:36.685269 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-0822e854-e35b-48a2-b470-e587a8ab8029 admin admin] The token cache is being invalidate because project 84ee2bdbbe0e423b8a83d0004f339d01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 20:58:36.685555 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-0822e854-e35b-48a2-b470-e587a8ab8029 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:58:36.686151 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-0822e854-e35b-48a2-b470-e587a8ab8029 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 20:58:36.687570 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1283/2568] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 20:58:36 2021] DELETE /identity/v3/projects/84ee2bdbbe0e423b8a83d0004f339d01 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 20:59:10.522970 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc917e-664f-4c95-835b-b516ecf627dd None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:59:10.523503 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc917e-664f-4c95-835b-b516ecf627dd None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:59:10.523618 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc917e-664f-4c95-835b-b516ecf627dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:59:10.546846 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-75fc917e-664f-4c95-835b-b516ecf627dd None None] MFA Rules not processed for user `df2ec396a09f497fa5761cef615b262d`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:59:10.548013 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-75fc917e-664f-4c95-835b-b516ecf627dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:59:10.622616 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1286/2569] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 20:59:10 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:59:10.633017 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822e854-e35b-48a2-b470-e587a8ab8029 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:59:10.634500 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-0822e854-e35b-48a2-b470-e587a8ab8029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:59:10.717544 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822e854-e35b-48a2-b470-e587a8ab8029 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:59:10.722415 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dec87-1972-45cc-b795-6704baea1025 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:59:10.723020 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dec87-1972-45cc-b795-6704baea1025 service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:59:10.723316 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dec87-1972-45cc-b795-6704baea1025 service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:59:10.723589 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dec87-1972-45cc-b795-6704baea1025 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:59:10.725208 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-598dec87-1972-45cc-b795-6704baea1025 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:59:10.734825 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598dec87-1972-45cc-b795-6704baea1025 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:59:10.760876 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598dec87-1972-45cc-b795-6704baea1025 service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:59:10.769378 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1284/2570] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:59:10 2021] GET /identity/v3/auth/tokens => generated 3686 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:59:11.204396 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc917e-664f-4c95-835b-b516ecf627dd None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:59:11.205712 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-75fc917e-664f-4c95-835b-b516ecf627dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:59:11.269779 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc917e-664f-4c95-835b-b516ecf627dd None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:59:11.273030 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a318f-74d0-434c-85b1-ea3740ca549a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:59:11.273637 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a318f-74d0-434c-85b1-ea3740ca549a service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:59:11.273924 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a318f-74d0-434c-85b1-ea3740ca549a service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:59:11.274200 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a318f-74d0-434c-85b1-ea3740ca549a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:59:11.275812 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-7b4a318f-74d0-434c-85b1-ea3740ca549a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:59:11.284665 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a318f-74d0-434c-85b1-ea3740ca549a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:59:11.310094 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a318f-74d0-434c-85b1-ea3740ca549a service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:59:11.318393 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1287/2571] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:59:11 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:59:11.921983 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dec87-1972-45cc-b795-6704baea1025 service nova] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:59:11.923348 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-598dec87-1972-45cc-b795-6704baea1025 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:59:12.000632 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dec87-1972-45cc-b795-6704baea1025 service nova] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:59:12.005130 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028e591-0717-4f24-b885-16f374cfeaea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25cb71bb64a3456fb2dc02095c487d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:59:12.005705 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028e591-0717-4f24-b885-16f374cfeaea service placement] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:59:12.005992 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028e591-0717-4f24-b885-16f374cfeaea service placement] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:59:12.006272 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028e591-0717-4f24-b885-16f374cfeaea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:59:12.007897 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-1028e591-0717-4f24-b885-16f374cfeaea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:59:12.018257 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028e591-0717-4f24-b885-16f374cfeaea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:59:12.044627 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028e591-0717-4f24-b885-16f374cfeaea service placement] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:59:12.053793 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1285/2572] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:59:11 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:59:12.148686 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a318f-74d0-434c-85b1-ea3740ca549a service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:59:12.149999 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-7b4a318f-74d0-434c-85b1-ea3740ca549a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:59:12.164067 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a318f-74d0-434c-85b1-ea3740ca549a service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:59:12.169354 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046d25b-7d3f-451d-ada7-1b7f9cdfa8ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25cb71bb64a3456fb2dc02095c487d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:59:12.169944 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046d25b-7d3f-451d-ada7-1b7f9cdfa8ac service placement] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:59:12.170229 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046d25b-7d3f-451d-ada7-1b7f9cdfa8ac service placement] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:59:12.170509 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046d25b-7d3f-451d-ada7-1b7f9cdfa8ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:59:12.172151 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-5046d25b-7d3f-451d-ada7-1b7f9cdfa8ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:59:12.182390 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046d25b-7d3f-451d-ada7-1b7f9cdfa8ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:59:12.207852 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046d25b-7d3f-451d-ada7-1b7f9cdfa8ac service placement] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:59:12.217793 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1288/2573] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:59:12 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:59:19.126500 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028e591-0717-4f24-b885-16f374cfeaea service placement] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:59:19.128159 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-1028e591-0717-4f24-b885-16f374cfeaea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:59:19.143159 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028e591-0717-4f24-b885-16f374cfeaea service placement] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:59:19.148034 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee365bd2-a96e-4cbb-a94d-380fa46d75a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:59:19.148552 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee365bd2-a96e-4cbb-a94d-380fa46d75a6 service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:59:19.148926 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee365bd2-a96e-4cbb-a94d-380fa46d75a6 service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:59:19.149209 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee365bd2-a96e-4cbb-a94d-380fa46d75a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:59:19.151609 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-ee365bd2-a96e-4cbb-a94d-380fa46d75a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:59:19.163024 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee365bd2-a96e-4cbb-a94d-380fa46d75a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:59:19.190472 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee365bd2-a96e-4cbb-a94d-380fa46d75a6 service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:59:19.203038 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1286/2574] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:59:19 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:59:21.074767 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fb4e2-ebd5-4276-9205-e55f23b005ee None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:59:21.075333 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fb4e2-ebd5-4276-9205-e55f23b005ee None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:59:21.075333 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fb4e2-ebd5-4276-9205-e55f23b005ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:59:21.154794 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-239fb4e2-ebd5-4276-9205-e55f23b005ee None None] MFA Rules not processed for user `1959af22edbf47cd8afca70831d476c0`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:59:21.155994 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-239fb4e2-ebd5-4276-9205-e55f23b005ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:59:21.228981 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1289/2575] 10.222.0.37 () {58 vars in 1014 bytes} [Wed Dec 29 20:59:21 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:59:21.276499 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee365bd2-a96e-4cbb-a94d-380fa46d75a6 service nova] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:59:21.277853 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-ee365bd2-a96e-4cbb-a94d-380fa46d75a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:59:21.382667 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee365bd2-a96e-4cbb-a94d-380fa46d75a6 service nova] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:59:21.387154 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c0707-9603-427a-8744-aa9c9aee1371 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd2861e377640c9b76d0dfb08cf088e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:59:21.387728 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c0707-9603-427a-8744-aa9c9aee1371 service swift] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:59:21.388014 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c0707-9603-427a-8744-aa9c9aee1371 service swift] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:59:21.388292 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c0707-9603-427a-8744-aa9c9aee1371 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:59:21.396352 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c0707-9603-427a-8744-aa9c9aee1371 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:59:21.423945 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c0707-9603-427a-8744-aa9c9aee1371 service swift] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:59:21.432385 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1287/2576] 10.222.0.37 () {60 vars in 1384 bytes} [Wed Dec 29 20:59:21 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 29 20:59:33.363767 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fb4e2-ebd5-4276-9205-e55f23b005ee None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:59:33.378499 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fb4e2-ebd5-4276-9205-e55f23b005ee None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:59:33.383769 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a74d0-66af-42ee-abeb-67a1aefa66e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:59:33.384784 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a74d0-66af-42ee-abeb-67a1aefa66e8 service nova] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:59:33.385387 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a74d0-66af-42ee-abeb-67a1aefa66e8 service nova] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:59:33.385675 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a74d0-66af-42ee-abeb-67a1aefa66e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:59:33.387473 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-901a74d0-66af-42ee-abeb-67a1aefa66e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:59:33.400097 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a74d0-66af-42ee-abeb-67a1aefa66e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:59:33.425943 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a74d0-66af-42ee-abeb-67a1aefa66e8 service nova] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:59:33.437323 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1290/2577] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:59:33 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:59:36.580389 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c0707-9603-427a-8744-aa9c9aee1371 service swift] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:59:36.581786 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-7e7c0707-9603-427a-8744-aa9c9aee1371 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:59:36.593451 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c0707-9603-427a-8744-aa9c9aee1371 service swift] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:59:36.596694 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e1db6-1d2f-47db-a62d-23ab80e61506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:59:36.597253 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e1db6-1d2f-47db-a62d-23ab80e61506 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:59:36.597540 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e1db6-1d2f-47db-a62d-23ab80e61506 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:59:36.597821 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e1db6-1d2f-47db-a62d-23ab80e61506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:59:36.599419 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-517e1db6-1d2f-47db-a62d-23ab80e61506 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:59:36.608304 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e1db6-1d2f-47db-a62d-23ab80e61506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:59:36.633173 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e1db6-1d2f-47db-a62d-23ab80e61506 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:59:36.641594 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1288/2578] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:59:36 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:59:36.910857 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494500de-92b3-4ce4-8110-2d5c62252e10 None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:59:36.911410 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494500de-92b3-4ce4-8110-2d5c62252e10 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:59:36.911410 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494500de-92b3-4ce4-8110-2d5c62252e10 None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:59:36.913209 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1291/2579] 10.222.0.37 () {54 vars in 921 bytes} [Wed Dec 29 20:59:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 29 20:59:36.918809 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521b62c-97c4-4c05-8ab7-06c72a654877 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:59:36.919109 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521b62c-97c4-4c05-8ab7-06c72a654877 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:59:36.919442 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521b62c-97c4-4c05-8ab7-06c72a654877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:59:36.943052 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-9521b62c-97c4-4c05-8ab7-06c72a654877 None None] MFA Rules not processed for user `55d700adb7db4848a97bab6cf4105481`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:59:36.944439 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-9521b62c-97c4-4c05-8ab7-06c72a654877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:59:36.950641 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1289/2580] 10.222.0.37 () {58 vars in 1018 bytes} [Wed Dec 29 20:59:36 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 20:59:36.962211 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494500de-92b3-4ce4-8110-2d5c62252e10 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:59:36.973442 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494500de-92b3-4ce4-8110-2d5c62252e10 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:59:36.977433 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3366162-a81a-4383-ab5e-794d6274c786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:59:36.983242 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3366162-a81a-4383-ab5e-794d6274c786 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:59:36.983850 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3366162-a81a-4383-ab5e-794d6274c786 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:59:36.984151 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3366162-a81a-4383-ab5e-794d6274c786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:59:36.992439 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3366162-a81a-4383-ab5e-794d6274c786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:59:37.018058 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3366162-a81a-4383-ab5e-794d6274c786 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:59:37.028013 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1292/2581] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 20:59:36 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 20:59:39.714362 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502765dd-1ef4-4338-b42a-a3e7c2f4a2c1 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:59:39.714958 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502765dd-1ef4-4338-b42a-a3e7c2f4a2c1 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:59:39.715052 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502765dd-1ef4-4338-b42a-a3e7c2f4a2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:59:39.737274 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-502765dd-1ef4-4338-b42a-a3e7c2f4a2c1 None None] MFA Rules not processed for user `1959af22edbf47cd8afca70831d476c0`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 20:59:39.738341 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-502765dd-1ef4-4338-b42a-a3e7c2f4a2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 20:59:39.745252 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1290/2582] 10.222.0.37 () {58 vars in 1014 bytes} [Wed Dec 29 20:59:39 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 20:59:39.757016 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3366162-a81a-4383-ab5e-794d6274c786 service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 20:59:39.768844 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3366162-a81a-4383-ab5e-794d6274c786 service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 20:59:39.773283 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ebcab-16cb-453e-98da-0f3cb79d108d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd2861e377640c9b76d0dfb08cf088e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 20:59:39.773844 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ebcab-16cb-453e-98da-0f3cb79d108d service swift] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 20:59:39.774136 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ebcab-16cb-453e-98da-0f3cb79d108d service swift] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 20:59:39.774419 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ebcab-16cb-453e-98da-0f3cb79d108d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 20:59:39.783091 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ebcab-16cb-453e-98da-0f3cb79d108d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 20:59:39.809104 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ebcab-16cb-453e-98da-0f3cb79d108d service swift] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 20:59:39.817437 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1293/2583] 10.222.0.37 () {60 vars in 1384 bytes} [Wed Dec 29 20:59:39 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 29 21:00:02.671245 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cf864-a3af-4982-a1c0-2fcb3acb9185 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:00:02.671803 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cf864-a3af-4982-a1c0-2fcb3acb9185 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:00:02.671984 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cf864-a3af-4982-a1c0-2fcb3acb9185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:00:02.693006 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-0a4cf864-a3af-4982-a1c0-2fcb3acb9185 None None] MFA Rules not processed for user `26b2db123c664c398307c4fdf26c2406`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:00:02.694148 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-0a4cf864-a3af-4982-a1c0-2fcb3acb9185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:00:02.752651 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1291/2584] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:00:02 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:00:07.571395 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67045ca1-15aa-430d-b710-4d5b99d29f08 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:00:07.571913 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67045ca1-15aa-430d-b710-4d5b99d29f08 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:00:07.572057 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67045ca1-15aa-430d-b710-4d5b99d29f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:00:07.594367 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-67045ca1-15aa-430d-b710-4d5b99d29f08 None None] MFA Rules not processed for user `1959af22edbf47cd8afca70831d476c0`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:00:07.595582 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-67045ca1-15aa-430d-b710-4d5b99d29f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:00:07.601970 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1294/2585] 10.222.0.37 () {58 vars in 967 bytes} [Wed Dec 29 21:00:07 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:00:07.613803 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cf864-a3af-4982-a1c0-2fcb3acb9185 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:00:07.625768 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cf864-a3af-4982-a1c0-2fcb3acb9185 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:00:07.630471 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671743f-bb1e-405c-beb2-dc717e5e25b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd2861e377640c9b76d0dfb08cf088e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:00:07.631148 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671743f-bb1e-405c-beb2-dc717e5e25b9 service swift] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:00:07.631626 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671743f-bb1e-405c-beb2-dc717e5e25b9 service swift] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:00:07.631914 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671743f-bb1e-405c-beb2-dc717e5e25b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:00:07.641023 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671743f-bb1e-405c-beb2-dc717e5e25b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:00:07.666620 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671743f-bb1e-405c-beb2-dc717e5e25b9 service swift] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:00:07.675672 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1292/2586] 10.222.0.37 () {60 vars in 1384 bytes} [Wed Dec 29 21:00:07 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 29 21:00:19.167245 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67045ca1-15aa-430d-b710-4d5b99d29f08 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:00:19.179586 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67045ca1-15aa-430d-b710-4d5b99d29f08 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:00:19.184231 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc9d40-9e35-4c7d-a71c-ec564578415b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25cb71bb64a3456fb2dc02095c487d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:00:19.184806 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc9d40-9e35-4c7d-a71c-ec564578415b service placement] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:00:19.185100 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc9d40-9e35-4c7d-a71c-ec564578415b service placement] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:00:19.185381 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc9d40-9e35-4c7d-a71c-ec564578415b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:00:19.187063 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-edcc9d40-9e35-4c7d-a71c-ec564578415b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:00:19.199364 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc9d40-9e35-4c7d-a71c-ec564578415b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:00:19.225675 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc9d40-9e35-4c7d-a71c-ec564578415b service placement] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:00:19.236584 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1295/2587] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:00:19 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:01:16.677642 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671743f-bb1e-405c-beb2-dc717e5e25b9 service swift] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:01:16.688780 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671743f-bb1e-405c-beb2-dc717e5e25b9 service swift] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:01:16.694084 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481b46f-306f-4945-b9a2-4d74a05ed703 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:01:16.694760 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481b46f-306f-4945-b9a2-4d74a05ed703 service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:01:16.695067 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481b46f-306f-4945-b9a2-4d74a05ed703 service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:01:16.695346 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481b46f-306f-4945-b9a2-4d74a05ed703 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:01:16.697026 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-e481b46f-306f-4945-b9a2-4d74a05ed703 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:01:16.764361 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481b46f-306f-4945-b9a2-4d74a05ed703 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:01:16.789831 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481b46f-306f-4945-b9a2-4d74a05ed703 service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:01:16.798420 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1293/2588] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:01:16 2021] GET /identity/v3/auth/tokens => generated 3694 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:01:26.708693 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df45253-90f7-4f23-928c-e99680a9f7a1 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:01:26.709232 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df45253-90f7-4f23-928c-e99680a9f7a1 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:01:26.709341 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df45253-90f7-4f23-928c-e99680a9f7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:01:26.731401 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-5df45253-90f7-4f23-928c-e99680a9f7a1 None None] MFA Rules not processed for user `82536fd1a7004505b9c79b6bc570d9e4`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:01:26.732523 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-5df45253-90f7-4f23-928c-e99680a9f7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:01:26.738424 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1296/2589] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:01:26 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:01:45.437108 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ddacc2-ef8b-4ed6-85bb-48ae5ecd94de None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:01:45.437670 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ddacc2-ef8b-4ed6-85bb-48ae5ecd94de None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:01:45.438198 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ddacc2-ef8b-4ed6-85bb-48ae5ecd94de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:01:45.461566 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-74ddacc2-ef8b-4ed6-85bb-48ae5ecd94de None None] MFA Rules not processed for user `df2ec396a09f497fa5761cef615b262d`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:01:45.463068 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-74ddacc2-ef8b-4ed6-85bb-48ae5ecd94de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:01:45.470231 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1294/2590] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:01:45 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:02:06.745295 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df45253-90f7-4f23-928c-e99680a9f7a1 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:06.755208 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df45253-90f7-4f23-928c-e99680a9f7a1 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:06.758350 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4f463-a789-4e80-9205-4c4a24c90634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:06.758939 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4f463-a789-4e80-9205-4c4a24c90634 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:06.759226 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4f463-a789-4e80-9205-4c4a24c90634 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:06.759505 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4f463-a789-4e80-9205-4c4a24c90634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:06.769293 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4f463-a789-4e80-9205-4c4a24c90634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:06.795661 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4f463-a789-4e80-9205-4c4a24c90634 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:06.806314 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1297/2591] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:02:06 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:02:08.305141 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ddacc2-ef8b-4ed6-85bb-48ae5ecd94de None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:08.314601 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ddacc2-ef8b-4ed6-85bb-48ae5ecd94de None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:08.317851 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3be72-38ef-480a-962c-f42c67ef5748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:08.318415 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3be72-38ef-480a-962c-f42c67ef5748 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:08.319019 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3be72-38ef-480a-962c-f42c67ef5748 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:08.319308 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3be72-38ef-480a-962c-f42c67ef5748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:08.328855 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3be72-38ef-480a-962c-f42c67ef5748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:08.354312 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3be72-38ef-480a-962c-f42c67ef5748 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:08.365174 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1295/2592] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:02:08 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:02:08.520919 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4f463-a789-4e80-9205-4c4a24c90634 service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:08.530140 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4f463-a789-4e80-9205-4c4a24c90634 service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:08.533480 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03497c3-d2d2-4e41-bb85-f2e88b0002a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:08.534034 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03497c3-d2d2-4e41-bb85-f2e88b0002a5 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:08.534318 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03497c3-d2d2-4e41-bb85-f2e88b0002a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:08.534594 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03497c3-d2d2-4e41-bb85-f2e88b0002a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:08.536245 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c03497c3-d2d2-4e41-bb85-f2e88b0002a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:02:08.606496 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03497c3-d2d2-4e41-bb85-f2e88b0002a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:08.631614 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03497c3-d2d2-4e41-bb85-f2e88b0002a5 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:08.641253 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1298/2593] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:02:08 2021] GET /identity/v3/auth/tokens => generated 3751 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:02:19.351507 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3be72-38ef-480a-962c-f42c67ef5748 service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:19.361210 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3be72-38ef-480a-962c-f42c67ef5748 service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:19.364609 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2e2ee-2670-4361-bceb-66ed6d5e58c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:19.365132 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2e2ee-2670-4361-bceb-66ed6d5e58c5 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:19.365419 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2e2ee-2670-4361-bceb-66ed6d5e58c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:19.365739 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2e2ee-2670-4361-bceb-66ed6d5e58c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:19.367414 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-0cb2e2ee-2670-4361-bceb-66ed6d5e58c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:02:19.433180 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2e2ee-2670-4361-bceb-66ed6d5e58c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:19.458779 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2e2ee-2670-4361-bceb-66ed6d5e58c5 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:19.468302 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1296/2594] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:02:19 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:02:26.794494 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03497c3-d2d2-4e41-bb85-f2e88b0002a5 service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:26.803017 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03497c3-d2d2-4e41-bb85-f2e88b0002a5 service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:26.806285 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b510e58-8a71-41ba-9602-a20e60bc179b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:26.806874 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b510e58-8a71-41ba-9602-a20e60bc179b service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:26.807299 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b510e58-8a71-41ba-9602-a20e60bc179b service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:26.807453 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b510e58-8a71-41ba-9602-a20e60bc179b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:26.809125 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-0b510e58-8a71-41ba-9602-a20e60bc179b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:02:26.880991 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b510e58-8a71-41ba-9602-a20e60bc179b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:26.907191 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b510e58-8a71-41ba-9602-a20e60bc179b service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:26.917826 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1299/2595] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:02:26 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:02:35.282519 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2e2ee-2670-4361-bceb-66ed6d5e58c5 service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:35.291101 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2e2ee-2670-4361-bceb-66ed6d5e58c5 service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:35.296472 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad43f6-e286-42cb-8021-3bf95103dfad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:35.297046 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad43f6-e286-42cb-8021-3bf95103dfad service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:35.297330 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad43f6-e286-42cb-8021-3bf95103dfad service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:35.297609 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad43f6-e286-42cb-8021-3bf95103dfad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:35.299336 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-e3ad43f6-e286-42cb-8021-3bf95103dfad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:02:35.311422 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad43f6-e286-42cb-8021-3bf95103dfad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:35.336918 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad43f6-e286-42cb-8021-3bf95103dfad service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:35.347365 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1297/2596] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:02:35 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:02:38.599587 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b510e58-8a71-41ba-9602-a20e60bc179b service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:38.601092 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-0b510e58-8a71-41ba-9602-a20e60bc179b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:02:38.617139 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b510e58-8a71-41ba-9602-a20e60bc179b service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:38.622014 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce675cd-fdbb-4cfc-a37b-607229a1c6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:38.623890 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce675cd-fdbb-4cfc-a37b-607229a1c6c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:38.624413 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce675cd-fdbb-4cfc-a37b-607229a1c6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:38.625136 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce675cd-fdbb-4cfc-a37b-607229a1c6c2 admin admin] PATH_INFO: `/v3/users/662cb05d5a264e9ab56a11a5ca8a1eb3` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:38.626720 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce675cd-fdbb-4cfc-a37b-607229a1c6c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=662cb05d5a264e9ab56a11a5ca8a1eb3)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:38.652628 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce675cd-fdbb-4cfc-a37b-607229a1c6c2 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:38.704236 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-fce675cd-fdbb-4cfc-a37b-607229a1c6c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '662cb05d5a264e9ab56a11a5ca8a1eb3'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:38.716073 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-fce675cd-fdbb-4cfc-a37b-607229a1c6c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '662cb05d5a264e9ab56a11a5ca8a1eb3'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:38.716916 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-fce675cd-fdbb-4cfc-a37b-607229a1c6c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '662cb05d5a264e9ab56a11a5ca8a1eb3'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:38.727523 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-fce675cd-fdbb-4cfc-a37b-607229a1c6c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '662cb05d5a264e9ab56a11a5ca8a1eb3'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:38.738148 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-fce675cd-fdbb-4cfc-a37b-607229a1c6c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '662cb05d5a264e9ab56a11a5ca8a1eb3'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:38.748368 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1300/2597] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 21:02:38 2021] DELETE /identity/v3/users/662cb05d5a264e9ab56a11a5ca8a1eb3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:02:38.992657 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad43f6-e286-42cb-8021-3bf95103dfad service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:39.002637 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad43f6-e286-42cb-8021-3bf95103dfad service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:39.074405 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bc3e8-a077-4415-98ad-fd9ff05de2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:39.075599 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bc3e8-a077-4415-98ad-fd9ff05de2c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:39.076095 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bc3e8-a077-4415-98ad-fd9ff05de2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:39.076538 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bc3e8-a077-4415-98ad-fd9ff05de2c9 admin admin] PATH_INFO: `/v3/projects/fc1b3281fc834cd68995c2b6fd67f2a4` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:39.078089 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bc3e8-a077-4415-98ad-fd9ff05de2c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc1b3281fc834cd68995c2b6fd67f2a4)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:39.119264 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bc3e8-a077-4415-98ad-fd9ff05de2c9 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:39.189766 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-172bc3e8-a077-4415-98ad-fd9ff05de2c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc1b3281fc834cd68995c2b6fd67f2a4', 'request_id': 'req-172bc3e8-a077-4415-98ad-fd9ff05de2c9'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:39.203029 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-172bc3e8-a077-4415-98ad-fd9ff05de2c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc1b3281fc834cd68995c2b6fd67f2a4', 'request_id': 'req-172bc3e8-a077-4415-98ad-fd9ff05de2c9'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:39.214188 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-172bc3e8-a077-4415-98ad-fd9ff05de2c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc1b3281fc834cd68995c2b6fd67f2a4', 'request_id': 'req-172bc3e8-a077-4415-98ad-fd9ff05de2c9'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:39.234512 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-172bc3e8-a077-4415-98ad-fd9ff05de2c9 admin admin] The token cache is being invalidate because project fc1b3281fc834cd68995c2b6fd67f2a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 21:02:39.234843 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-172bc3e8-a077-4415-98ad-fd9ff05de2c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:39.235471 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-172bc3e8-a077-4415-98ad-fd9ff05de2c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:39.238164 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1298/2598] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 21:02:38 2021] DELETE /identity/v3/projects/fc1b3281fc834cd68995c2b6fd67f2a4 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:02:39.241748 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce675cd-fdbb-4cfc-a37b-607229a1c6c2 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:39.243362 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-fce675cd-fdbb-4cfc-a37b-607229a1c6c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:02:39.260139 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce675cd-fdbb-4cfc-a37b-607229a1c6c2 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:39.326549 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72142938-d547-450b-b456-be4220a0e8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:39.326902 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72142938-d547-450b-b456-be4220a0e8a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:39.327231 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72142938-d547-450b-b456-be4220a0e8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:39.327513 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72142938-d547-450b-b456-be4220a0e8a3 admin admin] PATH_INFO: `/v3/users/4335ebf161604e54a12b50942d16b574` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:39.328673 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72142938-d547-450b-b456-be4220a0e8a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4335ebf161604e54a12b50942d16b574)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:39.354173 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72142938-d547-450b-b456-be4220a0e8a3 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:39.405098 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-72142938-d547-450b-b456-be4220a0e8a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4335ebf161604e54a12b50942d16b574'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:39.416567 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-72142938-d547-450b-b456-be4220a0e8a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4335ebf161604e54a12b50942d16b574'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:39.417221 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-72142938-d547-450b-b456-be4220a0e8a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4335ebf161604e54a12b50942d16b574'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:39.425552 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-72142938-d547-450b-b456-be4220a0e8a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4335ebf161604e54a12b50942d16b574'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:39.432844 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-72142938-d547-450b-b456-be4220a0e8a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4335ebf161604e54a12b50942d16b574'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:39.440451 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1301/2599] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 21:02:39 2021] DELETE /identity/v3/users/4335ebf161604e54a12b50942d16b574 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 21:02:39.669020 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bc3e8-a077-4415-98ad-fd9ff05de2c9 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:39.671179 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-172bc3e8-a077-4415-98ad-fd9ff05de2c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:02:39.684200 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bc3e8-a077-4415-98ad-fd9ff05de2c9 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:39.760242 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebe999-dff1-49a9-b23d-6e530ccd81d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:39.760415 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebe999-dff1-49a9-b23d-6e530ccd81d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:39.761557 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebe999-dff1-49a9-b23d-6e530ccd81d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:39.761557 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebe999-dff1-49a9-b23d-6e530ccd81d6 admin admin] PATH_INFO: `/v3/projects/6d21c3a01cf640d18210aada5d270cdc` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:39.765095 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cebe999-dff1-49a9-b23d-6e530ccd81d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d21c3a01cf640d18210aada5d270cdc)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:39.789071 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cebe999-dff1-49a9-b23d-6e530ccd81d6 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:39.840299 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-2cebe999-dff1-49a9-b23d-6e530ccd81d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d21c3a01cf640d18210aada5d270cdc', 'request_id': 'req-2cebe999-dff1-49a9-b23d-6e530ccd81d6'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:39.848169 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-2cebe999-dff1-49a9-b23d-6e530ccd81d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d21c3a01cf640d18210aada5d270cdc', 'request_id': 'req-2cebe999-dff1-49a9-b23d-6e530ccd81d6'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:39.853334 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-2cebe999-dff1-49a9-b23d-6e530ccd81d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d21c3a01cf640d18210aada5d270cdc', 'request_id': 'req-2cebe999-dff1-49a9-b23d-6e530ccd81d6'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:39.875900 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-2cebe999-dff1-49a9-b23d-6e530ccd81d6 admin admin] The token cache is being invalidate because project 6d21c3a01cf640d18210aada5d270cdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 21:02:39.876464 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-2cebe999-dff1-49a9-b23d-6e530ccd81d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:39.877285 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-2cebe999-dff1-49a9-b23d-6e530ccd81d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:39.879149 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1299/2600] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 21:02:39 2021] DELETE /identity/v3/projects/6d21c3a01cf640d18210aada5d270cdc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:02:41.277372 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72142938-d547-450b-b456-be4220a0e8a3 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:41.278905 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-72142938-d547-450b-b456-be4220a0e8a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:02:41.290872 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72142938-d547-450b-b456-be4220a0e8a3 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:41.353487 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b845f-a9c7-446b-b359-7221681bac1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:41.354200 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b845f-a9c7-446b-b359-7221681bac1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:41.354486 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b845f-a9c7-446b-b359-7221681bac1b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:41.354794 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b845f-a9c7-446b-b359-7221681bac1b admin admin] PATH_INFO: `/v3/users/26b2db123c664c398307c4fdf26c2406` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:41.371756 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b845f-a9c7-446b-b359-7221681bac1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=26b2db123c664c398307c4fdf26c2406)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:41.398475 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b845f-a9c7-446b-b359-7221681bac1b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:41.446182 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-d77b845f-a9c7-446b-b359-7221681bac1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26b2db123c664c398307c4fdf26c2406'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:41.457475 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-d77b845f-a9c7-446b-b359-7221681bac1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26b2db123c664c398307c4fdf26c2406'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:41.458103 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-d77b845f-a9c7-446b-b359-7221681bac1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26b2db123c664c398307c4fdf26c2406'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:41.465468 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-d77b845f-a9c7-446b-b359-7221681bac1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26b2db123c664c398307c4fdf26c2406'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:41.472595 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-d77b845f-a9c7-446b-b359-7221681bac1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26b2db123c664c398307c4fdf26c2406'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:41.478632 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1302/2601] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 21:02:41 2021] DELETE /identity/v3/users/26b2db123c664c398307c4fdf26c2406 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:02:41.705065 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebe999-dff1-49a9-b23d-6e530ccd81d6 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:41.706396 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-2cebe999-dff1-49a9-b23d-6e530ccd81d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:02:41.720216 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebe999-dff1-49a9-b23d-6e530ccd81d6 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:41.781457 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e9d95-6572-4a1a-be03-ac5a73d91161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:41.782233 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e9d95-6572-4a1a-be03-ac5a73d91161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:41.782517 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e9d95-6572-4a1a-be03-ac5a73d91161 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:41.782829 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e9d95-6572-4a1a-be03-ac5a73d91161 admin admin] PATH_INFO: `/v3/projects/4ab51ee037374f88ab16f92d853d8d12` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:41.794046 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e9d95-6572-4a1a-be03-ac5a73d91161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ab51ee037374f88ab16f92d853d8d12)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:41.820199 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e9d95-6572-4a1a-be03-ac5a73d91161 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:41.870413 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-600e9d95-6572-4a1a-be03-ac5a73d91161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ab51ee037374f88ab16f92d853d8d12', 'request_id': 'req-600e9d95-6572-4a1a-be03-ac5a73d91161'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:41.877889 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-600e9d95-6572-4a1a-be03-ac5a73d91161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ab51ee037374f88ab16f92d853d8d12', 'request_id': 'req-600e9d95-6572-4a1a-be03-ac5a73d91161'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:41.882957 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-600e9d95-6572-4a1a-be03-ac5a73d91161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ab51ee037374f88ab16f92d853d8d12', 'request_id': 'req-600e9d95-6572-4a1a-be03-ac5a73d91161'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:41.898437 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-600e9d95-6572-4a1a-be03-ac5a73d91161 admin admin] The token cache is being invalidate because project 4ab51ee037374f88ab16f92d853d8d12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 21:02:41.898751 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-600e9d95-6572-4a1a-be03-ac5a73d91161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:41.899354 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-600e9d95-6572-4a1a-be03-ac5a73d91161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:41.900772 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1300/2602] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 21:02:41 2021] DELETE /identity/v3/projects/4ab51ee037374f88ab16f92d853d8d12 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:02:41.906964 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42137ce-2925-462e-8fc9-d9be4935c844 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:41.907309 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42137ce-2925-462e-8fc9-d9be4935c844 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:41.907536 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42137ce-2925-462e-8fc9-d9be4935c844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:41.930013 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-c42137ce-2925-462e-8fc9-d9be4935c844 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:02:41.931167 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c42137ce-2925-462e-8fc9-d9be4935c844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:02:41.996235 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1303/2603] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:02:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:02:42.004249 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43152df7-9cb8-4bd0-b582-0d3c282d3bc0 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:42.004542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43152df7-9cb8-4bd0-b582-0d3c282d3bc0 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:42.004824 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43152df7-9cb8-4bd0-b582-0d3c282d3bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:42.026502 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-43152df7-9cb8-4bd0-b582-0d3c282d3bc0 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:02:42.027673 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-43152df7-9cb8-4bd0-b582-0d3c282d3bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:02:42.035358 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1301/2604] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:02:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:02:42.039329 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42137ce-2925-462e-8fc9-d9be4935c844 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:42.049092 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42137ce-2925-462e-8fc9-d9be4935c844 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:42.053266 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c78c17-6343-4000-951f-ccf8fcba6210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:42.053845 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c78c17-6343-4000-951f-ccf8fcba6210 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:42.054134 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c78c17-6343-4000-951f-ccf8fcba6210 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:42.054416 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c78c17-6343-4000-951f-ccf8fcba6210 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:42.055142 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c78c17-6343-4000-951f-ccf8fcba6210 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 21:02:42.055443 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c78c17-6343-4000-951f-ccf8fcba6210 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:42.080990 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c78c17-6343-4000-951f-ccf8fcba6210 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:42.094074 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1304/2605] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 21:02:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 21:02:42.098137 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43152df7-9cb8-4bd0-b582-0d3c282d3bc0 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:42.106784 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43152df7-9cb8-4bd0-b582-0d3c282d3bc0 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:42.111599 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecf1ea-7014-47a2-8417-85cd3f8f65a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:42.112171 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecf1ea-7014-47a2-8417-85cd3f8f65a9 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:42.112459 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecf1ea-7014-47a2-8417-85cd3f8f65a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:42.112740 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecf1ea-7014-47a2-8417-85cd3f8f65a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:42.113384 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecf1ea-7014-47a2-8417-85cd3f8f65a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:42.139312 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecf1ea-7014-47a2-8417-85cd3f8f65a9 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:42.174871 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1302/2606] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 21:02:42 2021] POST /identity/v3/projects => generated 365 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 21:02:42.178945 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c78c17-6343-4000-951f-ccf8fcba6210 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:42.188350 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c78c17-6343-4000-951f-ccf8fcba6210 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:42.250740 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b443766-55a0-40d3-bfed-38ffeea63dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:42.251331 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b443766-55a0-40d3-bfed-38ffeea63dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:42.251619 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b443766-55a0-40d3-bfed-38ffeea63dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:42.251902 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b443766-55a0-40d3-bfed-38ffeea63dc9 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:42.252526 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b443766-55a0-40d3-bfed-38ffeea63dc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:42.279307 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b443766-55a0-40d3-bfed-38ffeea63dc9 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:42.298392 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1305/2607] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 21:02:42 2021] POST /identity/v3/users => generated 283 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 21:02:42.302402 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecf1ea-7014-47a2-8417-85cd3f8f65a9 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:42.314138 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecf1ea-7014-47a2-8417-85cd3f8f65a9 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:42.321434 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee6a9d-f483-4dec-8553-f4692951894b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:42.322518 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee6a9d-f483-4dec-8553-f4692951894b admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:42.323080 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee6a9d-f483-4dec-8553-f4692951894b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:42.323566 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee6a9d-f483-4dec-8553-f4692951894b admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:42.324782 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee6a9d-f483-4dec-8553-f4692951894b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:42.352161 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee6a9d-f483-4dec-8553-f4692951894b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:42.363026 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1303/2608] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:02:42 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 21:02:42.367120 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b443766-55a0-40d3-bfed-38ffeea63dc9 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:42.376790 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b443766-55a0-40d3-bfed-38ffeea63dc9 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:42.381014 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db96ec1-2fe9-4bfa-ba69-b7389e8fd23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:42.381827 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db96ec1-2fe9-4bfa-ba69-b7389e8fd23d admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:42.382114 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db96ec1-2fe9-4bfa-ba69-b7389e8fd23d admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:42.382393 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db96ec1-2fe9-4bfa-ba69-b7389e8fd23d admin admin] PATH_INFO: `/v3/projects/ce5c5263b7694fa09cd1f6d7d2218d8d/users/7d1eec6dd752459a9c7bea677e668a39/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:42.403013 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db96ec1-2fe9-4bfa-ba69-b7389e8fd23d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce5c5263b7694fa09cd1f6d7d2218d8d, user_id=7d1eec6dd752459a9c7bea677e668a39, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:42.429914 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db96ec1-2fe9-4bfa-ba69-b7389e8fd23d admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:42.442638 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1306/2609] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:02:42 2021] PUT /identity/v3/projects/ce5c5263b7694fa09cd1f6d7d2218d8d/users/7d1eec6dd752459a9c7bea677e668a39/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:02:42.453543 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e29213-50a0-46b5-a9f1-7eb27d557f43 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:42.453846 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e29213-50a0-46b5-a9f1-7eb27d557f43 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:42.454165 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e29213-50a0-46b5-a9f1-7eb27d557f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:42.490725 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-39e29213-50a0-46b5-a9f1-7eb27d557f43 None None] MFA Rules not processed for user `7d1eec6dd752459a9c7bea677e668a39`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:02:42.491882 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-39e29213-50a0-46b5-a9f1-7eb27d557f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:02:42.568458 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1304/2610] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:02:42 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:02:42.573251 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db96ec1-2fe9-4bfa-ba69-b7389e8fd23d admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:42.640831 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db96ec1-2fe9-4bfa-ba69-b7389e8fd23d admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:42.645024 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2f521-f50c-4fa9-82ca-5cc353de72db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:42.645549 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2f521-f50c-4fa9-82ca-5cc353de72db admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:42.645835 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2f521-f50c-4fa9-82ca-5cc353de72db admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:42.646111 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2f521-f50c-4fa9-82ca-5cc353de72db admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:42.646763 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2f521-f50c-4fa9-82ca-5cc353de72db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:42.672737 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2f521-f50c-4fa9-82ca-5cc353de72db admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:42.698736 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1307/2611] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 21:02:42 2021] POST /identity/v3/projects => generated 363 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 21:02:42.703413 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e29213-50a0-46b5-a9f1-7eb27d557f43 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:42.713609 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e29213-50a0-46b5-a9f1-7eb27d557f43 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:42.776617 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6ad92-ba50-4ae6-8f0c-a16c9809581f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:42.777215 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6ad92-ba50-4ae6-8f0c-a16c9809581f admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:42.777527 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6ad92-ba50-4ae6-8f0c-a16c9809581f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:42.777807 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6ad92-ba50-4ae6-8f0c-a16c9809581f admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:42.778450 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6ad92-ba50-4ae6-8f0c-a16c9809581f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:42.803843 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6ad92-ba50-4ae6-8f0c-a16c9809581f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:42.822763 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1305/2612] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 21:02:42 2021] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 21:02:42.827568 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2f521-f50c-4fa9-82ca-5cc353de72db admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:42.837761 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2f521-f50c-4fa9-82ca-5cc353de72db admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:42.842014 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594b3b6-e96e-4cb9-a78f-a9f459801c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:42.842601 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594b3b6-e96e-4cb9-a78f-a9f459801c93 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:42.842954 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594b3b6-e96e-4cb9-a78f-a9f459801c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:42.843237 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594b3b6-e96e-4cb9-a78f-a9f459801c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:42.843922 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594b3b6-e96e-4cb9-a78f-a9f459801c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:42.869251 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594b3b6-e96e-4cb9-a78f-a9f459801c93 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:42.881364 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1308/2613] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:02:42 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 21:02:42.885610 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6ad92-ba50-4ae6-8f0c-a16c9809581f admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:42.895579 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6ad92-ba50-4ae6-8f0c-a16c9809581f admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:42.899649 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477f963-c21e-4357-aeb7-41a52b2a71b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:42.900454 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477f963-c21e-4357-aeb7-41a52b2a71b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:42.900744 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477f963-c21e-4357-aeb7-41a52b2a71b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:42.901026 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477f963-c21e-4357-aeb7-41a52b2a71b7 admin admin] PATH_INFO: `/v3/projects/395cd476196741028ac1d066488a9a0c/users/f1ee5742e8374731aa9ad8d37e6387fb/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:42.920679 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477f963-c21e-4357-aeb7-41a52b2a71b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=395cd476196741028ac1d066488a9a0c, user_id=f1ee5742e8374731aa9ad8d37e6387fb, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:42.948195 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477f963-c21e-4357-aeb7-41a52b2a71b7 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:42.961313 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1306/2614] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:02:42 2021] PUT /identity/v3/projects/395cd476196741028ac1d066488a9a0c/users/f1ee5742e8374731aa9ad8d37e6387fb/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:02:42.965415 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594b3b6-e96e-4cb9-a78f-a9f459801c93 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:42.975484 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594b3b6-e96e-4cb9-a78f-a9f459801c93 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:43.038330 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07eb83a-d5f3-4b5a-bbc0-86a267a2b89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:43.039122 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07eb83a-d5f3-4b5a-bbc0-86a267a2b89a admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:43.039641 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07eb83a-d5f3-4b5a-bbc0-86a267a2b89a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:43.040134 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07eb83a-d5f3-4b5a-bbc0-86a267a2b89a admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:43.041321 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07eb83a-d5f3-4b5a-bbc0-86a267a2b89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:43.066954 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07eb83a-d5f3-4b5a-bbc0-86a267a2b89a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:43.077885 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1309/2615] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:02:42 2021] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 21:02:43.082203 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477f963-c21e-4357-aeb7-41a52b2a71b7 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:43.092506 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477f963-c21e-4357-aeb7-41a52b2a71b7 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:43.098060 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f0251-cc01-43e5-b966-f592a5867a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:43.098902 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f0251-cc01-43e5-b966-f592a5867a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:43.099187 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f0251-cc01-43e5-b966-f592a5867a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:43.099465 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f0251-cc01-43e5-b966-f592a5867a41 admin admin] PATH_INFO: `/v3/projects/395cd476196741028ac1d066488a9a0c/users/f1ee5742e8374731aa9ad8d37e6387fb/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:43.101186 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f0251-cc01-43e5-b966-f592a5867a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=395cd476196741028ac1d066488a9a0c, user_id=f1ee5742e8374731aa9ad8d37e6387fb, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:43.127450 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f0251-cc01-43e5-b966-f592a5867a41 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:43.137480 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1307/2616] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:02:43 2021] PUT /identity/v3/projects/395cd476196741028ac1d066488a9a0c/users/f1ee5742e8374731aa9ad8d37e6387fb/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:02:43.141874 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07eb83a-d5f3-4b5a-bbc0-86a267a2b89a admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:43.151245 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07eb83a-d5f3-4b5a-bbc0-86a267a2b89a admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:43.212233 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256aa10d-7b44-4752-99c0-077dad611153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:43.212810 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256aa10d-7b44-4752-99c0-077dad611153 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:43.213096 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256aa10d-7b44-4752-99c0-077dad611153 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:43.213376 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256aa10d-7b44-4752-99c0-077dad611153 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:43.214048 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256aa10d-7b44-4752-99c0-077dad611153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:43.239706 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256aa10d-7b44-4752-99c0-077dad611153 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:43.249923 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1310/2617] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:02:43 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 21:02:43.254028 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f0251-cc01-43e5-b966-f592a5867a41 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:43.264349 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f0251-cc01-43e5-b966-f592a5867a41 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:43.268575 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdcb540-5378-4d8a-ae2c-f66f1fa07b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:43.269403 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcb540-5378-4d8a-ae2c-f66f1fa07b9a admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:43.269692 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcb540-5378-4d8a-ae2c-f66f1fa07b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:43.269973 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcb540-5378-4d8a-ae2c-f66f1fa07b9a admin admin] PATH_INFO: `/v3/projects/395cd476196741028ac1d066488a9a0c/users/f1ee5742e8374731aa9ad8d37e6387fb/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:43.271742 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdcb540-5378-4d8a-ae2c-f66f1fa07b9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=395cd476196741028ac1d066488a9a0c, user_id=f1ee5742e8374731aa9ad8d37e6387fb, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:43.297823 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdcb540-5378-4d8a-ae2c-f66f1fa07b9a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:43.311545 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1308/2618] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:02:43 2021] PUT /identity/v3/projects/395cd476196741028ac1d066488a9a0c/users/f1ee5742e8374731aa9ad8d37e6387fb/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:02:43.322309 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e1d91-3995-4518-8c21-5be0c8dc3b8f None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:43.322804 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e1d91-3995-4518-8c21-5be0c8dc3b8f None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:43.322923 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e1d91-3995-4518-8c21-5be0c8dc3b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:43.438833 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-f59e1d91-3995-4518-8c21-5be0c8dc3b8f None None] MFA Rules not processed for user `f1ee5742e8374731aa9ad8d37e6387fb`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:02:43.439894 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-f59e1d91-3995-4518-8c21-5be0c8dc3b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:02:43.511830 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1311/2619] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:02:43 2021] POST /identity/v3/auth/tokens => generated 3737 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:02:43.521706 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdcb540-5378-4d8a-ae2c-f66f1fa07b9a admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:43.523301 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-cbdcb540-5378-4d8a-ae2c-f66f1fa07b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:02:43.584525 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdcb540-5378-4d8a-ae2c-f66f1fa07b9a admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:43.587762 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff4801-d21c-45bc-8cd6-a782dd9f7534 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:43.588326 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff4801-d21c-45bc-8cd6-a782dd9f7534 service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:43.588610 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff4801-d21c-45bc-8cd6-a782dd9f7534 service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:43.588889 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff4801-d21c-45bc-8cd6-a782dd9f7534 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:43.598305 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff4801-d21c-45bc-8cd6-a782dd9f7534 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:43.623846 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff4801-d21c-45bc-8cd6-a782dd9f7534 service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:43.632606 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1309/2620] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:02:43 2021] GET /identity/v3/auth/tokens => generated 3737 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:02:43.823090 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e1d91-3995-4518-8c21-5be0c8dc3b8f None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:43.891627 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e1d91-3995-4518-8c21-5be0c8dc3b8f None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:43.895744 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a99b5-35ee-482a-a8e2-13c530876c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:43.896535 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a99b5-35ee-482a-a8e2-13c530876c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:43.896822 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a99b5-35ee-482a-a8e2-13c530876c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:43.897105 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a99b5-35ee-482a-a8e2-13c530876c06 admin admin] PATH_INFO: `/v3/users/7d1eec6dd752459a9c7bea677e668a39` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:43.898174 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a99b5-35ee-482a-a8e2-13c530876c06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d1eec6dd752459a9c7bea677e668a39)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:43.926342 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a99b5-35ee-482a-a8e2-13c530876c06 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:43.974513 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-d99a99b5-35ee-482a-a8e2-13c530876c06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d1eec6dd752459a9c7bea677e668a39'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:43.985742 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-d99a99b5-35ee-482a-a8e2-13c530876c06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d1eec6dd752459a9c7bea677e668a39'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:43.986362 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-d99a99b5-35ee-482a-a8e2-13c530876c06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d1eec6dd752459a9c7bea677e668a39'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:43.993709 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-d99a99b5-35ee-482a-a8e2-13c530876c06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d1eec6dd752459a9c7bea677e668a39'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:44.000765 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-d99a99b5-35ee-482a-a8e2-13c530876c06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d1eec6dd752459a9c7bea677e668a39'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:44.006587 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1312/2621] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 21:02:43 2021] DELETE /identity/v3/users/7d1eec6dd752459a9c7bea677e668a39 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:02:44.011085 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e8fd2-3fbe-4a7d-9737-2b124059b396 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:44.011544 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e8fd2-3fbe-4a7d-9737-2b124059b396 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:44.011658 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e8fd2-3fbe-4a7d-9737-2b124059b396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:44.033953 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-958e8fd2-3fbe-4a7d-9737-2b124059b396 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:02:44.035124 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-958e8fd2-3fbe-4a7d-9737-2b124059b396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:02:44.097465 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1310/2622] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:02:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 21:02:44.107532 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a99b5-35ee-482a-a8e2-13c530876c06 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:44.108820 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-d99a99b5-35ee-482a-a8e2-13c530876c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:02:44.169912 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a99b5-35ee-482a-a8e2-13c530876c06 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:44.173200 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b59b35-4c33-4553-b737-45257dffd13d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:44.173756 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b59b35-4c33-4553-b737-45257dffd13d service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:44.174043 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b59b35-4c33-4553-b737-45257dffd13d service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:44.174319 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b59b35-4c33-4553-b737-45257dffd13d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:44.182815 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b59b35-4c33-4553-b737-45257dffd13d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:44.208812 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b59b35-4c33-4553-b737-45257dffd13d service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:44.217791 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1313/2623] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:02:44 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 21:02:44.628469 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e8fd2-3fbe-4a7d-9737-2b124059b396 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:44.629886 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-958e8fd2-3fbe-4a7d-9737-2b124059b396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:02:44.640854 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e8fd2-3fbe-4a7d-9737-2b124059b396 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:44.645182 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453747a-cf85-48e1-be48-4243606b9523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:44.646019 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453747a-cf85-48e1-be48-4243606b9523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:44.646242 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453747a-cf85-48e1-be48-4243606b9523 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:44.646525 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453747a-cf85-48e1-be48-4243606b9523 admin admin] PATH_INFO: `/v3/projects/ce5c5263b7694fa09cd1f6d7d2218d8d` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:44.647642 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453747a-cf85-48e1-be48-4243606b9523 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce5c5263b7694fa09cd1f6d7d2218d8d)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:44.674114 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453747a-cf85-48e1-be48-4243606b9523 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:44.722936 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-b453747a-cf85-48e1-be48-4243606b9523 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce5c5263b7694fa09cd1f6d7d2218d8d', 'request_id': 'req-b453747a-cf85-48e1-be48-4243606b9523'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:44.729103 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-b453747a-cf85-48e1-be48-4243606b9523 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce5c5263b7694fa09cd1f6d7d2218d8d', 'request_id': 'req-b453747a-cf85-48e1-be48-4243606b9523'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:44.734844 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-b453747a-cf85-48e1-be48-4243606b9523 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce5c5263b7694fa09cd1f6d7d2218d8d', 'request_id': 'req-b453747a-cf85-48e1-be48-4243606b9523'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:44.751211 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-b453747a-cf85-48e1-be48-4243606b9523 admin admin] The token cache is being invalidate because project ce5c5263b7694fa09cd1f6d7d2218d8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 21:02:44.751493 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-b453747a-cf85-48e1-be48-4243606b9523 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:44.752076 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-b453747a-cf85-48e1-be48-4243606b9523 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:44.753439 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1311/2624] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 21:02:44 2021] DELETE /identity/v3/projects/ce5c5263b7694fa09cd1f6d7d2218d8d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 21:02:44.757357 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b59b35-4c33-4553-b737-45257dffd13d service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:44.766691 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b59b35-4c33-4553-b737-45257dffd13d service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:44.830347 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545170f-ef00-4201-bbba-a5bb508a0e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:44.831261 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545170f-ef00-4201-bbba-a5bb508a0e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:44.831623 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545170f-ef00-4201-bbba-a5bb508a0e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:44.832189 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545170f-ef00-4201-bbba-a5bb508a0e9e admin admin] PATH_INFO: `/v3/users/f1ee5742e8374731aa9ad8d37e6387fb` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:44.833387 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545170f-ef00-4201-bbba-a5bb508a0e9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1ee5742e8374731aa9ad8d37e6387fb)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:44.860449 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545170f-ef00-4201-bbba-a5bb508a0e9e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:44.911656 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-a545170f-ef00-4201-bbba-a5bb508a0e9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1ee5742e8374731aa9ad8d37e6387fb'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:44.924678 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-a545170f-ef00-4201-bbba-a5bb508a0e9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1ee5742e8374731aa9ad8d37e6387fb'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:44.925416 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-a545170f-ef00-4201-bbba-a5bb508a0e9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1ee5742e8374731aa9ad8d37e6387fb'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:44.933170 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-a545170f-ef00-4201-bbba-a5bb508a0e9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1ee5742e8374731aa9ad8d37e6387fb'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:44.940754 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-a545170f-ef00-4201-bbba-a5bb508a0e9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1ee5742e8374731aa9ad8d37e6387fb'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:44.946837 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1314/2625] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 21:02:44 2021] DELETE /identity/v3/users/f1ee5742e8374731aa9ad8d37e6387fb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:02:45.292625 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453747a-cf85-48e1-be48-4243606b9523 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:45.294004 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-b453747a-cf85-48e1-be48-4243606b9523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:02:45.305802 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453747a-cf85-48e1-be48-4243606b9523 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:45.369101 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73e05f-1052-48f2-99be-3736fe5ebe70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:45.369909 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73e05f-1052-48f2-99be-3736fe5ebe70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:45.370192 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73e05f-1052-48f2-99be-3736fe5ebe70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:45.370471 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73e05f-1052-48f2-99be-3736fe5ebe70 admin admin] PATH_INFO: `/v3/projects/395cd476196741028ac1d066488a9a0c` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:45.371567 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73e05f-1052-48f2-99be-3736fe5ebe70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=395cd476196741028ac1d066488a9a0c)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:45.397429 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73e05f-1052-48f2-99be-3736fe5ebe70 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:45.445179 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-cf73e05f-1052-48f2-99be-3736fe5ebe70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '395cd476196741028ac1d066488a9a0c', 'request_id': 'req-cf73e05f-1052-48f2-99be-3736fe5ebe70'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:45.452141 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-cf73e05f-1052-48f2-99be-3736fe5ebe70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '395cd476196741028ac1d066488a9a0c', 'request_id': 'req-cf73e05f-1052-48f2-99be-3736fe5ebe70'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:45.457257 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-cf73e05f-1052-48f2-99be-3736fe5ebe70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '395cd476196741028ac1d066488a9a0c', 'request_id': 'req-cf73e05f-1052-48f2-99be-3736fe5ebe70'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:45.473476 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-cf73e05f-1052-48f2-99be-3736fe5ebe70 admin admin] The token cache is being invalidate because project 395cd476196741028ac1d066488a9a0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 21:02:45.473757 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-cf73e05f-1052-48f2-99be-3736fe5ebe70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:45.474349 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-cf73e05f-1052-48f2-99be-3736fe5ebe70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:02:45.475746 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1312/2626] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 21:02:45 2021] DELETE /identity/v3/projects/395cd476196741028ac1d066488a9a0c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:02:45.483064 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a769a-4c9f-47a6-9b6f-ebe3e36e379b None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:45.483362 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a769a-4c9f-47a6-9b6f-ebe3e36e379b None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:45.483651 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a769a-4c9f-47a6-9b6f-ebe3e36e379b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:45.505724 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-255a769a-4c9f-47a6-9b6f-ebe3e36e379b None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:02:45.506922 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-255a769a-4c9f-47a6-9b6f-ebe3e36e379b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:02:45.572910 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1315/2627] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:02:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:02:45.581463 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781544f-3f58-41d5-9109-bc4ec0c1871e None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:45.581797 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781544f-3f58-41d5-9109-bc4ec0c1871e None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:45.582120 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781544f-3f58-41d5-9109-bc4ec0c1871e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:45.604481 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-b781544f-3f58-41d5-9109-bc4ec0c1871e None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:02:45.605613 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-b781544f-3f58-41d5-9109-bc4ec0c1871e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:02:45.612714 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1313/2628] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:02:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:02:45.616742 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a769a-4c9f-47a6-9b6f-ebe3e36e379b None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:45.626904 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a769a-4c9f-47a6-9b6f-ebe3e36e379b None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:45.630916 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49e36a-fdfe-4ea3-9f83-35f92d4d8110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:45.631490 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49e36a-fdfe-4ea3-9f83-35f92d4d8110 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:45.631774 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49e36a-fdfe-4ea3-9f83-35f92d4d8110 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:45.632051 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49e36a-fdfe-4ea3-9f83-35f92d4d8110 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:45.632726 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49e36a-fdfe-4ea3-9f83-35f92d4d8110 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 21:02:45.633021 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49e36a-fdfe-4ea3-9f83-35f92d4d8110 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:45.659506 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49e36a-fdfe-4ea3-9f83-35f92d4d8110 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:45.671954 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1316/2629] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 21:02:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 21:02:45.676320 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781544f-3f58-41d5-9109-bc4ec0c1871e None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:45.685509 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781544f-3f58-41d5-9109-bc4ec0c1871e None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:45.689599 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d704a14-f4d6-428e-ac09-6e8202439aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:45.690169 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d704a14-f4d6-428e-ac09-6e8202439aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:45.690452 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d704a14-f4d6-428e-ac09-6e8202439aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:45.690764 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d704a14-f4d6-428e-ac09-6e8202439aa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:45.691395 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d704a14-f4d6-428e-ac09-6e8202439aa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:45.718195 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d704a14-f4d6-428e-ac09-6e8202439aa4 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:45.744023 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1314/2630] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 21:02:45 2021] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 21:02:45.748815 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49e36a-fdfe-4ea3-9f83-35f92d4d8110 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:45.758029 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49e36a-fdfe-4ea3-9f83-35f92d4d8110 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:45.818581 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06b887-4ff0-48aa-86f7-a53af6e6c558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:45.819228 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06b887-4ff0-48aa-86f7-a53af6e6c558 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:45.819515 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06b887-4ff0-48aa-86f7-a53af6e6c558 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:45.820073 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06b887-4ff0-48aa-86f7-a53af6e6c558 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:45.820708 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06b887-4ff0-48aa-86f7-a53af6e6c558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:45.846929 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06b887-4ff0-48aa-86f7-a53af6e6c558 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:45.866072 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1317/2631] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 21:02:45 2021] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 21:02:45.870285 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d704a14-f4d6-428e-ac09-6e8202439aa4 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:45.881481 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d704a14-f4d6-428e-ac09-6e8202439aa4 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:45.885557 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871bf1d-c182-4289-8ee6-2ef68827d044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:45.886142 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871bf1d-c182-4289-8ee6-2ef68827d044 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:45.886426 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871bf1d-c182-4289-8ee6-2ef68827d044 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:45.886721 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871bf1d-c182-4289-8ee6-2ef68827d044 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:45.887412 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871bf1d-c182-4289-8ee6-2ef68827d044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:45.913186 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871bf1d-c182-4289-8ee6-2ef68827d044 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:45.924114 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1315/2632] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:02:45 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 21:02:45.928290 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06b887-4ff0-48aa-86f7-a53af6e6c558 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:45.938551 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06b887-4ff0-48aa-86f7-a53af6e6c558 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:45.942745 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89a5fb-8fb9-4960-ad7d-6009e34f844f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:45.943544 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89a5fb-8fb9-4960-ad7d-6009e34f844f admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:45.943828 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89a5fb-8fb9-4960-ad7d-6009e34f844f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:45.944102 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89a5fb-8fb9-4960-ad7d-6009e34f844f admin admin] PATH_INFO: `/v3/projects/ed3f6e5e342f40bca948e9eee0d0e2bf/users/364f8276e41d445abf0d89aaf6c55cab/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:45.965034 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89a5fb-8fb9-4960-ad7d-6009e34f844f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3f6e5e342f40bca948e9eee0d0e2bf, user_id=364f8276e41d445abf0d89aaf6c55cab, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:45.991897 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89a5fb-8fb9-4960-ad7d-6009e34f844f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:46.005019 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1318/2633] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:02:45 2021] PUT /identity/v3/projects/ed3f6e5e342f40bca948e9eee0d0e2bf/users/364f8276e41d445abf0d89aaf6c55cab/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:02:46.017619 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467ac5e-fadd-4d27-b890-c39521757ad7 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:46.017919 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467ac5e-fadd-4d27-b890-c39521757ad7 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:46.018204 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467ac5e-fadd-4d27-b890-c39521757ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:46.055176 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-c467ac5e-fadd-4d27-b890-c39521757ad7 None None] MFA Rules not processed for user `364f8276e41d445abf0d89aaf6c55cab`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:02:46.056329 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-c467ac5e-fadd-4d27-b890-c39521757ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:02:46.128155 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1316/2634] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:02:46 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:02:46.133050 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89a5fb-8fb9-4960-ad7d-6009e34f844f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:46.199133 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89a5fb-8fb9-4960-ad7d-6009e34f844f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:46.204051 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930ab2d-ba2f-40fc-bf26-0cd0784bfb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:46.204623 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930ab2d-ba2f-40fc-bf26-0cd0784bfb87 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:46.204920 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930ab2d-ba2f-40fc-bf26-0cd0784bfb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:46.205184 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930ab2d-ba2f-40fc-bf26-0cd0784bfb87 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:46.205810 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930ab2d-ba2f-40fc-bf26-0cd0784bfb87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:46.232469 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930ab2d-ba2f-40fc-bf26-0cd0784bfb87 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:46.257399 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1319/2635] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 21:02:46 2021] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 21:02:46.261515 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467ac5e-fadd-4d27-b890-c39521757ad7 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:46.272855 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467ac5e-fadd-4d27-b890-c39521757ad7 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:46.334323 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18eb7ba-5be1-4dd1-af5f-676501ca6e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:46.334952 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18eb7ba-5be1-4dd1-af5f-676501ca6e2a admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:46.335236 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18eb7ba-5be1-4dd1-af5f-676501ca6e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:46.335517 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18eb7ba-5be1-4dd1-af5f-676501ca6e2a admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:46.336152 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18eb7ba-5be1-4dd1-af5f-676501ca6e2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:46.362011 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18eb7ba-5be1-4dd1-af5f-676501ca6e2a admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:46.380974 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1317/2636] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 21:02:46 2021] POST /identity/v3/users => generated 295 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 21:02:46.384974 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930ab2d-ba2f-40fc-bf26-0cd0784bfb87 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:46.395171 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930ab2d-ba2f-40fc-bf26-0cd0784bfb87 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:46.399327 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81f919-7b81-4796-b9af-9e74b474bdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:46.399902 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81f919-7b81-4796-b9af-9e74b474bdec admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:46.400187 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81f919-7b81-4796-b9af-9e74b474bdec admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:46.400466 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81f919-7b81-4796-b9af-9e74b474bdec admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:46.401139 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81f919-7b81-4796-b9af-9e74b474bdec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:46.426326 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81f919-7b81-4796-b9af-9e74b474bdec admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:46.437820 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1320/2637] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:02:46 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 21:02:46.441788 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18eb7ba-5be1-4dd1-af5f-676501ca6e2a admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:46.452400 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18eb7ba-5be1-4dd1-af5f-676501ca6e2a admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:46.456564 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0840f64-9b8e-41ca-8266-4be0ed53ae7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:46.457359 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0840f64-9b8e-41ca-8266-4be0ed53ae7b admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:46.457647 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0840f64-9b8e-41ca-8266-4be0ed53ae7b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:46.457928 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0840f64-9b8e-41ca-8266-4be0ed53ae7b admin admin] PATH_INFO: `/v3/projects/ab5eec3daef54832855455be9083fe66/users/0edf664501da4e13894746d3529dbdce/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:46.477189 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0840f64-9b8e-41ca-8266-4be0ed53ae7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab5eec3daef54832855455be9083fe66, user_id=0edf664501da4e13894746d3529dbdce, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:46.505208 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0840f64-9b8e-41ca-8266-4be0ed53ae7b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:46.519133 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1318/2638] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:02:46 2021] PUT /identity/v3/projects/ab5eec3daef54832855455be9083fe66/users/0edf664501da4e13894746d3529dbdce/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:02:46.523021 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81f919-7b81-4796-b9af-9e74b474bdec admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:46.532731 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81f919-7b81-4796-b9af-9e74b474bdec admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:46.593380 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ffb5d-5dc3-429a-9ae7-dac0ecbb0c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:46.593969 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ffb5d-5dc3-429a-9ae7-dac0ecbb0c72 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:46.594253 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ffb5d-5dc3-429a-9ae7-dac0ecbb0c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:46.594544 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ffb5d-5dc3-429a-9ae7-dac0ecbb0c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:46.595247 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ffb5d-5dc3-429a-9ae7-dac0ecbb0c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:46.620250 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ffb5d-5dc3-429a-9ae7-dac0ecbb0c72 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:46.630390 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1321/2639] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:02:46 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 21:02:46.634528 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0840f64-9b8e-41ca-8266-4be0ed53ae7b admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:46.645077 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0840f64-9b8e-41ca-8266-4be0ed53ae7b admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:46.649174 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef31522-a411-49cb-8883-b5162d05929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:46.650000 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef31522-a411-49cb-8883-b5162d05929e admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:46.650285 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef31522-a411-49cb-8883-b5162d05929e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:46.650564 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef31522-a411-49cb-8883-b5162d05929e admin admin] PATH_INFO: `/v3/projects/ab5eec3daef54832855455be9083fe66/users/0edf664501da4e13894746d3529dbdce/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:46.652327 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef31522-a411-49cb-8883-b5162d05929e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab5eec3daef54832855455be9083fe66, user_id=0edf664501da4e13894746d3529dbdce, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:46.679458 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef31522-a411-49cb-8883-b5162d05929e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:46.689928 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1319/2640] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:02:46 2021] PUT /identity/v3/projects/ab5eec3daef54832855455be9083fe66/users/0edf664501da4e13894746d3529dbdce/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 21:02:46.693654 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ffb5d-5dc3-429a-9ae7-dac0ecbb0c72 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:46.703222 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ffb5d-5dc3-429a-9ae7-dac0ecbb0c72 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:46.764985 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39240bf-b7ee-4ce7-8b88-7219a7fbf117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:46.765650 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39240bf-b7ee-4ce7-8b88-7219a7fbf117 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:46.765832 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39240bf-b7ee-4ce7-8b88-7219a7fbf117 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:46.766108 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39240bf-b7ee-4ce7-8b88-7219a7fbf117 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:46.766806 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39240bf-b7ee-4ce7-8b88-7219a7fbf117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:46.791766 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39240bf-b7ee-4ce7-8b88-7219a7fbf117 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:46.802242 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1322/2641] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:02:46 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 21:02:46.806397 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef31522-a411-49cb-8883-b5162d05929e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:46.816910 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef31522-a411-49cb-8883-b5162d05929e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:46.821334 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965da8e0-5a1d-4127-9194-9e82e3ca0c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:46.822136 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965da8e0-5a1d-4127-9194-9e82e3ca0c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:46.822428 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965da8e0-5a1d-4127-9194-9e82e3ca0c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:46.822742 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965da8e0-5a1d-4127-9194-9e82e3ca0c6b admin admin] PATH_INFO: `/v3/projects/ab5eec3daef54832855455be9083fe66/users/0edf664501da4e13894746d3529dbdce/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:46.824505 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965da8e0-5a1d-4127-9194-9e82e3ca0c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab5eec3daef54832855455be9083fe66, user_id=0edf664501da4e13894746d3529dbdce, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:46.850949 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965da8e0-5a1d-4127-9194-9e82e3ca0c6b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:46.866088 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1320/2642] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:02:46 2021] PUT /identity/v3/projects/ab5eec3daef54832855455be9083fe66/users/0edf664501da4e13894746d3529dbdce/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:02:46.876765 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec98120-77d3-4e2e-bbc2-5051db80df7f None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:46.877059 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec98120-77d3-4e2e-bbc2-5051db80df7f None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:46.877339 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec98120-77d3-4e2e-bbc2-5051db80df7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:46.912697 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-1ec98120-77d3-4e2e-bbc2-5051db80df7f None None] MFA Rules not processed for user `0edf664501da4e13894746d3529dbdce`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:02:46.913806 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-1ec98120-77d3-4e2e-bbc2-5051db80df7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:02:46.988553 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1323/2643] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:02:46 2021] POST /identity/v3/auth/tokens => generated 3751 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 21:02:46.998567 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965da8e0-5a1d-4127-9194-9e82e3ca0c6b admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:46.999885 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-965da8e0-5a1d-4127-9194-9e82e3ca0c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:02:47.063107 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965da8e0-5a1d-4127-9194-9e82e3ca0c6b admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:47.066374 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b72b2-d445-4abb-84bd-162c84b27b19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:47.066974 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b72b2-d445-4abb-84bd-162c84b27b19 service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:47.067258 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b72b2-d445-4abb-84bd-162c84b27b19 service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:47.067536 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b72b2-d445-4abb-84bd-162c84b27b19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:47.129815 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b72b2-d445-4abb-84bd-162c84b27b19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:47.155804 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b72b2-d445-4abb-84bd-162c84b27b19 service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:47.165156 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1321/2644] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:02:46 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:02:54.139728 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec98120-77d3-4e2e-bbc2-5051db80df7f None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:02:54.148936 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec98120-77d3-4e2e-bbc2-5051db80df7f None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:02:54.152184 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3b8f3-b699-43f0-bc0a-a64e6ebdbf85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:02:54.152745 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3b8f3-b699-43f0-bc0a-a64e6ebdbf85 service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:02:54.153033 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3b8f3-b699-43f0-bc0a-a64e6ebdbf85 service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:02:54.153312 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3b8f3-b699-43f0-bc0a-a64e6ebdbf85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:02:54.162769 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3b8f3-b699-43f0-bc0a-a64e6ebdbf85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:02:54.188588 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3b8f3-b699-43f0-bc0a-a64e6ebdbf85 service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:02:54.198379 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1324/2645] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:02:54 2021] GET /identity/v3/auth/tokens => generated 3751 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:03:21.689056 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b72b2-d445-4abb-84bd-162c84b27b19 service cinder] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:21.690387 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-a91b72b2-d445-4abb-84bd-162c84b27b19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:21.753341 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b72b2-d445-4abb-84bd-162c84b27b19 service cinder] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:21.756636 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a14381-533f-4460-b995-3b391c28798d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:21.757207 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a14381-533f-4460-b995-3b391c28798d service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:21.757494 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a14381-533f-4460-b995-3b391c28798d service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:21.757778 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a14381-533f-4460-b995-3b391c28798d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:21.759443 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-f3a14381-533f-4460-b995-3b391c28798d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:21.769001 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a14381-533f-4460-b995-3b391c28798d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:21.794451 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a14381-533f-4460-b995-3b391c28798d service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:21.802635 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1322/2646] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:03:21 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:03:24.702121 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3b8f3-b699-43f0-bc0a-a64e6ebdbf85 service cinder] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:24.775554 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3b8f3-b699-43f0-bc0a-a64e6ebdbf85 service cinder] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:24.780292 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baaea7-24f7-46dc-8d6b-e8f3036ab4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:24.781074 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baaea7-24f7-46dc-8d6b-e8f3036ab4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:24.781381 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baaea7-24f7-46dc-8d6b-e8f3036ab4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:24.781644 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baaea7-24f7-46dc-8d6b-e8f3036ab4e6 admin admin] PATH_INFO: `/v3/users/364f8276e41d445abf0d89aaf6c55cab` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:24.782736 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baaea7-24f7-46dc-8d6b-e8f3036ab4e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=364f8276e41d445abf0d89aaf6c55cab)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:24.808488 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baaea7-24f7-46dc-8d6b-e8f3036ab4e6 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:24.857125 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-98baaea7-24f7-46dc-8d6b-e8f3036ab4e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '364f8276e41d445abf0d89aaf6c55cab'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:24.868994 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-98baaea7-24f7-46dc-8d6b-e8f3036ab4e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '364f8276e41d445abf0d89aaf6c55cab'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:24.869616 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-98baaea7-24f7-46dc-8d6b-e8f3036ab4e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '364f8276e41d445abf0d89aaf6c55cab'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:24.878646 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-98baaea7-24f7-46dc-8d6b-e8f3036ab4e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '364f8276e41d445abf0d89aaf6c55cab'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:24.885819 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-98baaea7-24f7-46dc-8d6b-e8f3036ab4e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '364f8276e41d445abf0d89aaf6c55cab'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:24.892542 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1325/2647] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 21:03:24 2021] DELETE /identity/v3/users/364f8276e41d445abf0d89aaf6c55cab => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:03:24.896934 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace75ea5-a27d-420b-881b-bfc30bb01de5 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:24.897350 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace75ea5-a27d-420b-881b-bfc30bb01de5 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:24.897503 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace75ea5-a27d-420b-881b-bfc30bb01de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:24.919680 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-ace75ea5-a27d-420b-881b-bfc30bb01de5 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:03:24.920756 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-ace75ea5-a27d-420b-881b-bfc30bb01de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:24.989690 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1323/2648] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:03:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:03:24.999827 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baaea7-24f7-46dc-8d6b-e8f3036ab4e6 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:25.001124 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-98baaea7-24f7-46dc-8d6b-e8f3036ab4e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:25.062587 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baaea7-24f7-46dc-8d6b-e8f3036ab4e6 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:25.066190 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f5ae6-e19e-46d3-866e-eaec461f3f17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:25.066846 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f5ae6-e19e-46d3-866e-eaec461f3f17 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:25.067138 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f5ae6-e19e-46d3-866e-eaec461f3f17 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:25.067448 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f5ae6-e19e-46d3-866e-eaec461f3f17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:25.077565 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f5ae6-e19e-46d3-866e-eaec461f3f17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:25.103919 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f5ae6-e19e-46d3-866e-eaec461f3f17 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:25.113474 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1326/2649] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:03:24 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:03:25.455070 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace75ea5-a27d-420b-881b-bfc30bb01de5 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:25.456405 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-ace75ea5-a27d-420b-881b-bfc30bb01de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:25.469706 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace75ea5-a27d-420b-881b-bfc30bb01de5 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:25.474212 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f837b-69cd-429a-bf31-ab10b66c0b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:25.474563 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f837b-69cd-429a-bf31-ab10b66c0b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:25.474886 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f837b-69cd-429a-bf31-ab10b66c0b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:25.475168 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f837b-69cd-429a-bf31-ab10b66c0b4f admin admin] PATH_INFO: `/v3/projects/ed3f6e5e342f40bca948e9eee0d0e2bf` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:25.476241 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f837b-69cd-429a-bf31-ab10b66c0b4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed3f6e5e342f40bca948e9eee0d0e2bf)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:25.502406 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f837b-69cd-429a-bf31-ab10b66c0b4f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:25.551001 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-7d8f837b-69cd-429a-bf31-ab10b66c0b4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed3f6e5e342f40bca948e9eee0d0e2bf', 'request_id': 'req-7d8f837b-69cd-429a-bf31-ab10b66c0b4f'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:25.559270 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-7d8f837b-69cd-429a-bf31-ab10b66c0b4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed3f6e5e342f40bca948e9eee0d0e2bf', 'request_id': 'req-7d8f837b-69cd-429a-bf31-ab10b66c0b4f'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:25.564523 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-7d8f837b-69cd-429a-bf31-ab10b66c0b4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed3f6e5e342f40bca948e9eee0d0e2bf', 'request_id': 'req-7d8f837b-69cd-429a-bf31-ab10b66c0b4f'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:25.579861 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-7d8f837b-69cd-429a-bf31-ab10b66c0b4f admin admin] The token cache is being invalidate because project ed3f6e5e342f40bca948e9eee0d0e2bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 21:03:25.580139 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-7d8f837b-69cd-429a-bf31-ab10b66c0b4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:25.580716 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-7d8f837b-69cd-429a-bf31-ab10b66c0b4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:25.582088 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1324/2650] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 21:03:25 2021] DELETE /identity/v3/projects/ed3f6e5e342f40bca948e9eee0d0e2bf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:03:25.585985 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f5ae6-e19e-46d3-866e-eaec461f3f17 service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:25.595471 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f5ae6-e19e-46d3-866e-eaec461f3f17 service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:25.659324 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c1361-5daf-4849-914f-17f85489d11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:25.660110 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c1361-5daf-4849-914f-17f85489d11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:25.660395 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c1361-5daf-4849-914f-17f85489d11b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:25.660675 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c1361-5daf-4849-914f-17f85489d11b admin admin] PATH_INFO: `/v3/users/0edf664501da4e13894746d3529dbdce` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:25.661729 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c1361-5daf-4849-914f-17f85489d11b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0edf664501da4e13894746d3529dbdce)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:25.687425 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c1361-5daf-4849-914f-17f85489d11b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:25.736572 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c69c1361-5daf-4849-914f-17f85489d11b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0edf664501da4e13894746d3529dbdce'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:25.748202 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c69c1361-5daf-4849-914f-17f85489d11b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0edf664501da4e13894746d3529dbdce'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:25.748816 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c69c1361-5daf-4849-914f-17f85489d11b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0edf664501da4e13894746d3529dbdce'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:25.756276 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c69c1361-5daf-4849-914f-17f85489d11b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0edf664501da4e13894746d3529dbdce'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:25.763426 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c69c1361-5daf-4849-914f-17f85489d11b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0edf664501da4e13894746d3529dbdce'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:25.769080 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1327/2651] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 21:03:25 2021] DELETE /identity/v3/users/0edf664501da4e13894746d3529dbdce => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:03:26.196636 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f837b-69cd-429a-bf31-ab10b66c0b4f admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:26.198209 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-7d8f837b-69cd-429a-bf31-ab10b66c0b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:26.212178 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f837b-69cd-429a-bf31-ab10b66c0b4f admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:26.275766 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625df6f-c461-47d1-969e-85b4d9fc9ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:26.276472 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625df6f-c461-47d1-969e-85b4d9fc9ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:26.276759 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625df6f-c461-47d1-969e-85b4d9fc9ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:26.277046 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625df6f-c461-47d1-969e-85b4d9fc9ee8 admin admin] PATH_INFO: `/v3/projects/ab5eec3daef54832855455be9083fe66` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:26.278134 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625df6f-c461-47d1-969e-85b4d9fc9ee8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab5eec3daef54832855455be9083fe66)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:26.303559 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625df6f-c461-47d1-969e-85b4d9fc9ee8 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:26.353956 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6625df6f-c461-47d1-969e-85b4d9fc9ee8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab5eec3daef54832855455be9083fe66', 'request_id': 'req-6625df6f-c461-47d1-969e-85b4d9fc9ee8'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:26.360629 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6625df6f-c461-47d1-969e-85b4d9fc9ee8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab5eec3daef54832855455be9083fe66', 'request_id': 'req-6625df6f-c461-47d1-969e-85b4d9fc9ee8'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:26.365763 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6625df6f-c461-47d1-969e-85b4d9fc9ee8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab5eec3daef54832855455be9083fe66', 'request_id': 'req-6625df6f-c461-47d1-969e-85b4d9fc9ee8'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:26.388922 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6625df6f-c461-47d1-969e-85b4d9fc9ee8 admin admin] The token cache is being invalidate because project ab5eec3daef54832855455be9083fe66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 21:03:26.389207 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6625df6f-c461-47d1-969e-85b4d9fc9ee8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:26.389811 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6625df6f-c461-47d1-969e-85b4d9fc9ee8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:26.391221 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1325/2652] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 21:03:26 2021] DELETE /identity/v3/projects/ab5eec3daef54832855455be9083fe66 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 21:03:26.397278 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6cfa7-df29-4dd4-b0e4-8c89a328189e None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:26.397588 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6cfa7-df29-4dd4-b0e4-8c89a328189e None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:26.397870 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6cfa7-df29-4dd4-b0e4-8c89a328189e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:26.419561 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-9cb6cfa7-df29-4dd4-b0e4-8c89a328189e None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:03:26.420781 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-9cb6cfa7-df29-4dd4-b0e4-8c89a328189e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:26.483220 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1328/2653] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:03:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 21:03:26.491637 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1d6a8-c2d6-4bb3-9a81-00359cab611b None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:26.491929 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1d6a8-c2d6-4bb3-9a81-00359cab611b None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:26.492206 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1d6a8-c2d6-4bb3-9a81-00359cab611b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:26.514228 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-f1c1d6a8-c2d6-4bb3-9a81-00359cab611b None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:03:26.515390 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-f1c1d6a8-c2d6-4bb3-9a81-00359cab611b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:26.522091 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1326/2654] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:03:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:03:26.526167 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6cfa7-df29-4dd4-b0e4-8c89a328189e None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:26.535161 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6cfa7-df29-4dd4-b0e4-8c89a328189e None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:26.539217 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60126df7-e2f4-4500-9567-6656d7a9f72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:26.539790 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60126df7-e2f4-4500-9567-6656d7a9f72f admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:26.540074 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60126df7-e2f4-4500-9567-6656d7a9f72f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:26.540351 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60126df7-e2f4-4500-9567-6656d7a9f72f admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:26.541026 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60126df7-e2f4-4500-9567-6656d7a9f72f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 21:03:26.541322 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60126df7-e2f4-4500-9567-6656d7a9f72f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:26.567527 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60126df7-e2f4-4500-9567-6656d7a9f72f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:26.580321 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1329/2655] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 21:03:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 21:03:26.584511 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1d6a8-c2d6-4bb3-9a81-00359cab611b None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:26.593140 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1d6a8-c2d6-4bb3-9a81-00359cab611b None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:26.597224 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5268758-3ebe-41e1-bcbb-5ee3f6c7e462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:26.597791 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5268758-3ebe-41e1-bcbb-5ee3f6c7e462 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:26.598075 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5268758-3ebe-41e1-bcbb-5ee3f6c7e462 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:26.598353 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5268758-3ebe-41e1-bcbb-5ee3f6c7e462 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:26.599168 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5268758-3ebe-41e1-bcbb-5ee3f6c7e462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:26.625578 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5268758-3ebe-41e1-bcbb-5ee3f6c7e462 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:26.651110 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1327/2656] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 21:03:26 2021] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 21:03:26.655100 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60126df7-e2f4-4500-9567-6656d7a9f72f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:26.664599 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60126df7-e2f4-4500-9567-6656d7a9f72f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:26.726112 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2f85d-a3f1-467b-9b88-649fbe21ac36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:26.726734 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2f85d-a3f1-467b-9b88-649fbe21ac36 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:26.727028 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2f85d-a3f1-467b-9b88-649fbe21ac36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:26.727307 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2f85d-a3f1-467b-9b88-649fbe21ac36 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:26.727937 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2f85d-a3f1-467b-9b88-649fbe21ac36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:26.754400 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2f85d-a3f1-467b-9b88-649fbe21ac36 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:26.772965 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1330/2657] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 21:03:26 2021] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 21:03:26.777209 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5268758-3ebe-41e1-bcbb-5ee3f6c7e462 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:26.787890 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5268758-3ebe-41e1-bcbb-5ee3f6c7e462 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:26.792042 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9abcf3-2f15-4d0c-893c-78fe0ad622f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:26.792627 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9abcf3-2f15-4d0c-893c-78fe0ad622f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:26.792916 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9abcf3-2f15-4d0c-893c-78fe0ad622f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:26.793198 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9abcf3-2f15-4d0c-893c-78fe0ad622f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:26.794736 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9abcf3-2f15-4d0c-893c-78fe0ad622f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:26.819652 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9abcf3-2f15-4d0c-893c-78fe0ad622f7 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:26.830288 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1328/2658] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:03:26 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 21:03:26.834352 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2f85d-a3f1-467b-9b88-649fbe21ac36 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:26.844280 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2f85d-a3f1-467b-9b88-649fbe21ac36 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:26.848610 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376584bf-e7ba-432c-8f07-cf659b98185e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:26.849609 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376584bf-e7ba-432c-8f07-cf659b98185e admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:26.849905 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376584bf-e7ba-432c-8f07-cf659b98185e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:26.850191 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376584bf-e7ba-432c-8f07-cf659b98185e admin admin] PATH_INFO: `/v3/projects/add57e84120c4b63998e51e63ae99151/users/64c32408b3d449948cad7c155ed8f5ab/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:26.870682 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376584bf-e7ba-432c-8f07-cf659b98185e admin admin] RBAC: Authorizing `identity:create_grant(project_id=add57e84120c4b63998e51e63ae99151, user_id=64c32408b3d449948cad7c155ed8f5ab, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:26.897456 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376584bf-e7ba-432c-8f07-cf659b98185e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:26.911033 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1331/2659] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:03:26 2021] PUT /identity/v3/projects/add57e84120c4b63998e51e63ae99151/users/64c32408b3d449948cad7c155ed8f5ab/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:03:26.921842 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e6e1a-2d96-46c7-b549-1fd75fead172 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:26.922139 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e6e1a-2d96-46c7-b549-1fd75fead172 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:26.922446 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e6e1a-2d96-46c7-b549-1fd75fead172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:26.964061 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-b13e6e1a-2d96-46c7-b549-1fd75fead172 None None] MFA Rules not processed for user `64c32408b3d449948cad7c155ed8f5ab`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:03:26.965238 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-b13e6e1a-2d96-46c7-b549-1fd75fead172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:27.035384 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1329/2660] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:03:26 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:03:27.039724 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376584bf-e7ba-432c-8f07-cf659b98185e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:27.107373 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376584bf-e7ba-432c-8f07-cf659b98185e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:27.111759 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d50a5-5154-4a6f-905b-d5f84e2f72b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:27.112363 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d50a5-5154-4a6f-905b-d5f84e2f72b3 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:27.112648 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d50a5-5154-4a6f-905b-d5f84e2f72b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:27.112925 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d50a5-5154-4a6f-905b-d5f84e2f72b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:27.113551 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d50a5-5154-4a6f-905b-d5f84e2f72b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:27.139351 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d50a5-5154-4a6f-905b-d5f84e2f72b3 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:27.164569 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1332/2661] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 21:03:27 2021] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 21:03:27.168634 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e6e1a-2d96-46c7-b549-1fd75fead172 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:27.179350 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e6e1a-2d96-46c7-b549-1fd75fead172 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:27.240170 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17da41-497d-4bc2-b892-1a6cda34a6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:27.240828 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17da41-497d-4bc2-b892-1a6cda34a6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:27.241036 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17da41-497d-4bc2-b892-1a6cda34a6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:27.241316 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17da41-497d-4bc2-b892-1a6cda34a6f1 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:27.241947 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17da41-497d-4bc2-b892-1a6cda34a6f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:27.268101 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17da41-497d-4bc2-b892-1a6cda34a6f1 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:27.289322 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1330/2662] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 21:03:27 2021] POST /identity/v3/users => generated 300 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 21:03:27.290782 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d50a5-5154-4a6f-905b-d5f84e2f72b3 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:27.301258 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d50a5-5154-4a6f-905b-d5f84e2f72b3 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:27.305400 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb9049-2eaf-496a-b691-9b6beea7af09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:27.305982 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb9049-2eaf-496a-b691-9b6beea7af09 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:27.306273 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb9049-2eaf-496a-b691-9b6beea7af09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:27.306556 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb9049-2eaf-496a-b691-9b6beea7af09 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:27.307278 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb9049-2eaf-496a-b691-9b6beea7af09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:27.333208 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb9049-2eaf-496a-b691-9b6beea7af09 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:27.344381 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1333/2663] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:03:27 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 21:03:27.348469 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17da41-497d-4bc2-b892-1a6cda34a6f1 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:27.358630 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17da41-497d-4bc2-b892-1a6cda34a6f1 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:27.362853 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f390d90-4af9-42cc-8993-5492975e2819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:27.363678 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f390d90-4af9-42cc-8993-5492975e2819 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:27.363958 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f390d90-4af9-42cc-8993-5492975e2819 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:27.364231 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f390d90-4af9-42cc-8993-5492975e2819 admin admin] PATH_INFO: `/v3/projects/54778de0bde346a9b4616a1ba5d34aa0/users/ce3da08bea3c45fc92e4a476c432369e/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:27.383896 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f390d90-4af9-42cc-8993-5492975e2819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54778de0bde346a9b4616a1ba5d34aa0, user_id=ce3da08bea3c45fc92e4a476c432369e, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:27.412190 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f390d90-4af9-42cc-8993-5492975e2819 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:27.424405 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1331/2664] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:03:27 2021] PUT /identity/v3/projects/54778de0bde346a9b4616a1ba5d34aa0/users/ce3da08bea3c45fc92e4a476c432369e/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:03:27.428235 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb9049-2eaf-496a-b691-9b6beea7af09 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:27.437495 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb9049-2eaf-496a-b691-9b6beea7af09 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:27.501822 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc3cdb-c962-4be2-b703-8389cadef0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:27.502407 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc3cdb-c962-4be2-b703-8389cadef0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:27.502718 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc3cdb-c962-4be2-b703-8389cadef0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:27.503002 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc3cdb-c962-4be2-b703-8389cadef0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:27.503679 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc3cdb-c962-4be2-b703-8389cadef0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:27.529450 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc3cdb-c962-4be2-b703-8389cadef0a1 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:27.539159 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1334/2665] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:03:27 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 21:03:27.543305 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f390d90-4af9-42cc-8993-5492975e2819 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:27.552841 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f390d90-4af9-42cc-8993-5492975e2819 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:27.557070 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2dce1-269b-4fcd-8487-867c151e686d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:27.557882 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2dce1-269b-4fcd-8487-867c151e686d admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:27.558163 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2dce1-269b-4fcd-8487-867c151e686d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:27.558444 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2dce1-269b-4fcd-8487-867c151e686d admin admin] PATH_INFO: `/v3/projects/54778de0bde346a9b4616a1ba5d34aa0/users/ce3da08bea3c45fc92e4a476c432369e/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:27.561150 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2dce1-269b-4fcd-8487-867c151e686d admin admin] RBAC: Authorizing `identity:create_grant(project_id=54778de0bde346a9b4616a1ba5d34aa0, user_id=ce3da08bea3c45fc92e4a476c432369e, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:27.588588 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2dce1-269b-4fcd-8487-867c151e686d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:27.598299 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1332/2666] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:03:27 2021] PUT /identity/v3/projects/54778de0bde346a9b4616a1ba5d34aa0/users/ce3da08bea3c45fc92e4a476c432369e/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:03:27.602164 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc3cdb-c962-4be2-b703-8389cadef0a1 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:27.611494 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc3cdb-c962-4be2-b703-8389cadef0a1 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:27.672159 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172680f-2d5d-45af-8315-32fe194eb53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:27.672742 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172680f-2d5d-45af-8315-32fe194eb53c admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:27.673033 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172680f-2d5d-45af-8315-32fe194eb53c admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:27.673313 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172680f-2d5d-45af-8315-32fe194eb53c admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:27.673994 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172680f-2d5d-45af-8315-32fe194eb53c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:27.700783 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172680f-2d5d-45af-8315-32fe194eb53c admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:27.710513 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1335/2667] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:03:27 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 21:03:27.714603 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2dce1-269b-4fcd-8487-867c151e686d admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:27.724188 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2dce1-269b-4fcd-8487-867c151e686d admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:27.728306 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7ac2c-a8bc-4920-bef6-a50534aec3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:27.729096 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7ac2c-a8bc-4920-bef6-a50534aec3d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:27.729377 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7ac2c-a8bc-4920-bef6-a50534aec3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:27.729680 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7ac2c-a8bc-4920-bef6-a50534aec3d2 admin admin] PATH_INFO: `/v3/projects/54778de0bde346a9b4616a1ba5d34aa0/users/ce3da08bea3c45fc92e4a476c432369e/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:27.731662 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7ac2c-a8bc-4920-bef6-a50534aec3d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54778de0bde346a9b4616a1ba5d34aa0, user_id=ce3da08bea3c45fc92e4a476c432369e, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:27.758507 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7ac2c-a8bc-4920-bef6-a50534aec3d2 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:27.773327 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1333/2668] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:03:27 2021] PUT /identity/v3/projects/54778de0bde346a9b4616a1ba5d34aa0/users/ce3da08bea3c45fc92e4a476c432369e/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 21:03:27.783331 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8df80a-6807-4e9c-a636-1af66c84720b None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:27.783821 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8df80a-6807-4e9c-a636-1af66c84720b None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:27.783928 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8df80a-6807-4e9c-a636-1af66c84720b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:27.819222 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-cf8df80a-6807-4e9c-a636-1af66c84720b None None] MFA Rules not processed for user `ce3da08bea3c45fc92e4a476c432369e`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:03:27.820295 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-cf8df80a-6807-4e9c-a636-1af66c84720b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:27.896842 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1336/2669] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:03:27 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 21:03:27.906936 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7ac2c-a8bc-4920-bef6-a50534aec3d2 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:27.908502 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-dfc7ac2c-a8bc-4920-bef6-a50534aec3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:27.969987 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7ac2c-a8bc-4920-bef6-a50534aec3d2 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:27.973294 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa341c-3051-4bdb-8954-ad2eb72bed38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:27.973888 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa341c-3051-4bdb-8954-ad2eb72bed38 service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:27.974171 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa341c-3051-4bdb-8954-ad2eb72bed38 service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:27.974448 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa341c-3051-4bdb-8954-ad2eb72bed38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:27.983894 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa341c-3051-4bdb-8954-ad2eb72bed38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:28.010046 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa341c-3051-4bdb-8954-ad2eb72bed38 service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:28.019007 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1334/2670] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:03:27 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:03:28.043325 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8df80a-6807-4e9c-a636-1af66c84720b None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:28.109971 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8df80a-6807-4e9c-a636-1af66c84720b None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:28.113993 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17180d7-20b5-47e4-90c9-19955073b922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:28.114810 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17180d7-20b5-47e4-90c9-19955073b922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:28.115097 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17180d7-20b5-47e4-90c9-19955073b922 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:28.115376 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17180d7-20b5-47e4-90c9-19955073b922 admin admin] PATH_INFO: `/v3/users/64c32408b3d449948cad7c155ed8f5ab` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:28.116446 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17180d7-20b5-47e4-90c9-19955073b922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64c32408b3d449948cad7c155ed8f5ab)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:28.142387 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17180d7-20b5-47e4-90c9-19955073b922 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:28.190193 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c17180d7-20b5-47e4-90c9-19955073b922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64c32408b3d449948cad7c155ed8f5ab'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:28.202171 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c17180d7-20b5-47e4-90c9-19955073b922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64c32408b3d449948cad7c155ed8f5ab'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:28.202827 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c17180d7-20b5-47e4-90c9-19955073b922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64c32408b3d449948cad7c155ed8f5ab'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:28.210190 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c17180d7-20b5-47e4-90c9-19955073b922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64c32408b3d449948cad7c155ed8f5ab'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:28.216952 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-c17180d7-20b5-47e4-90c9-19955073b922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64c32408b3d449948cad7c155ed8f5ab'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:28.222684 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1337/2671] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 21:03:28 2021] DELETE /identity/v3/users/64c32408b3d449948cad7c155ed8f5ab => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:03:28.227184 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7802bd-a554-4e17-88f6-ac43d571171e None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:28.227478 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7802bd-a554-4e17-88f6-ac43d571171e None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:28.227760 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7802bd-a554-4e17-88f6-ac43d571171e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:28.250090 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-5a7802bd-a554-4e17-88f6-ac43d571171e None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:03:28.251369 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-5a7802bd-a554-4e17-88f6-ac43d571171e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:28.329938 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1335/2672] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:03:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:03:28.340084 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17180d7-20b5-47e4-90c9-19955073b922 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:28.342022 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c17180d7-20b5-47e4-90c9-19955073b922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:28.407779 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17180d7-20b5-47e4-90c9-19955073b922 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:28.411037 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c2507-dd0c-4618-8820-337f076390ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:28.411611 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c2507-dd0c-4618-8820-337f076390ed service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:28.411899 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c2507-dd0c-4618-8820-337f076390ed service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:28.412181 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c2507-dd0c-4618-8820-337f076390ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:28.421785 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c2507-dd0c-4618-8820-337f076390ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:28.447769 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c2507-dd0c-4618-8820-337f076390ed service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:28.458086 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1338/2673] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:03:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:03:28.804934 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7802bd-a554-4e17-88f6-ac43d571171e None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:28.806276 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-5a7802bd-a554-4e17-88f6-ac43d571171e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:28.819134 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7802bd-a554-4e17-88f6-ac43d571171e None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:28.823602 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25439f63-0a9d-4d33-8144-a38569b517ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:28.824386 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25439f63-0a9d-4d33-8144-a38569b517ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:28.824675 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25439f63-0a9d-4d33-8144-a38569b517ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:28.824958 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25439f63-0a9d-4d33-8144-a38569b517ea admin admin] PATH_INFO: `/v3/projects/add57e84120c4b63998e51e63ae99151` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:28.826514 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25439f63-0a9d-4d33-8144-a38569b517ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=add57e84120c4b63998e51e63ae99151)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:28.852606 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25439f63-0a9d-4d33-8144-a38569b517ea admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:28.906441 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-25439f63-0a9d-4d33-8144-a38569b517ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'add57e84120c4b63998e51e63ae99151', 'request_id': 'req-25439f63-0a9d-4d33-8144-a38569b517ea'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:28.913038 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-25439f63-0a9d-4d33-8144-a38569b517ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'add57e84120c4b63998e51e63ae99151', 'request_id': 'req-25439f63-0a9d-4d33-8144-a38569b517ea'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:28.917899 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-25439f63-0a9d-4d33-8144-a38569b517ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'add57e84120c4b63998e51e63ae99151', 'request_id': 'req-25439f63-0a9d-4d33-8144-a38569b517ea'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:28.935080 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-25439f63-0a9d-4d33-8144-a38569b517ea admin admin] The token cache is being invalidate because project add57e84120c4b63998e51e63ae99151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 21:03:28.935425 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-25439f63-0a9d-4d33-8144-a38569b517ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:28.936051 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-25439f63-0a9d-4d33-8144-a38569b517ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:28.937442 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1336/2674] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 21:03:28 2021] DELETE /identity/v3/projects/add57e84120c4b63998e51e63ae99151 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:03:28.941500 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c2507-dd0c-4618-8820-337f076390ed service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:28.951526 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c2507-dd0c-4618-8820-337f076390ed service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:29.017574 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239b67a-5329-4726-bb68-01b1d78b6753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:29.018361 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239b67a-5329-4726-bb68-01b1d78b6753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:29.018644 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239b67a-5329-4726-bb68-01b1d78b6753 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:29.018947 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239b67a-5329-4726-bb68-01b1d78b6753 admin admin] PATH_INFO: `/v3/users/ce3da08bea3c45fc92e4a476c432369e` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:29.019994 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239b67a-5329-4726-bb68-01b1d78b6753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce3da08bea3c45fc92e4a476c432369e)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:29.045377 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239b67a-5329-4726-bb68-01b1d78b6753 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:29.095307 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4239b67a-5329-4726-bb68-01b1d78b6753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce3da08bea3c45fc92e4a476c432369e'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:29.106604 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4239b67a-5329-4726-bb68-01b1d78b6753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce3da08bea3c45fc92e4a476c432369e'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:29.107405 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4239b67a-5329-4726-bb68-01b1d78b6753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce3da08bea3c45fc92e4a476c432369e'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:29.114721 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4239b67a-5329-4726-bb68-01b1d78b6753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce3da08bea3c45fc92e4a476c432369e'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:29.123655 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4239b67a-5329-4726-bb68-01b1d78b6753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce3da08bea3c45fc92e4a476c432369e'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:29.129468 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1339/2675] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 21:03:28 2021] DELETE /identity/v3/users/ce3da08bea3c45fc92e4a476c432369e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:03:29.469255 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25439f63-0a9d-4d33-8144-a38569b517ea admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:29.470702 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-25439f63-0a9d-4d33-8144-a38569b517ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:29.482987 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25439f63-0a9d-4d33-8144-a38569b517ea admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:29.544483 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351c99b-c4f4-4869-9ec3-d5ecd10316a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:29.545265 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351c99b-c4f4-4869-9ec3-d5ecd10316a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:29.545556 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351c99b-c4f4-4869-9ec3-d5ecd10316a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:29.545836 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351c99b-c4f4-4869-9ec3-d5ecd10316a1 admin admin] PATH_INFO: `/v3/projects/54778de0bde346a9b4616a1ba5d34aa0` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:29.546950 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351c99b-c4f4-4869-9ec3-d5ecd10316a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54778de0bde346a9b4616a1ba5d34aa0)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:29.573190 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351c99b-c4f4-4869-9ec3-d5ecd10316a1 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:29.620742 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-5351c99b-c4f4-4869-9ec3-d5ecd10316a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54778de0bde346a9b4616a1ba5d34aa0', 'request_id': 'req-5351c99b-c4f4-4869-9ec3-d5ecd10316a1'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:29.628217 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-5351c99b-c4f4-4869-9ec3-d5ecd10316a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54778de0bde346a9b4616a1ba5d34aa0', 'request_id': 'req-5351c99b-c4f4-4869-9ec3-d5ecd10316a1'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:29.633073 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-5351c99b-c4f4-4869-9ec3-d5ecd10316a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54778de0bde346a9b4616a1ba5d34aa0', 'request_id': 'req-5351c99b-c4f4-4869-9ec3-d5ecd10316a1'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:29.648672 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-5351c99b-c4f4-4869-9ec3-d5ecd10316a1 admin admin] The token cache is being invalidate because project 54778de0bde346a9b4616a1ba5d34aa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 21:03:29.648955 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-5351c99b-c4f4-4869-9ec3-d5ecd10316a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:29.649543 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-5351c99b-c4f4-4869-9ec3-d5ecd10316a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:29.650948 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1337/2676] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 21:03:29 2021] DELETE /identity/v3/projects/54778de0bde346a9b4616a1ba5d34aa0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:03:29.658246 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d5b10-ef4c-4341-8626-68ead01ece64 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:29.658537 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d5b10-ef4c-4341-8626-68ead01ece64 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:29.658848 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d5b10-ef4c-4341-8626-68ead01ece64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:29.680747 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-bc6d5b10-ef4c-4341-8626-68ead01ece64 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:03:29.681874 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-bc6d5b10-ef4c-4341-8626-68ead01ece64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:29.744657 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1340/2677] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:03:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:03:29.753914 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c403ba-f05f-4874-8d31-61622db5a6f8 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:29.754203 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c403ba-f05f-4874-8d31-61622db5a6f8 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:29.754484 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c403ba-f05f-4874-8d31-61622db5a6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:29.778912 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-c7c403ba-f05f-4874-8d31-61622db5a6f8 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:03:29.780085 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-c7c403ba-f05f-4874-8d31-61622db5a6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:29.787094 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1338/2678] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:03:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:03:29.791196 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d5b10-ef4c-4341-8626-68ead01ece64 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:29.801007 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d5b10-ef4c-4341-8626-68ead01ece64 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:29.805095 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271503c8-600e-476e-ae2c-37362dbe9449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:29.805669 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271503c8-600e-476e-ae2c-37362dbe9449 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:29.805957 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271503c8-600e-476e-ae2c-37362dbe9449 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:29.806237 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271503c8-600e-476e-ae2c-37362dbe9449 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:29.806981 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271503c8-600e-476e-ae2c-37362dbe9449 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 21:03:29.807280 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271503c8-600e-476e-ae2c-37362dbe9449 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:29.832730 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271503c8-600e-476e-ae2c-37362dbe9449 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:29.846096 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1341/2679] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 21:03:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 21:03:29.850340 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c403ba-f05f-4874-8d31-61622db5a6f8 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:29.859856 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c403ba-f05f-4874-8d31-61622db5a6f8 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:29.864242 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf87d8e-cbc3-48b5-937f-1dfbd159b739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:29.864949 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf87d8e-cbc3-48b5-937f-1dfbd159b739 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:29.865304 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf87d8e-cbc3-48b5-937f-1dfbd159b739 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:29.865652 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf87d8e-cbc3-48b5-937f-1dfbd159b739 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:29.866391 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf87d8e-cbc3-48b5-937f-1dfbd159b739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:29.893145 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf87d8e-cbc3-48b5-937f-1dfbd159b739 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:29.920355 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1339/2680] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 21:03:29 2021] POST /identity/v3/projects => generated 375 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 21:03:29.924597 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271503c8-600e-476e-ae2c-37362dbe9449 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:29.933908 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271503c8-600e-476e-ae2c-37362dbe9449 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:29.994546 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427eef89-f19c-491b-b46a-61b4a31b6323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:29.995287 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427eef89-f19c-491b-b46a-61b4a31b6323 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:29.995465 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427eef89-f19c-491b-b46a-61b4a31b6323 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:29.995743 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427eef89-f19c-491b-b46a-61b4a31b6323 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:29.996375 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427eef89-f19c-491b-b46a-61b4a31b6323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:30.022265 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427eef89-f19c-491b-b46a-61b4a31b6323 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:30.041901 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1342/2681] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 21:03:29 2021] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 21:03:30.046605 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf87d8e-cbc3-48b5-937f-1dfbd159b739 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:30.056081 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf87d8e-cbc3-48b5-937f-1dfbd159b739 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:30.060432 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180efa0-e0c7-4362-9670-5429b5996c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:30.061017 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180efa0-e0c7-4362-9670-5429b5996c83 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:30.061299 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180efa0-e0c7-4362-9670-5429b5996c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:30.061575 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180efa0-e0c7-4362-9670-5429b5996c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:30.062260 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180efa0-e0c7-4362-9670-5429b5996c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:30.089544 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180efa0-e0c7-4362-9670-5429b5996c83 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:30.100758 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1340/2682] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:03:30 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 21:03:30.104784 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427eef89-f19c-491b-b46a-61b4a31b6323 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:30.114996 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427eef89-f19c-491b-b46a-61b4a31b6323 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:30.119186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e205dd5-8071-436d-b3ca-41f26ccd691f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:30.120050 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e205dd5-8071-436d-b3ca-41f26ccd691f admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:30.120403 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e205dd5-8071-436d-b3ca-41f26ccd691f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:30.120747 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e205dd5-8071-436d-b3ca-41f26ccd691f admin admin] PATH_INFO: `/v3/projects/dcd6a968b05047268767d2ebcf4394b1/users/acf892fb84e349db97762ed9fc795363/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:30.140910 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e205dd5-8071-436d-b3ca-41f26ccd691f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd6a968b05047268767d2ebcf4394b1, user_id=acf892fb84e349db97762ed9fc795363, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:30.167633 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e205dd5-8071-436d-b3ca-41f26ccd691f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:30.182578 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1343/2683] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:03:30 2021] PUT /identity/v3/projects/dcd6a968b05047268767d2ebcf4394b1/users/acf892fb84e349db97762ed9fc795363/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:03:30.193446 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df269e4-bb01-47d5-87e3-61fa9cfce257 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:30.193746 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df269e4-bb01-47d5-87e3-61fa9cfce257 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:30.194030 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df269e4-bb01-47d5-87e3-61fa9cfce257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:30.231897 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-3df269e4-bb01-47d5-87e3-61fa9cfce257 None None] MFA Rules not processed for user `acf892fb84e349db97762ed9fc795363`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:03:30.233266 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-3df269e4-bb01-47d5-87e3-61fa9cfce257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:30.306965 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1341/2684] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:03:30 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 21:03:30.312120 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e205dd5-8071-436d-b3ca-41f26ccd691f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:30.378475 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e205dd5-8071-436d-b3ca-41f26ccd691f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:30.382632 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a142083-3924-4eb8-9a52-65bc5a81458a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:30.383236 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a142083-3924-4eb8-9a52-65bc5a81458a admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:30.383518 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a142083-3924-4eb8-9a52-65bc5a81458a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:30.383791 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a142083-3924-4eb8-9a52-65bc5a81458a admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:30.384418 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a142083-3924-4eb8-9a52-65bc5a81458a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:30.409964 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a142083-3924-4eb8-9a52-65bc5a81458a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:30.435627 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1344/2685] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 21:03:30 2021] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 21:03:30.439797 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df269e4-bb01-47d5-87e3-61fa9cfce257 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:30.450387 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df269e4-bb01-47d5-87e3-61fa9cfce257 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:30.511593 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea268e-a63d-4bb4-96f4-07b17525914d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:30.512222 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea268e-a63d-4bb4-96f4-07b17525914d admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:30.512592 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea268e-a63d-4bb4-96f4-07b17525914d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:30.512879 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea268e-a63d-4bb4-96f4-07b17525914d admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:30.513506 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea268e-a63d-4bb4-96f4-07b17525914d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:30.539555 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea268e-a63d-4bb4-96f4-07b17525914d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:30.558804 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1342/2686] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 21:03:30 2021] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 21:03:30.567865 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a142083-3924-4eb8-9a52-65bc5a81458a admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:30.578448 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a142083-3924-4eb8-9a52-65bc5a81458a admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:30.582641 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa816fe-19f4-47fe-84c1-3febef3d376a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:30.583250 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa816fe-19f4-47fe-84c1-3febef3d376a admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:30.583544 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa816fe-19f4-47fe-84c1-3febef3d376a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:30.583828 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa816fe-19f4-47fe-84c1-3febef3d376a admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:30.584517 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa816fe-19f4-47fe-84c1-3febef3d376a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:30.610420 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa816fe-19f4-47fe-84c1-3febef3d376a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:30.623154 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1345/2687] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:03:30 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 21:03:30.627419 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea268e-a63d-4bb4-96f4-07b17525914d admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:30.636761 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea268e-a63d-4bb4-96f4-07b17525914d admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:30.641518 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc906200-3c0d-4f8b-b605-6e77163e54ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:30.642323 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc906200-3c0d-4f8b-b605-6e77163e54ee admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:30.642610 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc906200-3c0d-4f8b-b605-6e77163e54ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:30.642924 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc906200-3c0d-4f8b-b605-6e77163e54ee admin admin] PATH_INFO: `/v3/projects/06a5aec2adc848c98c1cd0c4aa0e6e3a/users/73d8c4a6846743b182b81476941b432e/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:30.661966 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc906200-3c0d-4f8b-b605-6e77163e54ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a5aec2adc848c98c1cd0c4aa0e6e3a, user_id=73d8c4a6846743b182b81476941b432e, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:30.689095 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc906200-3c0d-4f8b-b605-6e77163e54ee admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:30.702639 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1343/2688] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:03:30 2021] PUT /identity/v3/projects/06a5aec2adc848c98c1cd0c4aa0e6e3a/users/73d8c4a6846743b182b81476941b432e/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 21:03:30.706671 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa816fe-19f4-47fe-84c1-3febef3d376a admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:30.716167 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa816fe-19f4-47fe-84c1-3febef3d376a admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:30.777403 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83b1e4-7054-4c6c-97b6-c95cf24d381e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:30.778032 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83b1e4-7054-4c6c-97b6-c95cf24d381e admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:30.778404 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83b1e4-7054-4c6c-97b6-c95cf24d381e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:30.778910 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83b1e4-7054-4c6c-97b6-c95cf24d381e admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:30.779595 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83b1e4-7054-4c6c-97b6-c95cf24d381e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:30.804705 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83b1e4-7054-4c6c-97b6-c95cf24d381e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:30.815164 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1346/2689] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:03:30 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 21:03:30.819240 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc906200-3c0d-4f8b-b605-6e77163e54ee admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:30.829972 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc906200-3c0d-4f8b-b605-6e77163e54ee admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:30.834281 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634ef42-b537-425f-9526-0fcc6092fcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:30.835117 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634ef42-b537-425f-9526-0fcc6092fcf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:30.835407 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634ef42-b537-425f-9526-0fcc6092fcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:30.835688 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634ef42-b537-425f-9526-0fcc6092fcf8 admin admin] PATH_INFO: `/v3/projects/06a5aec2adc848c98c1cd0c4aa0e6e3a/users/73d8c4a6846743b182b81476941b432e/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:30.837429 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634ef42-b537-425f-9526-0fcc6092fcf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a5aec2adc848c98c1cd0c4aa0e6e3a, user_id=73d8c4a6846743b182b81476941b432e, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:30.863563 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634ef42-b537-425f-9526-0fcc6092fcf8 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:30.874823 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1344/2690] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:03:30 2021] PUT /identity/v3/projects/06a5aec2adc848c98c1cd0c4aa0e6e3a/users/73d8c4a6846743b182b81476941b432e/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:03:30.878813 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83b1e4-7054-4c6c-97b6-c95cf24d381e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:30.889260 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83b1e4-7054-4c6c-97b6-c95cf24d381e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:30.950911 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac6211-56d8-40f3-a616-0b6fb59afbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:30.951498 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac6211-56d8-40f3-a616-0b6fb59afbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:30.951918 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac6211-56d8-40f3-a616-0b6fb59afbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:30.952210 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac6211-56d8-40f3-a616-0b6fb59afbe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:30.952902 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac6211-56d8-40f3-a616-0b6fb59afbe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:30.985403 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac6211-56d8-40f3-a616-0b6fb59afbe6 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:30.995790 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1347/2691] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:03:30 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 21:03:31.000675 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634ef42-b537-425f-9526-0fcc6092fcf8 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:31.010376 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634ef42-b537-425f-9526-0fcc6092fcf8 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:31.014855 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b92246-d94e-4b88-a423-57a01751cac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:31.015673 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b92246-d94e-4b88-a423-57a01751cac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:31.015946 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b92246-d94e-4b88-a423-57a01751cac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:31.016227 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b92246-d94e-4b88-a423-57a01751cac6 admin admin] PATH_INFO: `/v3/projects/06a5aec2adc848c98c1cd0c4aa0e6e3a/users/73d8c4a6846743b182b81476941b432e/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:31.017982 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b92246-d94e-4b88-a423-57a01751cac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a5aec2adc848c98c1cd0c4aa0e6e3a, user_id=73d8c4a6846743b182b81476941b432e, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:31.044979 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b92246-d94e-4b88-a423-57a01751cac6 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:31.058172 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1345/2692] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:03:30 2021] PUT /identity/v3/projects/06a5aec2adc848c98c1cd0c4aa0e6e3a/users/73d8c4a6846743b182b81476941b432e/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:03:31.069216 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30019e79-d4e7-4376-83a8-de71b9dad92d None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:31.069451 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30019e79-d4e7-4376-83a8-de71b9dad92d None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:31.069737 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30019e79-d4e7-4376-83a8-de71b9dad92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:31.104682 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-30019e79-d4e7-4376-83a8-de71b9dad92d None None] MFA Rules not processed for user `73d8c4a6846743b182b81476941b432e`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:03:31.105820 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-30019e79-d4e7-4376-83a8-de71b9dad92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:31.179997 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1348/2693] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:03:31 2021] POST /identity/v3/auth/tokens => generated 3749 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:03:31.189902 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b92246-d94e-4b88-a423-57a01751cac6 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:31.191511 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-94b92246-d94e-4b88-a423-57a01751cac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:31.253079 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b92246-d94e-4b88-a423-57a01751cac6 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:31.256394 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d9fa2-3e15-4c24-b57f-62f7b5ef1ca9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:31.256956 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d9fa2-3e15-4c24-b57f-62f7b5ef1ca9 service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:31.257239 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d9fa2-3e15-4c24-b57f-62f7b5ef1ca9 service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:31.257515 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d9fa2-3e15-4c24-b57f-62f7b5ef1ca9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:31.320947 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d9fa2-3e15-4c24-b57f-62f7b5ef1ca9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:31.346315 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d9fa2-3e15-4c24-b57f-62f7b5ef1ca9 service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:31.354849 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1346/2694] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:03:31 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 21:03:34.281855 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30019e79-d4e7-4376-83a8-de71b9dad92d None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:34.348822 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30019e79-d4e7-4376-83a8-de71b9dad92d None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:34.352934 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42981982-b798-4171-b858-d0782bdfa6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:34.353721 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42981982-b798-4171-b858-d0782bdfa6c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:34.354008 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42981982-b798-4171-b858-d0782bdfa6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:34.354285 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42981982-b798-4171-b858-d0782bdfa6c9 admin admin] PATH_INFO: `/v3/users/acf892fb84e349db97762ed9fc795363` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:34.355372 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42981982-b798-4171-b858-d0782bdfa6c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acf892fb84e349db97762ed9fc795363)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:34.381955 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42981982-b798-4171-b858-d0782bdfa6c9 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:34.429059 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-42981982-b798-4171-b858-d0782bdfa6c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acf892fb84e349db97762ed9fc795363'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:34.440415 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-42981982-b798-4171-b858-d0782bdfa6c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acf892fb84e349db97762ed9fc795363'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:34.441047 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-42981982-b798-4171-b858-d0782bdfa6c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acf892fb84e349db97762ed9fc795363'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:34.448909 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-42981982-b798-4171-b858-d0782bdfa6c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acf892fb84e349db97762ed9fc795363'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:34.455296 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-42981982-b798-4171-b858-d0782bdfa6c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acf892fb84e349db97762ed9fc795363'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:34.460904 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1349/2695] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 21:03:34 2021] DELETE /identity/v3/users/acf892fb84e349db97762ed9fc795363 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:03:34.466233 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333358a8-6e85-4b53-8f4c-c0f975a1708f None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:34.466962 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333358a8-6e85-4b53-8f4c-c0f975a1708f None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:34.467252 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333358a8-6e85-4b53-8f4c-c0f975a1708f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:34.490232 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-333358a8-6e85-4b53-8f4c-c0f975a1708f None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:03:34.491332 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-333358a8-6e85-4b53-8f4c-c0f975a1708f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:34.555681 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1347/2696] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:03:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:03:34.565731 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42981982-b798-4171-b858-d0782bdfa6c9 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:34.567248 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-42981982-b798-4171-b858-d0782bdfa6c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:34.632547 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42981982-b798-4171-b858-d0782bdfa6c9 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:34.635968 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e37e6a-b921-42ed-b9f7-ce5bb3e40059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:34.636536 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e37e6a-b921-42ed-b9f7-ce5bb3e40059 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:34.636823 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e37e6a-b921-42ed-b9f7-ce5bb3e40059 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:34.637132 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e37e6a-b921-42ed-b9f7-ce5bb3e40059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:34.646374 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e37e6a-b921-42ed-b9f7-ce5bb3e40059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:34.672460 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e37e6a-b921-42ed-b9f7-ce5bb3e40059 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:34.681443 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1350/2697] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:03:34 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:03:35.026439 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333358a8-6e85-4b53-8f4c-c0f975a1708f None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:35.027845 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-333358a8-6e85-4b53-8f4c-c0f975a1708f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:35.038824 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333358a8-6e85-4b53-8f4c-c0f975a1708f None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:35.043036 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c7d4e-9406-4225-881e-216afbb55281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:35.043849 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c7d4e-9406-4225-881e-216afbb55281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:35.044133 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c7d4e-9406-4225-881e-216afbb55281 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:35.044405 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c7d4e-9406-4225-881e-216afbb55281 admin admin] PATH_INFO: `/v3/projects/dcd6a968b05047268767d2ebcf4394b1` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:35.045477 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c7d4e-9406-4225-881e-216afbb55281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcd6a968b05047268767d2ebcf4394b1)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:35.071687 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c7d4e-9406-4225-881e-216afbb55281 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:35.119468 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-054c7d4e-9406-4225-881e-216afbb55281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcd6a968b05047268767d2ebcf4394b1', 'request_id': 'req-054c7d4e-9406-4225-881e-216afbb55281'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:35.126637 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-054c7d4e-9406-4225-881e-216afbb55281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcd6a968b05047268767d2ebcf4394b1', 'request_id': 'req-054c7d4e-9406-4225-881e-216afbb55281'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:35.131516 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-054c7d4e-9406-4225-881e-216afbb55281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcd6a968b05047268767d2ebcf4394b1', 'request_id': 'req-054c7d4e-9406-4225-881e-216afbb55281'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:35.147164 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-054c7d4e-9406-4225-881e-216afbb55281 admin admin] The token cache is being invalidate because project dcd6a968b05047268767d2ebcf4394b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 21:03:35.147447 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-054c7d4e-9406-4225-881e-216afbb55281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:35.148034 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-054c7d4e-9406-4225-881e-216afbb55281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:35.149399 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1348/2698] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 21:03:35 2021] DELETE /identity/v3/projects/dcd6a968b05047268767d2ebcf4394b1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:03:35.153859 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e37e6a-b921-42ed-b9f7-ce5bb3e40059 service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:35.162960 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e37e6a-b921-42ed-b9f7-ce5bb3e40059 service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:35.224152 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a9083-f7b6-4eec-a4d6-888ec7c66f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:35.224933 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a9083-f7b6-4eec-a4d6-888ec7c66f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:35.225217 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a9083-f7b6-4eec-a4d6-888ec7c66f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:35.225492 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a9083-f7b6-4eec-a4d6-888ec7c66f01 admin admin] PATH_INFO: `/v3/users/73d8c4a6846743b182b81476941b432e` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:35.226545 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a9083-f7b6-4eec-a4d6-888ec7c66f01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73d8c4a6846743b182b81476941b432e)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:35.252312 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a9083-f7b6-4eec-a4d6-888ec7c66f01 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:35.298508 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ed3a9083-f7b6-4eec-a4d6-888ec7c66f01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73d8c4a6846743b182b81476941b432e'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:35.310150 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ed3a9083-f7b6-4eec-a4d6-888ec7c66f01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73d8c4a6846743b182b81476941b432e'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:35.310793 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ed3a9083-f7b6-4eec-a4d6-888ec7c66f01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73d8c4a6846743b182b81476941b432e'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:35.318035 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ed3a9083-f7b6-4eec-a4d6-888ec7c66f01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73d8c4a6846743b182b81476941b432e'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:35.324207 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ed3a9083-f7b6-4eec-a4d6-888ec7c66f01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73d8c4a6846743b182b81476941b432e'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:35.330625 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1351/2699] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 21:03:35 2021] DELETE /identity/v3/users/73d8c4a6846743b182b81476941b432e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:03:35.676763 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c7d4e-9406-4225-881e-216afbb55281 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:35.678154 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-054c7d4e-9406-4225-881e-216afbb55281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:35.690447 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c7d4e-9406-4225-881e-216afbb55281 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:35.752974 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e32721-33cd-4b3b-9f59-446b82e9c589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:35.753757 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e32721-33cd-4b3b-9f59-446b82e9c589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:35.754046 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e32721-33cd-4b3b-9f59-446b82e9c589 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:35.754325 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e32721-33cd-4b3b-9f59-446b82e9c589 admin admin] PATH_INFO: `/v3/projects/06a5aec2adc848c98c1cd0c4aa0e6e3a` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:35.755421 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e32721-33cd-4b3b-9f59-446b82e9c589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06a5aec2adc848c98c1cd0c4aa0e6e3a)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:35.781389 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e32721-33cd-4b3b-9f59-446b82e9c589 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:35.828373 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-e4e32721-33cd-4b3b-9f59-446b82e9c589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06a5aec2adc848c98c1cd0c4aa0e6e3a', 'request_id': 'req-e4e32721-33cd-4b3b-9f59-446b82e9c589'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:35.835275 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-e4e32721-33cd-4b3b-9f59-446b82e9c589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06a5aec2adc848c98c1cd0c4aa0e6e3a', 'request_id': 'req-e4e32721-33cd-4b3b-9f59-446b82e9c589'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:35.840272 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-e4e32721-33cd-4b3b-9f59-446b82e9c589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06a5aec2adc848c98c1cd0c4aa0e6e3a', 'request_id': 'req-e4e32721-33cd-4b3b-9f59-446b82e9c589'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:35.856868 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-e4e32721-33cd-4b3b-9f59-446b82e9c589 admin admin] The token cache is being invalidate because project 06a5aec2adc848c98c1cd0c4aa0e6e3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 21:03:35.857145 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-e4e32721-33cd-4b3b-9f59-446b82e9c589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:35.857729 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-e4e32721-33cd-4b3b-9f59-446b82e9c589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:03:35.859493 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1349/2700] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 21:03:35 2021] DELETE /identity/v3/projects/06a5aec2adc848c98c1cd0c4aa0e6e3a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:03:35.866183 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772be19-ee50-46f1-8f19-3ca9030a5d12 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:35.866549 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772be19-ee50-46f1-8f19-3ca9030a5d12 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:35.866928 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772be19-ee50-46f1-8f19-3ca9030a5d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:35.889343 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-f772be19-ee50-46f1-8f19-3ca9030a5d12 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:03:35.891018 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-f772be19-ee50-46f1-8f19-3ca9030a5d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:35.954487 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1352/2701] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:03:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:03:35.962065 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a32452-30a2-4550-8ff4-a3d039d3d76d None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:35.962355 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a32452-30a2-4550-8ff4-a3d039d3d76d None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:35.962638 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a32452-30a2-4550-8ff4-a3d039d3d76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:35.985483 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-02a32452-30a2-4550-8ff4-a3d039d3d76d None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:03:35.986632 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-02a32452-30a2-4550-8ff4-a3d039d3d76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:35.993487 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1350/2702] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:03:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:03:35.997602 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772be19-ee50-46f1-8f19-3ca9030a5d12 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:36.006815 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772be19-ee50-46f1-8f19-3ca9030a5d12 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:36.011060 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6c719-c149-490d-a3c2-342b422081d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:36.011638 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6c719-c149-490d-a3c2-342b422081d2 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:36.011924 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6c719-c149-490d-a3c2-342b422081d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:36.012294 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6c719-c149-490d-a3c2-342b422081d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:36.013258 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6c719-c149-490d-a3c2-342b422081d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 21:03:36.013553 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6c719-c149-490d-a3c2-342b422081d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:36.039538 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6c719-c149-490d-a3c2-342b422081d2 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:36.052438 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1353/2703] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 21:03:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 21:03:36.056668 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a32452-30a2-4550-8ff4-a3d039d3d76d None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:36.065147 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a32452-30a2-4550-8ff4-a3d039d3d76d None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:36.069282 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c58a7a-ae9a-4119-9063-7f0cc7478074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:36.069849 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c58a7a-ae9a-4119-9063-7f0cc7478074 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:36.070134 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c58a7a-ae9a-4119-9063-7f0cc7478074 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:36.070413 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c58a7a-ae9a-4119-9063-7f0cc7478074 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:36.071323 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c58a7a-ae9a-4119-9063-7f0cc7478074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:36.097214 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c58a7a-ae9a-4119-9063-7f0cc7478074 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:36.124642 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1351/2704] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 21:03:36 2021] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 21:03:36.128660 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6c719-c149-490d-a3c2-342b422081d2 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:36.138545 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6c719-c149-490d-a3c2-342b422081d2 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:36.199196 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c798af-bf52-420f-9869-62cb2f50543f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:36.200355 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c798af-bf52-420f-9869-62cb2f50543f admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:36.200641 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c798af-bf52-420f-9869-62cb2f50543f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:36.200918 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c798af-bf52-420f-9869-62cb2f50543f admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:36.201546 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c798af-bf52-420f-9869-62cb2f50543f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:36.227606 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c798af-bf52-420f-9869-62cb2f50543f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:36.245806 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1354/2705] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 21:03:36 2021] POST /identity/v3/users => generated 285 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 21:03:36.250464 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c58a7a-ae9a-4119-9063-7f0cc7478074 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:36.260152 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c58a7a-ae9a-4119-9063-7f0cc7478074 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:36.265305 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecf6a3-72f4-4c1e-add5-de490c1f1044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:36.265873 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecf6a3-72f4-4c1e-add5-de490c1f1044 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:36.266163 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecf6a3-72f4-4c1e-add5-de490c1f1044 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:36.266444 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecf6a3-72f4-4c1e-add5-de490c1f1044 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:36.267159 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecf6a3-72f4-4c1e-add5-de490c1f1044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:36.293454 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecf6a3-72f4-4c1e-add5-de490c1f1044 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:36.304250 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1352/2706] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:03:36 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 21:03:36.308325 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c798af-bf52-420f-9869-62cb2f50543f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:36.318353 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c798af-bf52-420f-9869-62cb2f50543f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:36.322767 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b02758-9a4a-49e2-8427-04e5d298925a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:36.323563 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b02758-9a4a-49e2-8427-04e5d298925a admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:36.323852 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b02758-9a4a-49e2-8427-04e5d298925a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:36.324135 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b02758-9a4a-49e2-8427-04e5d298925a admin admin] PATH_INFO: `/v3/projects/ef29db310e29414296dcf5e9c682941e/users/fc8beaa67ffc45269d2bfc89f2a0d50e/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:36.343475 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b02758-9a4a-49e2-8427-04e5d298925a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef29db310e29414296dcf5e9c682941e, user_id=fc8beaa67ffc45269d2bfc89f2a0d50e, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:36.370123 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b02758-9a4a-49e2-8427-04e5d298925a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:36.383315 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1355/2707] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:03:36 2021] PUT /identity/v3/projects/ef29db310e29414296dcf5e9c682941e/users/fc8beaa67ffc45269d2bfc89f2a0d50e/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:03:36.393430 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a895309-03b7-45a7-835d-1381568a9790 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:36.393728 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a895309-03b7-45a7-835d-1381568a9790 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:36.394036 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a895309-03b7-45a7-835d-1381568a9790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:36.428789 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-9a895309-03b7-45a7-835d-1381568a9790 None None] MFA Rules not processed for user `fc8beaa67ffc45269d2bfc89f2a0d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:03:36.429922 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-9a895309-03b7-45a7-835d-1381568a9790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:36.498796 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1353/2708] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:03:36 2021] POST /identity/v3/auth/tokens => generated 3676 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:03:36.509679 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b02758-9a4a-49e2-8427-04e5d298925a admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:03:36.511327 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-97b02758-9a4a-49e2-8427-04e5d298925a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:03:36.602760 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b02758-9a4a-49e2-8427-04e5d298925a admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:03:36.606822 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15959a06-0619-48f7-9988-c003cae43fac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1976a528ee24585bcaccc83e308fec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:03:36.607409 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15959a06-0619-48f7-9988-c003cae43fac service glance] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:03:36.607694 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15959a06-0619-48f7-9988-c003cae43fac service glance] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:03:36.607973 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15959a06-0619-48f7-9988-c003cae43fac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:03:36.615979 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15959a06-0619-48f7-9988-c003cae43fac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:03:36.640842 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15959a06-0619-48f7-9988-c003cae43fac service glance] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:03:36.649169 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1356/2709] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:03:36 2021] GET /identity/v3/auth/tokens => generated 3676 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:04:09.952561 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad935c7-1d3e-4f83-a6ad-e57728921466 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:04:09.953462 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad935c7-1d3e-4f83-a6ad-e57728921466 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:04:09.953956 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad935c7-1d3e-4f83-a6ad-e57728921466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:04:09.977085 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-0ad935c7-1d3e-4f83-a6ad-e57728921466 None None] MFA Rules not processed for user `1959af22edbf47cd8afca70831d476c0`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:04:09.978236 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-0ad935c7-1d3e-4f83-a6ad-e57728921466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:04:10.042799 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1354/2710] 10.222.0.37 () {58 vars in 1014 bytes} [Wed Dec 29 21:04:09 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 21:04:10.091919 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15959a06-0619-48f7-9988-c003cae43fac service glance] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:04:10.093417 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-15959a06-0619-48f7-9988-c003cae43fac service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:04:10.172441 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15959a06-0619-48f7-9988-c003cae43fac service glance] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:04:10.177779 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4b506-74d7-4c6d-80d3-ae3cad805312 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd2861e377640c9b76d0dfb08cf088e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:04:10.178350 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4b506-74d7-4c6d-80d3-ae3cad805312 service swift] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:04:10.178635 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4b506-74d7-4c6d-80d3-ae3cad805312 service swift] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:04:10.178971 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4b506-74d7-4c6d-80d3-ae3cad805312 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:04:10.189177 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4b506-74d7-4c6d-80d3-ae3cad805312 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:04:10.215399 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4b506-74d7-4c6d-80d3-ae3cad805312 service swift] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:04:10.223869 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1357/2711] 10.222.0.37 () {60 vars in 1384 bytes} [Wed Dec 29 21:04:10 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 29 21:04:23.550881 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad935c7-1d3e-4f83-a6ad-e57728921466 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:04:23.552256 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-0ad935c7-1d3e-4f83-a6ad-e57728921466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:04:23.614374 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad935c7-1d3e-4f83-a6ad-e57728921466 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:04:23.617994 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af1f73-4422-4e07-8480-8453f8cf061b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:04:23.618568 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af1f73-4422-4e07-8480-8453f8cf061b service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:04:23.618903 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af1f73-4422-4e07-8480-8453f8cf061b service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:04:23.619177 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af1f73-4422-4e07-8480-8453f8cf061b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:04:23.620791 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-f6af1f73-4422-4e07-8480-8453f8cf061b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:04:23.714642 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af1f73-4422-4e07-8480-8453f8cf061b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:04:23.740348 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af1f73-4422-4e07-8480-8453f8cf061b service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:04:23.759520 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1355/2712] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:04:23 2021] GET /identity/v3/auth/tokens => generated 3686 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:04:25.280858 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4b506-74d7-4c6d-80d3-ae3cad805312 service swift] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:04:25.282319 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-e4d4b506-74d7-4c6d-80d3-ae3cad805312 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:04:25.365925 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4b506-74d7-4c6d-80d3-ae3cad805312 service swift] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:04:25.371133 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c2c40-ab7a-4081-9fe7-b037d9a731a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:04:25.371712 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c2c40-ab7a-4081-9fe7-b037d9a731a8 service nova] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:04:25.372003 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c2c40-ab7a-4081-9fe7-b037d9a731a8 service nova] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:04:25.372281 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c2c40-ab7a-4081-9fe7-b037d9a731a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:04:25.373927 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-e55c2c40-ab7a-4081-9fe7-b037d9a731a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:04:25.386487 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c2c40-ab7a-4081-9fe7-b037d9a731a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:04:25.415518 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c2c40-ab7a-4081-9fe7-b037d9a731a8 service nova] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:04:25.427278 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1358/2713] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:04:25 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:04:26.544309 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af1f73-4422-4e07-8480-8453f8cf061b service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:04:26.545702 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-f6af1f73-4422-4e07-8480-8453f8cf061b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:04:26.572239 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af1f73-4422-4e07-8480-8453f8cf061b service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:04:26.588981 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75859077-4519-48c1-a63d-ee5d51364163 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:04:26.589594 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75859077-4519-48c1-a63d-ee5d51364163 service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:04:26.591631 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75859077-4519-48c1-a63d-ee5d51364163 service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:04:26.591952 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75859077-4519-48c1-a63d-ee5d51364163 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:04:26.593715 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-75859077-4519-48c1-a63d-ee5d51364163 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:04:26.611689 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75859077-4519-48c1-a63d-ee5d51364163 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:04:26.650127 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75859077-4519-48c1-a63d-ee5d51364163 service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:04:26.679049 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1356/2714] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:04:26 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:04:27.737886 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f2c25-2cdd-4b64-b789-a546a7db93ee None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:04:27.738619 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f2c25-2cdd-4b64-b789-a546a7db93ee None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:04:27.738999 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f2c25-2cdd-4b64-b789-a546a7db93ee None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:04:27.741397 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1359/2715] 10.222.0.37 () {54 vars in 921 bytes} [Wed Dec 29 21:04:27 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 21:04:27.748106 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0285697-5719-4d1a-9047-1f6bb889ef06 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:04:27.748794 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0285697-5719-4d1a-9047-1f6bb889ef06 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:04:27.749092 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0285697-5719-4d1a-9047-1f6bb889ef06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:04:27.807023 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-f0285697-5719-4d1a-9047-1f6bb889ef06 None None] MFA Rules not processed for user `55d700adb7db4848a97bab6cf4105481`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:04:27.808097 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-f0285697-5719-4d1a-9047-1f6bb889ef06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:04:27.814513 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1357/2716] 10.222.0.37 () {58 vars in 1018 bytes} [Wed Dec 29 21:04:27 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:04:27.834720 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f2c25-2cdd-4b64-b789-a546a7db93ee None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:04:27.837019 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-1c4f2c25-2cdd-4b64-b789-a546a7db93ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:04:27.851490 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f2c25-2cdd-4b64-b789-a546a7db93ee None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:04:27.855956 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca80e7f-5369-4416-addd-4aa20d5a39a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:04:27.856817 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca80e7f-5369-4416-addd-4aa20d5a39a7 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:04:27.857701 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca80e7f-5369-4416-addd-4aa20d5a39a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:04:27.858351 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca80e7f-5369-4416-addd-4aa20d5a39a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:04:27.867000 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca80e7f-5369-4416-addd-4aa20d5a39a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:04:27.896613 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca80e7f-5369-4416-addd-4aa20d5a39a7 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:04:27.905511 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1360/2717] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:04:27 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:04:28.010746 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0285697-5719-4d1a-9047-1f6bb889ef06 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:04:28.012079 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-f0285697-5719-4d1a-9047-1f6bb889ef06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:04:28.049388 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca80e7f-5369-4416-addd-4aa20d5a39a7 service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:04:28.094017 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0285697-5719-4d1a-9047-1f6bb889ef06 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:04:28.099060 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a2256-25f2-4c30-ab93-99f81aab37ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25cb71bb64a3456fb2dc02095c487d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:04:28.099644 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a2256-25f2-4c30-ab93-99f81aab37ef service placement] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:04:28.099930 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a2256-25f2-4c30-ab93-99f81aab37ef service placement] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:04:28.100210 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a2256-25f2-4c30-ab93-99f81aab37ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:04:28.102167 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-732a2256-25f2-4c30-ab93-99f81aab37ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:04:28.114033 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a2256-25f2-4c30-ab93-99f81aab37ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:04:28.124943 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca80e7f-5369-4416-addd-4aa20d5a39a7 service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:04:28.129860 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5702bd-d578-4121-b896-b942be440fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:04:28.130667 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5702bd-d578-4121-b896-b942be440fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:04:28.130971 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5702bd-d578-4121-b896-b942be440fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:04:28.131243 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5702bd-d578-4121-b896-b942be440fa6 admin admin] PATH_INFO: `/v3/users/fc8beaa67ffc45269d2bfc89f2a0d50e` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:04:28.132343 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5702bd-d578-4121-b896-b942be440fa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc8beaa67ffc45269d2bfc89f2a0d50e)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:04:28.140272 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a2256-25f2-4c30-ab93-99f81aab37ef service placement] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:04:28.150258 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1358/2718] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:04:28 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:04:28.158088 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5702bd-d578-4121-b896-b942be440fa6 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:04:28.213541 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ca5702bd-d578-4121-b896-b942be440fa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc8beaa67ffc45269d2bfc89f2a0d50e'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:04:28.227426 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ca5702bd-d578-4121-b896-b942be440fa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc8beaa67ffc45269d2bfc89f2a0d50e'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:04:28.228202 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ca5702bd-d578-4121-b896-b942be440fa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc8beaa67ffc45269d2bfc89f2a0d50e'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:04:28.236461 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ca5702bd-d578-4121-b896-b942be440fa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc8beaa67ffc45269d2bfc89f2a0d50e'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:04:28.244938 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-ca5702bd-d578-4121-b896-b942be440fa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc8beaa67ffc45269d2bfc89f2a0d50e'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:04:28.251513 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1361/2719] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 21:04:28 2021] DELETE /identity/v3/users/fc8beaa67ffc45269d2bfc89f2a0d50e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 21:04:28.256038 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c41843-e3c5-4f9e-ad78-22e114a1bd19 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:04:28.256339 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c41843-e3c5-4f9e-ad78-22e114a1bd19 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:04:28.256625 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c41843-e3c5-4f9e-ad78-22e114a1bd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:04:28.263798 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5702bd-d578-4121-b896-b942be440fa6 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:04:28.265490 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-ca5702bd-d578-4121-b896-b942be440fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:04:28.285157 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-b2c41843-e3c5-4f9e-ad78-22e114a1bd19 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:04:28.287838 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-b2c41843-e3c5-4f9e-ad78-22e114a1bd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:04:28.353121 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5702bd-d578-4121-b896-b942be440fa6 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:04:28.358509 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0456dab-6a1f-446d-80a0-a6861b4f953f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25cb71bb64a3456fb2dc02095c487d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:04:28.359286 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1359/2720] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:04:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:04:28.362347 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0456dab-6a1f-446d-80a0-a6861b4f953f service placement] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:04:28.362688 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0456dab-6a1f-446d-80a0-a6861b4f953f service placement] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:04:28.362972 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0456dab-6a1f-446d-80a0-a6861b4f953f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:04:28.366464 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c0456dab-6a1f-446d-80a0-a6861b4f953f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:04:28.371172 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c41843-e3c5-4f9e-ad78-22e114a1bd19 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:04:28.375138 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-b2c41843-e3c5-4f9e-ad78-22e114a1bd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:04:28.378548 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0456dab-6a1f-446d-80a0-a6861b4f953f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:04:28.404681 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0456dab-6a1f-446d-80a0-a6861b4f953f service placement] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:04:28.416117 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1362/2721] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:04:28 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:04:28.451472 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c41843-e3c5-4f9e-ad78-22e114a1bd19 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:04:28.455671 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42592eb0-a703-4ec0-9d12-d9a664f973b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:04:28.456252 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42592eb0-a703-4ec0-9d12-d9a664f973b0 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:04:28.456539 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42592eb0-a703-4ec0-9d12-d9a664f973b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:04:28.458128 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42592eb0-a703-4ec0-9d12-d9a664f973b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:04:28.468644 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42592eb0-a703-4ec0-9d12-d9a664f973b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:04:28.497043 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42592eb0-a703-4ec0-9d12-d9a664f973b0 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:04:28.511913 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1360/2722] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:04:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:04:29.090948 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0456dab-6a1f-446d-80a0-a6861b4f953f service placement] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:04:29.095552 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c0456dab-6a1f-446d-80a0-a6861b4f953f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:04:29.115749 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0456dab-6a1f-446d-80a0-a6861b4f953f service placement] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:04:29.120283 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce53b4-6011-47f7-8341-574c8f787f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:04:29.121122 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce53b4-6011-47f7-8341-574c8f787f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:04:29.121413 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce53b4-6011-47f7-8341-574c8f787f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:04:29.121721 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce53b4-6011-47f7-8341-574c8f787f9e admin admin] PATH_INFO: `/v3/projects/ef29db310e29414296dcf5e9c682941e` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:04:29.122882 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce53b4-6011-47f7-8341-574c8f787f9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef29db310e29414296dcf5e9c682941e)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:04:29.150612 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce53b4-6011-47f7-8341-574c8f787f9e admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:04:29.210277 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4cce53b4-6011-47f7-8341-574c8f787f9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef29db310e29414296dcf5e9c682941e', 'request_id': 'req-4cce53b4-6011-47f7-8341-574c8f787f9e'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:04:29.225862 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4cce53b4-6011-47f7-8341-574c8f787f9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef29db310e29414296dcf5e9c682941e', 'request_id': 'req-4cce53b4-6011-47f7-8341-574c8f787f9e'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:04:29.237774 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4cce53b4-6011-47f7-8341-574c8f787f9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef29db310e29414296dcf5e9c682941e', 'request_id': 'req-4cce53b4-6011-47f7-8341-574c8f787f9e'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:04:29.249186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4cce53b4-6011-47f7-8341-574c8f787f9e admin admin] The token cache is being invalidate because project ef29db310e29414296dcf5e9c682941e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 21:04:29.249186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4cce53b4-6011-47f7-8341-574c8f787f9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:04:29.249912 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-4cce53b4-6011-47f7-8341-574c8f787f9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:04:29.251625 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1363/2723] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 21:04:29 2021] DELETE /identity/v3/projects/ef29db310e29414296dcf5e9c682941e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:04:30.417581 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938523e-b725-49e1-8e64-660295b75a7b None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:04:30.418065 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938523e-b725-49e1-8e64-660295b75a7b None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:04:30.418189 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938523e-b725-49e1-8e64-660295b75a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:04:30.442612 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-5938523e-b725-49e1-8e64-660295b75a7b None None] MFA Rules not processed for user `1959af22edbf47cd8afca70831d476c0`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:04:30.443833 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-5938523e-b725-49e1-8e64-660295b75a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:04:30.506517 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1361/2724] 10.222.0.37 () {58 vars in 1014 bytes} [Wed Dec 29 21:04:30 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:04:30.517928 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce53b4-6011-47f7-8341-574c8f787f9e admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:04:30.519276 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-4cce53b4-6011-47f7-8341-574c8f787f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:04:30.596036 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce53b4-6011-47f7-8341-574c8f787f9e admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:04:30.601213 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce3a3c-9452-4fce-a250-19acb41f609f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd2861e377640c9b76d0dfb08cf088e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:04:30.601793 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce3a3c-9452-4fce-a250-19acb41f609f service swift] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:04:30.602081 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce3a3c-9452-4fce-a250-19acb41f609f service swift] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:04:30.602362 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce3a3c-9452-4fce-a250-19acb41f609f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:04:30.610459 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce3a3c-9452-4fce-a250-19acb41f609f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:04:30.638697 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce3a3c-9452-4fce-a250-19acb41f609f service swift] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:04:30.647192 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1364/2725] 10.222.0.37 () {60 vars in 1384 bytes} [Wed Dec 29 21:04:30 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 29 21:04:35.123397 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938523e-b725-49e1-8e64-660295b75a7b None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:04:35.125279 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-5938523e-b725-49e1-8e64-660295b75a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:04:35.257010 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938523e-b725-49e1-8e64-660295b75a7b None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:04:35.262192 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833a52b-42ee-49c5-8251-7e3dfdc0aa6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:04:35.263016 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833a52b-42ee-49c5-8251-7e3dfdc0aa6e service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:04:35.263376 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833a52b-42ee-49c5-8251-7e3dfdc0aa6e service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:04:35.263856 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833a52b-42ee-49c5-8251-7e3dfdc0aa6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:04:35.265630 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-e833a52b-42ee-49c5-8251-7e3dfdc0aa6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:04:35.282801 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833a52b-42ee-49c5-8251-7e3dfdc0aa6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:04:35.309857 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833a52b-42ee-49c5-8251-7e3dfdc0aa6e service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:04:35.328685 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1362/2726] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:04:35 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:04:49.247333 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce3a3c-9452-4fce-a250-19acb41f609f service swift] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:04:49.248765 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-61ce3a3c-9452-4fce-a250-19acb41f609f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:04:49.366833 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce3a3c-9452-4fce-a250-19acb41f609f service swift] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:04:49.370149 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa2dce-8ba6-4644-a9e8-34286eabdb57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:04:49.370740 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa2dce-8ba6-4644-a9e8-34286eabdb57 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:04:49.371029 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa2dce-8ba6-4644-a9e8-34286eabdb57 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:04:49.371308 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa2dce-8ba6-4644-a9e8-34286eabdb57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:04:49.372924 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-3ffa2dce-8ba6-4644-a9e8-34286eabdb57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:04:49.485614 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa2dce-8ba6-4644-a9e8-34286eabdb57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:04:49.512154 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa2dce-8ba6-4644-a9e8-34286eabdb57 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:04:49.534887 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1365/2727] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:04:49 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:04:52.381435 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5faed-5738-4746-bfad-b7066f4a3a39 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:04:52.382010 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5faed-5738-4746-bfad-b7066f4a3a39 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:04:52.383322 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5faed-5738-4746-bfad-b7066f4a3a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:04:52.411890 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-b6a5faed-5738-4746-bfad-b7066f4a3a39 None None] MFA Rules not processed for user `1959af22edbf47cd8afca70831d476c0`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:04:52.413223 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-b6a5faed-5738-4746-bfad-b7066f4a3a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:04:52.420926 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1363/2728] 10.222.0.37 () {58 vars in 967 bytes} [Wed Dec 29 21:04:52 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:04:52.433310 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa2dce-8ba6-4644-a9e8-34286eabdb57 service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:04:52.446209 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa2dce-8ba6-4644-a9e8-34286eabdb57 service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:04:52.451147 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c89445-bc03-492d-9318-9e8ad948d058 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd2861e377640c9b76d0dfb08cf088e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:04:52.451722 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c89445-bc03-492d-9318-9e8ad948d058 service swift] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:04:52.452008 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c89445-bc03-492d-9318-9e8ad948d058 service swift] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:04:52.452288 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c89445-bc03-492d-9318-9e8ad948d058 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:04:52.461078 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c89445-bc03-492d-9318-9e8ad948d058 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:04:52.486012 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c89445-bc03-492d-9318-9e8ad948d058 service swift] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:04:52.494519 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1366/2729] 10.222.0.37 () {60 vars in 1384 bytes} [Wed Dec 29 21:04:52 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 29 21:05:00.744082 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5faed-5738-4746-bfad-b7066f4a3a39 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:05:00.745537 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-b6a5faed-5738-4746-bfad-b7066f4a3a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:05:00.758458 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5faed-5738-4746-bfad-b7066f4a3a39 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:05:00.762464 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebca4a-6d14-4fbe-8e25-6fef71fc8d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:05:00.763288 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebca4a-6d14-4fbe-8e25-6fef71fc8d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:05:00.763575 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebca4a-6d14-4fbe-8e25-6fef71fc8d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:05:00.763854 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebca4a-6d14-4fbe-8e25-6fef71fc8d56 admin admin] PATH_INFO: `/v3/users/df2ec396a09f497fa5761cef615b262d` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:05:00.764954 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ebca4a-6d14-4fbe-8e25-6fef71fc8d56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df2ec396a09f497fa5761cef615b262d)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:05:00.791212 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ebca4a-6d14-4fbe-8e25-6fef71fc8d56 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:05:00.839072 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-94ebca4a-6d14-4fbe-8e25-6fef71fc8d56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df2ec396a09f497fa5761cef615b262d'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:05:00.839688 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-94ebca4a-6d14-4fbe-8e25-6fef71fc8d56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df2ec396a09f497fa5761cef615b262d'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:05:00.847266 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-94ebca4a-6d14-4fbe-8e25-6fef71fc8d56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df2ec396a09f497fa5761cef615b262d'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:05:00.859277 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-94ebca4a-6d14-4fbe-8e25-6fef71fc8d56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df2ec396a09f497fa5761cef615b262d'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:05:00.867570 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-94ebca4a-6d14-4fbe-8e25-6fef71fc8d56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df2ec396a09f497fa5761cef615b262d'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:05:00.873765 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1364/2730] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 21:05:00 2021] DELETE /identity/v3/users/df2ec396a09f497fa5761cef615b262d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:05:01.099498 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c89445-bc03-492d-9318-9e8ad948d058 service swift] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:05:01.110067 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c89445-bc03-492d-9318-9e8ad948d058 service swift] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:05:01.172107 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497eca2-9206-46aa-9c5b-2f831de972f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:05:01.172922 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497eca2-9206-46aa-9c5b-2f831de972f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:05:01.173284 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497eca2-9206-46aa-9c5b-2f831de972f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:05:01.173496 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497eca2-9206-46aa-9c5b-2f831de972f2 admin admin] PATH_INFO: `/v3/projects/f6605294a2f54d1b8e2be6b90dc68f7c` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:05:01.174634 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497eca2-9206-46aa-9c5b-2f831de972f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6605294a2f54d1b8e2be6b90dc68f7c)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:05:01.202121 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497eca2-9206-46aa-9c5b-2f831de972f2 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:05:01.250564 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-0497eca2-9206-46aa-9c5b-2f831de972f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6605294a2f54d1b8e2be6b90dc68f7c', 'request_id': 'req-0497eca2-9206-46aa-9c5b-2f831de972f2'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:05:01.256725 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-0497eca2-9206-46aa-9c5b-2f831de972f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6605294a2f54d1b8e2be6b90dc68f7c', 'request_id': 'req-0497eca2-9206-46aa-9c5b-2f831de972f2'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:05:01.268347 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-0497eca2-9206-46aa-9c5b-2f831de972f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6605294a2f54d1b8e2be6b90dc68f7c', 'request_id': 'req-0497eca2-9206-46aa-9c5b-2f831de972f2'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:05:01.277792 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-0497eca2-9206-46aa-9c5b-2f831de972f2 admin admin] The token cache is being invalidate because project f6605294a2f54d1b8e2be6b90dc68f7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 21:05:01.278066 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-0497eca2-9206-46aa-9c5b-2f831de972f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:05:01.278694 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-0497eca2-9206-46aa-9c5b-2f831de972f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:05:01.280313 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1367/2731] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 21:05:01 2021] DELETE /identity/v3/projects/f6605294a2f54d1b8e2be6b90dc68f7c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:05:01.284096 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebca4a-6d14-4fbe-8e25-6fef71fc8d56 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:05:01.285457 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-94ebca4a-6d14-4fbe-8e25-6fef71fc8d56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:05:01.297437 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebca4a-6d14-4fbe-8e25-6fef71fc8d56 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:05:01.358169 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c907b7e-32f4-4908-bee4-fa0dcea25552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:05:01.358919 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c907b7e-32f4-4908-bee4-fa0dcea25552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:05:01.359214 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c907b7e-32f4-4908-bee4-fa0dcea25552 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:05:01.359496 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c907b7e-32f4-4908-bee4-fa0dcea25552 admin admin] PATH_INFO: `/v3/users/9b82fa253446493f84cb0d9768ed1573` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:05:01.377307 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c907b7e-32f4-4908-bee4-fa0dcea25552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b82fa253446493f84cb0d9768ed1573)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:05:01.404109 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c907b7e-32f4-4908-bee4-fa0dcea25552 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:05:01.451409 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-1c907b7e-32f4-4908-bee4-fa0dcea25552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b82fa253446493f84cb0d9768ed1573'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:05:01.452021 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-1c907b7e-32f4-4908-bee4-fa0dcea25552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b82fa253446493f84cb0d9768ed1573'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:05:01.459431 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-1c907b7e-32f4-4908-bee4-fa0dcea25552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b82fa253446493f84cb0d9768ed1573'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:05:01.471016 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-1c907b7e-32f4-4908-bee4-fa0dcea25552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b82fa253446493f84cb0d9768ed1573'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:05:01.478882 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-1c907b7e-32f4-4908-bee4-fa0dcea25552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b82fa253446493f84cb0d9768ed1573'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:05:01.484735 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1365/2732] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 21:05:01 2021] DELETE /identity/v3/users/9b82fa253446493f84cb0d9768ed1573 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:05:01.699395 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497eca2-9206-46aa-9c5b-2f831de972f2 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:05:01.700744 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-0497eca2-9206-46aa-9c5b-2f831de972f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:05:01.712689 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497eca2-9206-46aa-9c5b-2f831de972f2 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:05:01.774464 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735210e-d550-4e3e-8002-123a043ea736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:05:01.775277 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735210e-d550-4e3e-8002-123a043ea736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:05:01.775565 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735210e-d550-4e3e-8002-123a043ea736 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:05:01.775849 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735210e-d550-4e3e-8002-123a043ea736 admin admin] PATH_INFO: `/v3/projects/2984268e625e45eba50ad075c215b31a` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:05:01.786900 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735210e-d550-4e3e-8002-123a043ea736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2984268e625e45eba50ad075c215b31a)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:05:01.812680 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735210e-d550-4e3e-8002-123a043ea736 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:05:01.862186 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-0735210e-d550-4e3e-8002-123a043ea736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2984268e625e45eba50ad075c215b31a', 'request_id': 'req-0735210e-d550-4e3e-8002-123a043ea736'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:05:01.869182 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-0735210e-d550-4e3e-8002-123a043ea736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2984268e625e45eba50ad075c215b31a', 'request_id': 'req-0735210e-d550-4e3e-8002-123a043ea736'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:05:01.880244 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-0735210e-d550-4e3e-8002-123a043ea736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2984268e625e45eba50ad075c215b31a', 'request_id': 'req-0735210e-d550-4e3e-8002-123a043ea736'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:05:01.890247 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-0735210e-d550-4e3e-8002-123a043ea736 admin admin] The token cache is being invalidate because project 2984268e625e45eba50ad075c215b31a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 21:05:01.890532 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-0735210e-d550-4e3e-8002-123a043ea736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:05:01.891174 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-0735210e-d550-4e3e-8002-123a043ea736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:05:01.892571 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1368/2733] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 21:05:01 2021] DELETE /identity/v3/projects/2984268e625e45eba50ad075c215b31a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:05:23.088433 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c907b7e-32f4-4908-bee4-fa0dcea25552 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:05:23.089822 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-1c907b7e-32f4-4908-bee4-fa0dcea25552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:05:23.270055 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c907b7e-32f4-4908-bee4-fa0dcea25552 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:05:23.332073 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75149b-7e4e-453e-b831-8836a7593d5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25cb71bb64a3456fb2dc02095c487d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:05:23.332650 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75149b-7e4e-453e-b831-8836a7593d5c service placement] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:05:23.332935 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75149b-7e4e-453e-b831-8836a7593d5c service placement] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:05:23.333222 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75149b-7e4e-453e-b831-8836a7593d5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:05:23.334903 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-1e75149b-7e4e-453e-b831-8836a7593d5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:05:23.345488 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75149b-7e4e-453e-b831-8836a7593d5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:05:23.371752 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75149b-7e4e-453e-b831-8836a7593d5c service placement] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:05:23.380828 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1366/2734] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:05:23 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:06:07.691880 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735210e-d550-4e3e-8002-123a043ea736 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:07.693320 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-0735210e-d550-4e3e-8002-123a043ea736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:07.755409 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735210e-d550-4e3e-8002-123a043ea736 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:07.758574 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbba926-d2fd-41cb-a70c-242cb9c21275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:07.759169 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbba926-d2fd-41cb-a70c-242cb9c21275 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:07.759945 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbba926-d2fd-41cb-a70c-242cb9c21275 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:07.760265 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbba926-d2fd-41cb-a70c-242cb9c21275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:07.761878 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-2cbba926-d2fd-41cb-a70c-242cb9c21275 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:07.830196 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbba926-d2fd-41cb-a70c-242cb9c21275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:07.856229 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbba926-d2fd-41cb-a70c-242cb9c21275 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:07.865640 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1369/2735] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:06:07 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:06:13.313313 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75149b-7e4e-453e-b831-8836a7593d5c service placement] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:13.314764 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-1e75149b-7e4e-453e-b831-8836a7593d5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:13.327637 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75149b-7e4e-453e-b831-8836a7593d5c service placement] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:13.331655 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f138ff-5026-4b3f-ab22-d7665363492f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:13.332432 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f138ff-5026-4b3f-ab22-d7665363492f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:13.332713 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f138ff-5026-4b3f-ab22-d7665363492f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:13.332990 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f138ff-5026-4b3f-ab22-d7665363492f admin admin] PATH_INFO: `/v3/users/82536fd1a7004505b9c79b6bc570d9e4` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:13.352134 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f138ff-5026-4b3f-ab22-d7665363492f admin admin] RBAC: Authorizing `identity:delete_user(user_id=82536fd1a7004505b9c79b6bc570d9e4)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:13.378116 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f138ff-5026-4b3f-ab22-d7665363492f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:13.427697 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-54f138ff-5026-4b3f-ab22-d7665363492f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82536fd1a7004505b9c79b6bc570d9e4'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:13.428321 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-54f138ff-5026-4b3f-ab22-d7665363492f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82536fd1a7004505b9c79b6bc570d9e4'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:13.436793 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-54f138ff-5026-4b3f-ab22-d7665363492f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82536fd1a7004505b9c79b6bc570d9e4'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:13.449204 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-54f138ff-5026-4b3f-ab22-d7665363492f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82536fd1a7004505b9c79b6bc570d9e4'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:13.456140 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-54f138ff-5026-4b3f-ab22-d7665363492f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82536fd1a7004505b9c79b6bc570d9e4'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:13.461833 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1367/2736] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 21:06:13 2021] DELETE /identity/v3/users/82536fd1a7004505b9c79b6bc570d9e4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:06:13.674949 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbba926-d2fd-41cb-a70c-242cb9c21275 service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:13.685471 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbba926-d2fd-41cb-a70c-242cb9c21275 service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:13.753793 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcf481-89d7-4692-953e-fe79db7afde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:13.754700 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcf481-89d7-4692-953e-fe79db7afde5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:13.754997 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcf481-89d7-4692-953e-fe79db7afde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:13.755280 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcf481-89d7-4692-953e-fe79db7afde5 admin admin] PATH_INFO: `/v3/projects/c57d417a00fc4d18b249a80a29223706` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:13.767238 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bcf481-89d7-4692-953e-fe79db7afde5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c57d417a00fc4d18b249a80a29223706)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:13.793465 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bcf481-89d7-4692-953e-fe79db7afde5 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:13.844327 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-21bcf481-89d7-4692-953e-fe79db7afde5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c57d417a00fc4d18b249a80a29223706', 'request_id': 'req-21bcf481-89d7-4692-953e-fe79db7afde5'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:13.851656 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-21bcf481-89d7-4692-953e-fe79db7afde5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c57d417a00fc4d18b249a80a29223706', 'request_id': 'req-21bcf481-89d7-4692-953e-fe79db7afde5'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:13.862436 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-21bcf481-89d7-4692-953e-fe79db7afde5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c57d417a00fc4d18b249a80a29223706', 'request_id': 'req-21bcf481-89d7-4692-953e-fe79db7afde5'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:13.872491 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-21bcf481-89d7-4692-953e-fe79db7afde5 admin admin] The token cache is being invalidate because project c57d417a00fc4d18b249a80a29223706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 21:06:13.872773 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-21bcf481-89d7-4692-953e-fe79db7afde5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:13.873383 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-21bcf481-89d7-4692-953e-fe79db7afde5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:13.874799 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1370/2737] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 21:06:13 2021] DELETE /identity/v3/projects/c57d417a00fc4d18b249a80a29223706 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:06:13.880376 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645d616-3609-433c-96b7-7dd72cb19cea None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:13.880690 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645d616-3609-433c-96b7-7dd72cb19cea None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:13.880952 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645d616-3609-433c-96b7-7dd72cb19cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:13.950590 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-a645d616-3609-433c-96b7-7dd72cb19cea None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:06:13.951763 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-a645d616-3609-433c-96b7-7dd72cb19cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:14.013710 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1368/2738] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:06:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 21:06:14.021309 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075cef1-7b24-4f04-8f1a-eeedc1fd46c8 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:14.021597 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075cef1-7b24-4f04-8f1a-eeedc1fd46c8 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:14.021878 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075cef1-7b24-4f04-8f1a-eeedc1fd46c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:14.044098 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-1075cef1-7b24-4f04-8f1a-eeedc1fd46c8 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:06:14.045222 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-1075cef1-7b24-4f04-8f1a-eeedc1fd46c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:14.052365 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1371/2739] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:06:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:06:14.056955 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645d616-3609-433c-96b7-7dd72cb19cea None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:14.066275 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645d616-3609-433c-96b7-7dd72cb19cea None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:14.070417 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc373958-0a5c-443a-9151-753e21f70c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:14.071034 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc373958-0a5c-443a-9151-753e21f70c9e admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:14.071322 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc373958-0a5c-443a-9151-753e21f70c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:14.071599 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc373958-0a5c-443a-9151-753e21f70c9e admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:14.073112 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc373958-0a5c-443a-9151-753e21f70c9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 21:06:14.073430 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc373958-0a5c-443a-9151-753e21f70c9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:14.098748 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc373958-0a5c-443a-9151-753e21f70c9e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:14.111285 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1369/2740] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 21:06:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 21:06:14.115427 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075cef1-7b24-4f04-8f1a-eeedc1fd46c8 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:14.124474 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075cef1-7b24-4f04-8f1a-eeedc1fd46c8 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:14.128877 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0d4be-e110-4e18-9701-5cf21de40adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:14.129459 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0d4be-e110-4e18-9701-5cf21de40adf admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:14.129750 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0d4be-e110-4e18-9701-5cf21de40adf admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:14.130032 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0d4be-e110-4e18-9701-5cf21de40adf admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:14.130787 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0d4be-e110-4e18-9701-5cf21de40adf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:14.157140 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0d4be-e110-4e18-9701-5cf21de40adf admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:14.183136 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1372/2741] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 21:06:14 2021] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 21:06:14.187152 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc373958-0a5c-443a-9151-753e21f70c9e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:14.196348 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc373958-0a5c-443a-9151-753e21f70c9e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:14.266227 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ea0f0-8d15-4ffa-873f-fe934fb4822b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:14.266772 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ea0f0-8d15-4ffa-873f-fe934fb4822b admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:14.267059 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ea0f0-8d15-4ffa-873f-fe934fb4822b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:14.267336 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ea0f0-8d15-4ffa-873f-fe934fb4822b admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:14.267989 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ea0f0-8d15-4ffa-873f-fe934fb4822b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:14.293163 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ea0f0-8d15-4ffa-873f-fe934fb4822b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:14.311908 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1370/2742] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 21:06:14 2021] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 21:06:14.316087 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0d4be-e110-4e18-9701-5cf21de40adf admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:14.326622 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0d4be-e110-4e18-9701-5cf21de40adf admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:14.330805 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a148399-3010-4dad-b483-3ccd5bf23a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:14.331388 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a148399-3010-4dad-b483-3ccd5bf23a1b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:14.331677 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a148399-3010-4dad-b483-3ccd5bf23a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:14.331957 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a148399-3010-4dad-b483-3ccd5bf23a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:14.332664 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a148399-3010-4dad-b483-3ccd5bf23a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:14.357798 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a148399-3010-4dad-b483-3ccd5bf23a1b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:14.367894 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1373/2743] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:06:14 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 21:06:14.372498 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ea0f0-8d15-4ffa-873f-fe934fb4822b admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:14.384179 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ea0f0-8d15-4ffa-873f-fe934fb4822b admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:14.389049 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e9753-6436-45bb-a7ea-6e41cc2b3b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:14.389854 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e9753-6436-45bb-a7ea-6e41cc2b3b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:14.390145 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e9753-6436-45bb-a7ea-6e41cc2b3b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:14.390424 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e9753-6436-45bb-a7ea-6e41cc2b3b88 admin admin] PATH_INFO: `/v3/projects/d1deb28bb8104e1386b40fcde164bdc6/users/94541e92d6c446eea4f071c55339abf8/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:14.411665 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e9753-6436-45bb-a7ea-6e41cc2b3b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1deb28bb8104e1386b40fcde164bdc6, user_id=94541e92d6c446eea4f071c55339abf8, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:14.438677 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e9753-6436-45bb-a7ea-6e41cc2b3b88 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:14.453059 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1371/2744] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:06:14 2021] PUT /identity/v3/projects/d1deb28bb8104e1386b40fcde164bdc6/users/94541e92d6c446eea4f071c55339abf8/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:06:14.463190 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd8191-ed04-4b1a-9bcc-786034e064fc None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:14.464114 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd8191-ed04-4b1a-9bcc-786034e064fc None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:14.464567 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd8191-ed04-4b1a-9bcc-786034e064fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:14.500980 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-08dd8191-ed04-4b1a-9bcc-786034e064fc None None] MFA Rules not processed for user `94541e92d6c446eea4f071c55339abf8`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:06:14.502178 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-08dd8191-ed04-4b1a-9bcc-786034e064fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:14.572138 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1374/2745] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:06:14 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:06:14.583471 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e9753-6436-45bb-a7ea-6e41cc2b3b88 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:14.585066 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-784e9753-6436-45bb-a7ea-6e41cc2b3b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:14.699451 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e9753-6436-45bb-a7ea-6e41cc2b3b88 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:14.704533 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af5768-98ae-490f-895d-c2f7c4b3271f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:14.705256 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af5768-98ae-490f-895d-c2f7c4b3271f service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:14.705548 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af5768-98ae-490f-895d-c2f7c4b3271f service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:14.705827 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af5768-98ae-490f-895d-c2f7c4b3271f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:14.714039 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af5768-98ae-490f-895d-c2f7c4b3271f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:14.740178 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af5768-98ae-490f-895d-c2f7c4b3271f service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:14.748855 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1372/2746] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:06:14 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 21:06:23.832698 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd8191-ed04-4b1a-9bcc-786034e064fc None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:23.904646 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd8191-ed04-4b1a-9bcc-786034e064fc None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:23.908769 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb99256-0a93-4cb8-b593-b00fb53abd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:23.909553 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb99256-0a93-4cb8-b593-b00fb53abd73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:23.909842 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb99256-0a93-4cb8-b593-b00fb53abd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:23.910122 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb99256-0a93-4cb8-b593-b00fb53abd73 admin admin] PATH_INFO: `/v3/users/94541e92d6c446eea4f071c55339abf8` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:23.911226 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb99256-0a93-4cb8-b593-b00fb53abd73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94541e92d6c446eea4f071c55339abf8)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:23.937202 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb99256-0a93-4cb8-b593-b00fb53abd73 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:23.985553 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-bcb99256-0a93-4cb8-b593-b00fb53abd73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94541e92d6c446eea4f071c55339abf8'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:23.998643 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-bcb99256-0a93-4cb8-b593-b00fb53abd73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94541e92d6c446eea4f071c55339abf8'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:23.999331 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-bcb99256-0a93-4cb8-b593-b00fb53abd73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94541e92d6c446eea4f071c55339abf8'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:24.006794 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-bcb99256-0a93-4cb8-b593-b00fb53abd73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94541e92d6c446eea4f071c55339abf8'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:24.014299 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-bcb99256-0a93-4cb8-b593-b00fb53abd73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94541e92d6c446eea4f071c55339abf8'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:24.020129 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1375/2747] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 21:06:23 2021] DELETE /identity/v3/users/94541e92d6c446eea4f071c55339abf8 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:06:24.024599 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46289564-ad54-4733-ad08-87bf15d9faa3 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:24.025112 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46289564-ad54-4733-ad08-87bf15d9faa3 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:24.025243 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46289564-ad54-4733-ad08-87bf15d9faa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:24.047858 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-46289564-ad54-4733-ad08-87bf15d9faa3 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:06:24.048997 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-46289564-ad54-4733-ad08-87bf15d9faa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:24.111181 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1373/2748] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:06:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:06:24.121329 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb99256-0a93-4cb8-b593-b00fb53abd73 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:24.122641 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-bcb99256-0a93-4cb8-b593-b00fb53abd73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:24.185226 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb99256-0a93-4cb8-b593-b00fb53abd73 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:24.188477 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5138d61-6df6-47c9-b6f3-e78b277f5a4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:24.189041 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5138d61-6df6-47c9-b6f3-e78b277f5a4b service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:24.189328 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5138d61-6df6-47c9-b6f3-e78b277f5a4b service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:24.189609 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5138d61-6df6-47c9-b6f3-e78b277f5a4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:24.199004 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5138d61-6df6-47c9-b6f3-e78b277f5a4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:24.224344 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5138d61-6df6-47c9-b6f3-e78b277f5a4b service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:24.233443 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1376/2749] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:06:24 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:06:24.568006 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46289564-ad54-4733-ad08-87bf15d9faa3 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:24.569334 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-46289564-ad54-4733-ad08-87bf15d9faa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:24.581380 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46289564-ad54-4733-ad08-87bf15d9faa3 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:24.585587 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d09151-773f-49db-8b27-09d7f2a8a93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:24.586360 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d09151-773f-49db-8b27-09d7f2a8a93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:24.586643 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d09151-773f-49db-8b27-09d7f2a8a93d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:24.586965 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d09151-773f-49db-8b27-09d7f2a8a93d admin admin] PATH_INFO: `/v3/projects/d1deb28bb8104e1386b40fcde164bdc6` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:24.588020 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d09151-773f-49db-8b27-09d7f2a8a93d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1deb28bb8104e1386b40fcde164bdc6)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:24.613512 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d09151-773f-49db-8b27-09d7f2a8a93d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:24.663466 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-b9d09151-773f-49db-8b27-09d7f2a8a93d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1deb28bb8104e1386b40fcde164bdc6', 'request_id': 'req-b9d09151-773f-49db-8b27-09d7f2a8a93d'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:24.670100 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-b9d09151-773f-49db-8b27-09d7f2a8a93d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1deb28bb8104e1386b40fcde164bdc6', 'request_id': 'req-b9d09151-773f-49db-8b27-09d7f2a8a93d'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:24.675137 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-b9d09151-773f-49db-8b27-09d7f2a8a93d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1deb28bb8104e1386b40fcde164bdc6', 'request_id': 'req-b9d09151-773f-49db-8b27-09d7f2a8a93d'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:24.690957 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-b9d09151-773f-49db-8b27-09d7f2a8a93d admin admin] The token cache is being invalidate because project d1deb28bb8104e1386b40fcde164bdc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 21:06:24.691238 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-b9d09151-773f-49db-8b27-09d7f2a8a93d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:24.691827 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-b9d09151-773f-49db-8b27-09d7f2a8a93d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:24.693218 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1374/2750] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 21:06:24 2021] DELETE /identity/v3/projects/d1deb28bb8104e1386b40fcde164bdc6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 21:06:24.699954 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46382ab1-9aa7-47a7-a3c5-080a78b8bd2a None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:24.700241 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46382ab1-9aa7-47a7-a3c5-080a78b8bd2a None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:24.700521 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46382ab1-9aa7-47a7-a3c5-080a78b8bd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:24.723009 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-46382ab1-9aa7-47a7-a3c5-080a78b8bd2a None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:06:24.724076 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-46382ab1-9aa7-47a7-a3c5-080a78b8bd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:24.787614 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1377/2751] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:06:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:06:24.795647 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cee7e-c36c-49ea-9a73-21f31f017b34 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:24.795947 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cee7e-c36c-49ea-9a73-21f31f017b34 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:24.796237 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cee7e-c36c-49ea-9a73-21f31f017b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:24.819021 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-4b3cee7e-c36c-49ea-9a73-21f31f017b34 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:06:24.820187 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-4b3cee7e-c36c-49ea-9a73-21f31f017b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:24.828063 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1375/2752] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:06:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:06:24.832243 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46382ab1-9aa7-47a7-a3c5-080a78b8bd2a None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:24.842278 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46382ab1-9aa7-47a7-a3c5-080a78b8bd2a None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:24.846463 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9de4ff-4d1e-4b74-b631-0f84d08aa27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:24.847074 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9de4ff-4d1e-4b74-b631-0f84d08aa27f admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:24.847361 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9de4ff-4d1e-4b74-b631-0f84d08aa27f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:24.847643 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9de4ff-4d1e-4b74-b631-0f84d08aa27f admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:24.848351 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9de4ff-4d1e-4b74-b631-0f84d08aa27f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 21:06:24.848646 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9de4ff-4d1e-4b74-b631-0f84d08aa27f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:24.874420 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9de4ff-4d1e-4b74-b631-0f84d08aa27f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:24.888301 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1378/2753] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 21:06:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 29 21:06:24.892693 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3cee7e-c36c-49ea-9a73-21f31f017b34 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:24.901549 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3cee7e-c36c-49ea-9a73-21f31f017b34 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:24.905811 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e97c7-b816-4d4e-a475-be8377a6bdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:24.906386 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e97c7-b816-4d4e-a475-be8377a6bdf0 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:24.906697 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e97c7-b816-4d4e-a475-be8377a6bdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:24.906986 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e97c7-b816-4d4e-a475-be8377a6bdf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:24.907616 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e97c7-b816-4d4e-a475-be8377a6bdf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:24.934216 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e97c7-b816-4d4e-a475-be8377a6bdf0 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:24.962143 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1376/2754] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 21:06:24 2021] POST /identity/v3/projects => generated 357 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 21:06:24.966834 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9de4ff-4d1e-4b74-b631-0f84d08aa27f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:24.976543 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9de4ff-4d1e-4b74-b631-0f84d08aa27f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:25.036805 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e9393-5a45-4f8a-8f3b-d3234c4a424d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:25.037390 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e9393-5a45-4f8a-8f3b-d3234c4a424d admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:25.037703 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e9393-5a45-4f8a-8f3b-d3234c4a424d admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:25.037984 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e9393-5a45-4f8a-8f3b-d3234c4a424d admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:25.038613 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e9393-5a45-4f8a-8f3b-d3234c4a424d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:25.064193 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e9393-5a45-4f8a-8f3b-d3234c4a424d admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:25.083712 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1379/2755] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 21:06:24 2021] POST /identity/v3/users => generated 279 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 21:06:25.087789 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e97c7-b816-4d4e-a475-be8377a6bdf0 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:25.098267 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e97c7-b816-4d4e-a475-be8377a6bdf0 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:25.102456 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa750d-cef4-4fd7-9709-e8c4537d7352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:25.103075 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa750d-cef4-4fd7-9709-e8c4537d7352 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:25.103358 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa750d-cef4-4fd7-9709-e8c4537d7352 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:25.103637 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa750d-cef4-4fd7-9709-e8c4537d7352 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:25.104403 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa750d-cef4-4fd7-9709-e8c4537d7352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:25.129742 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa750d-cef4-4fd7-9709-e8c4537d7352 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:25.140112 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1377/2756] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:06:25 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 21:06:25.144213 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e9393-5a45-4f8a-8f3b-d3234c4a424d admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:25.154174 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e9393-5a45-4f8a-8f3b-d3234c4a424d admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:25.158489 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a4dd8-9c30-4bc9-b734-429c14fc7d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:25.159334 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a4dd8-9c30-4bc9-b734-429c14fc7d3a admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:25.159621 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a4dd8-9c30-4bc9-b734-429c14fc7d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:25.159900 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a4dd8-9c30-4bc9-b734-429c14fc7d3a admin admin] PATH_INFO: `/v3/projects/cbe01083eec14181a9b123c4e2d9b56c/users/5d9b4d1a0067490ea4ec4349c49412eb/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:25.179168 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a4dd8-9c30-4bc9-b734-429c14fc7d3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe01083eec14181a9b123c4e2d9b56c, user_id=5d9b4d1a0067490ea4ec4349c49412eb, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:25.205620 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a4dd8-9c30-4bc9-b734-429c14fc7d3a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:25.218235 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1380/2757] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:06:25 2021] PUT /identity/v3/projects/cbe01083eec14181a9b123c4e2d9b56c/users/5d9b4d1a0067490ea4ec4349c49412eb/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:06:25.229753 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c12e45-827c-4bf4-aff7-ffc8652c766a None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:25.229986 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c12e45-827c-4bf4-aff7-ffc8652c766a None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:25.230268 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c12e45-827c-4bf4-aff7-ffc8652c766a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:25.265444 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-c4c12e45-827c-4bf4-aff7-ffc8652c766a None None] MFA Rules not processed for user `5d9b4d1a0067490ea4ec4349c49412eb`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:06:25.266569 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-c4c12e45-827c-4bf4-aff7-ffc8652c766a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:25.335035 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1378/2758] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:06:25 2021] POST /identity/v3/auth/tokens => generated 3664 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:06:25.339483 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a4dd8-9c30-4bc9-b734-429c14fc7d3a admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:25.408963 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a4dd8-9c30-4bc9-b734-429c14fc7d3a admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:25.413115 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dc295-a143-4426-bf43-e535771d9128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:25.413691 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dc295-a143-4426-bf43-e535771d9128 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:25.413977 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dc295-a143-4426-bf43-e535771d9128 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:25.414257 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dc295-a143-4426-bf43-e535771d9128 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:25.414945 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dc295-a143-4426-bf43-e535771d9128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:25.441282 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dc295-a143-4426-bf43-e535771d9128 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:25.467037 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1381/2759] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 21:06:25 2021] POST /identity/v3/projects => generated 355 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 21:06:25.470990 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c12e45-827c-4bf4-aff7-ffc8652c766a None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:25.481781 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c12e45-827c-4bf4-aff7-ffc8652c766a None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:25.541137 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058b665-1320-4c65-950c-4c30669d2026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:25.542319 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058b665-1320-4c65-950c-4c30669d2026 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:25.542628 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058b665-1320-4c65-950c-4c30669d2026 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:25.542916 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058b665-1320-4c65-950c-4c30669d2026 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:25.543553 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058b665-1320-4c65-950c-4c30669d2026 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:25.569654 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058b665-1320-4c65-950c-4c30669d2026 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:25.588719 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1379/2760] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 21:06:25 2021] POST /identity/v3/users => generated 284 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 21:06:25.592731 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dc295-a143-4426-bf43-e535771d9128 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:25.602334 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dc295-a143-4426-bf43-e535771d9128 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:25.607413 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e08ca6-0ae7-4b15-803b-729b50fbd64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:25.607978 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e08ca6-0ae7-4b15-803b-729b50fbd64f admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:25.608260 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e08ca6-0ae7-4b15-803b-729b50fbd64f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:25.608543 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e08ca6-0ae7-4b15-803b-729b50fbd64f admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:25.609223 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e08ca6-0ae7-4b15-803b-729b50fbd64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:25.634255 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e08ca6-0ae7-4b15-803b-729b50fbd64f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:25.645048 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1382/2761] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:06:25 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 21:06:25.649180 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058b665-1320-4c65-950c-4c30669d2026 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:25.659128 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058b665-1320-4c65-950c-4c30669d2026 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:25.663362 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd739c-2379-491e-9925-a5f27158211c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:25.664161 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd739c-2379-491e-9925-a5f27158211c admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:25.664442 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd739c-2379-491e-9925-a5f27158211c admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:25.664720 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd739c-2379-491e-9925-a5f27158211c admin admin] PATH_INFO: `/v3/projects/2d09e89b3e8844e78f3a8dd9ca0afb95/users/9fcae700ae4741518777a9d8addb8b9e/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:25.684382 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd739c-2379-491e-9925-a5f27158211c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d09e89b3e8844e78f3a8dd9ca0afb95, user_id=9fcae700ae4741518777a9d8addb8b9e, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:25.711227 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd739c-2379-491e-9925-a5f27158211c admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:25.725295 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1380/2762] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:06:25 2021] PUT /identity/v3/projects/2d09e89b3e8844e78f3a8dd9ca0afb95/users/9fcae700ae4741518777a9d8addb8b9e/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:06:25.729459 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e08ca6-0ae7-4b15-803b-729b50fbd64f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:25.738964 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e08ca6-0ae7-4b15-803b-729b50fbd64f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:25.799347 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838eaad-1479-41b2-b81e-dfe31fc29a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:25.799931 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838eaad-1479-41b2-b81e-dfe31fc29a1f admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:25.800218 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838eaad-1479-41b2-b81e-dfe31fc29a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:25.800496 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838eaad-1479-41b2-b81e-dfe31fc29a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:25.801175 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838eaad-1479-41b2-b81e-dfe31fc29a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:25.826775 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838eaad-1479-41b2-b81e-dfe31fc29a1f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:25.837031 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1383/2763] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:06:25 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 21:06:25.841929 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd739c-2379-491e-9925-a5f27158211c admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:25.851481 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd739c-2379-491e-9925-a5f27158211c admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:25.855742 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154afa4-66bf-4d4c-b233-58fbe28ef6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:25.856546 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154afa4-66bf-4d4c-b233-58fbe28ef6a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:25.856827 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154afa4-66bf-4d4c-b233-58fbe28ef6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:25.857131 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154afa4-66bf-4d4c-b233-58fbe28ef6a7 admin admin] PATH_INFO: `/v3/projects/2d09e89b3e8844e78f3a8dd9ca0afb95/users/9fcae700ae4741518777a9d8addb8b9e/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:25.858896 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154afa4-66bf-4d4c-b233-58fbe28ef6a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d09e89b3e8844e78f3a8dd9ca0afb95, user_id=9fcae700ae4741518777a9d8addb8b9e, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:25.886088 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154afa4-66bf-4d4c-b233-58fbe28ef6a7 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:25.896846 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1381/2764] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:06:25 2021] PUT /identity/v3/projects/2d09e89b3e8844e78f3a8dd9ca0afb95/users/9fcae700ae4741518777a9d8addb8b9e/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:06:25.901475 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838eaad-1479-41b2-b81e-dfe31fc29a1f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:25.910955 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838eaad-1479-41b2-b81e-dfe31fc29a1f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:25.972321 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f99133-0eac-4fae-b5ee-117f4838fdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:25.972905 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f99133-0eac-4fae-b5ee-117f4838fdfd admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:25.973198 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f99133-0eac-4fae-b5ee-117f4838fdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:25.973513 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f99133-0eac-4fae-b5ee-117f4838fdfd admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:25.974164 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f99133-0eac-4fae-b5ee-117f4838fdfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:25.999496 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f99133-0eac-4fae-b5ee-117f4838fdfd admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:26.009204 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1384/2765] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:06:25 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 21:06:26.013962 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154afa4-66bf-4d4c-b233-58fbe28ef6a7 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:26.023553 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154afa4-66bf-4d4c-b233-58fbe28ef6a7 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:26.028318 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f0bf4-4b38-43a1-be35-6b1775e0d8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:26.029119 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f0bf4-4b38-43a1-be35-6b1775e0d8cf admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:26.029408 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f0bf4-4b38-43a1-be35-6b1775e0d8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:26.029689 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f0bf4-4b38-43a1-be35-6b1775e0d8cf admin admin] PATH_INFO: `/v3/projects/2d09e89b3e8844e78f3a8dd9ca0afb95/users/9fcae700ae4741518777a9d8addb8b9e/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:26.031494 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f0bf4-4b38-43a1-be35-6b1775e0d8cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d09e89b3e8844e78f3a8dd9ca0afb95, user_id=9fcae700ae4741518777a9d8addb8b9e, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:26.058209 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f0bf4-4b38-43a1-be35-6b1775e0d8cf admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:26.071650 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1382/2766] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:06:26 2021] PUT /identity/v3/projects/2d09e89b3e8844e78f3a8dd9ca0afb95/users/9fcae700ae4741518777a9d8addb8b9e/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:06:26.082304 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcec2a-7a9c-4dad-a648-4edc52966154 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:26.082599 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcec2a-7a9c-4dad-a648-4edc52966154 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:26.082912 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcec2a-7a9c-4dad-a648-4edc52966154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:26.117466 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-33bcec2a-7a9c-4dad-a648-4edc52966154 None None] MFA Rules not processed for user `9fcae700ae4741518777a9d8addb8b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:06:26.118615 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-33bcec2a-7a9c-4dad-a648-4edc52966154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:26.191868 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1385/2767] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:06:26 2021] POST /identity/v3/auth/tokens => generated 3729 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:06:26.202990 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f0bf4-4b38-43a1-be35-6b1775e0d8cf admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:26.204563 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-ae4f0bf4-4b38-43a1-be35-6b1775e0d8cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:26.292260 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f0bf4-4b38-43a1-be35-6b1775e0d8cf admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:26.295525 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e960de6-8fc9-43db-ac8e-657f1f1eac83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:26.296092 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e960de6-8fc9-43db-ac8e-657f1f1eac83 service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:26.296375 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e960de6-8fc9-43db-ac8e-657f1f1eac83 service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:26.296653 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e960de6-8fc9-43db-ac8e-657f1f1eac83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:26.305180 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e960de6-8fc9-43db-ac8e-657f1f1eac83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:26.331379 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e960de6-8fc9-43db-ac8e-657f1f1eac83 service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:26.340502 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1383/2768] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:06:26 2021] GET /identity/v3/auth/tokens => generated 3729 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:06:26.437629 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcec2a-7a9c-4dad-a648-4edc52966154 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:26.446929 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcec2a-7a9c-4dad-a648-4edc52966154 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:26.450443 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372429d7-4ea4-4381-a9ec-f161a78f7616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:26.451043 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372429d7-4ea4-4381-a9ec-f161a78f7616 service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:26.451326 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372429d7-4ea4-4381-a9ec-f161a78f7616 service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:26.451606 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372429d7-4ea4-4381-a9ec-f161a78f7616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:26.515677 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372429d7-4ea4-4381-a9ec-f161a78f7616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:26.540468 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372429d7-4ea4-4381-a9ec-f161a78f7616 service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:26.549522 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1386/2769] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:06:26 2021] GET /identity/v3/auth/tokens => generated 3664 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:06:42.539066 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e960de6-8fc9-43db-ac8e-657f1f1eac83 service cinder] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:42.608123 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e960de6-8fc9-43db-ac8e-657f1f1eac83 service cinder] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:42.612424 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9c69b-3f90-4310-b7b4-7f64d288c145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:42.613252 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9c69b-3f90-4310-b7b4-7f64d288c145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:42.613542 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9c69b-3f90-4310-b7b4-7f64d288c145 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:42.613825 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9c69b-3f90-4310-b7b4-7f64d288c145 admin admin] PATH_INFO: `/v3/users/5d9b4d1a0067490ea4ec4349c49412eb` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:42.614953 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9c69b-3f90-4310-b7b4-7f64d288c145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d9b4d1a0067490ea4ec4349c49412eb)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:42.641495 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9c69b-3f90-4310-b7b4-7f64d288c145 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:42.687840 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-a4f9c69b-3f90-4310-b7b4-7f64d288c145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d9b4d1a0067490ea4ec4349c49412eb'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:42.688378 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-a4f9c69b-3f90-4310-b7b4-7f64d288c145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d9b4d1a0067490ea4ec4349c49412eb'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:42.695800 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-a4f9c69b-3f90-4310-b7b4-7f64d288c145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d9b4d1a0067490ea4ec4349c49412eb'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:42.707803 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-a4f9c69b-3f90-4310-b7b4-7f64d288c145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d9b4d1a0067490ea4ec4349c49412eb'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:42.714250 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-a4f9c69b-3f90-4310-b7b4-7f64d288c145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d9b4d1a0067490ea4ec4349c49412eb'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:42.719965 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1384/2770] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 21:06:42 2021] DELETE /identity/v3/users/5d9b4d1a0067490ea4ec4349c49412eb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:06:42.724474 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20cda0-36cc-451f-b413-573a0ca77dab None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:42.724967 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20cda0-36cc-451f-b413-573a0ca77dab None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:42.725063 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20cda0-36cc-451f-b413-573a0ca77dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:42.748740 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-bb20cda0-36cc-451f-b413-573a0ca77dab None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:06:42.749864 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-bb20cda0-36cc-451f-b413-573a0ca77dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:42.895013 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1387/2771] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:06:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:06:42.905231 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9c69b-3f90-4310-b7b4-7f64d288c145 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:42.906523 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-a4f9c69b-3f90-4310-b7b4-7f64d288c145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:42.969518 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9c69b-3f90-4310-b7b4-7f64d288c145 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:42.972654 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94287a-9b12-4e42-94dc-7d0144faa3cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:42.973220 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94287a-9b12-4e42-94dc-7d0144faa3cb service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:42.973505 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94287a-9b12-4e42-94dc-7d0144faa3cb service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:42.973784 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94287a-9b12-4e42-94dc-7d0144faa3cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:42.982923 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94287a-9b12-4e42-94dc-7d0144faa3cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:43.008310 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94287a-9b12-4e42-94dc-7d0144faa3cb service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:43.017257 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1385/2772] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:06:42 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:06:43.354898 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20cda0-36cc-451f-b413-573a0ca77dab None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:43.357032 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-bb20cda0-36cc-451f-b413-573a0ca77dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:43.368158 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20cda0-36cc-451f-b413-573a0ca77dab None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:43.372495 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0bc2a-8299-4d9f-85a1-91cc04a03b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:43.373275 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0bc2a-8299-4d9f-85a1-91cc04a03b9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:43.373561 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0bc2a-8299-4d9f-85a1-91cc04a03b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:43.373868 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0bc2a-8299-4d9f-85a1-91cc04a03b9d admin admin] PATH_INFO: `/v3/projects/cbe01083eec14181a9b123c4e2d9b56c` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:43.374967 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0bc2a-8299-4d9f-85a1-91cc04a03b9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbe01083eec14181a9b123c4e2d9b56c)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:43.400499 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0bc2a-8299-4d9f-85a1-91cc04a03b9d admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:43.449585 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-2bd0bc2a-8299-4d9f-85a1-91cc04a03b9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbe01083eec14181a9b123c4e2d9b56c', 'request_id': 'req-2bd0bc2a-8299-4d9f-85a1-91cc04a03b9d'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:43.456355 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-2bd0bc2a-8299-4d9f-85a1-91cc04a03b9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbe01083eec14181a9b123c4e2d9b56c', 'request_id': 'req-2bd0bc2a-8299-4d9f-85a1-91cc04a03b9d'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:43.467965 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-2bd0bc2a-8299-4d9f-85a1-91cc04a03b9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbe01083eec14181a9b123c4e2d9b56c', 'request_id': 'req-2bd0bc2a-8299-4d9f-85a1-91cc04a03b9d'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:43.477559 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-2bd0bc2a-8299-4d9f-85a1-91cc04a03b9d admin admin] The token cache is being invalidate because project cbe01083eec14181a9b123c4e2d9b56c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 21:06:43.477840 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-2bd0bc2a-8299-4d9f-85a1-91cc04a03b9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:43.478421 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-2bd0bc2a-8299-4d9f-85a1-91cc04a03b9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:43.479931 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1388/2773] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 21:06:43 2021] DELETE /identity/v3/projects/cbe01083eec14181a9b123c4e2d9b56c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:06:43.484558 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94287a-9b12-4e42-94dc-7d0144faa3cb service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:43.494179 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94287a-9b12-4e42-94dc-7d0144faa3cb service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:43.554962 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7755a-94ea-4a16-a63c-c7291b9b8bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:43.555687 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7755a-94ea-4a16-a63c-c7291b9b8bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:43.555973 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7755a-94ea-4a16-a63c-c7291b9b8bab admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:43.556255 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7755a-94ea-4a16-a63c-c7291b9b8bab admin admin] PATH_INFO: `/v3/users/9fcae700ae4741518777a9d8addb8b9e` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:43.557322 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7755a-94ea-4a16-a63c-c7291b9b8bab admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fcae700ae4741518777a9d8addb8b9e)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:43.583350 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7755a-94ea-4a16-a63c-c7291b9b8bab admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:43.630235 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-feb7755a-94ea-4a16-a63c-c7291b9b8bab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fcae700ae4741518777a9d8addb8b9e'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:43.630888 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-feb7755a-94ea-4a16-a63c-c7291b9b8bab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fcae700ae4741518777a9d8addb8b9e'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:43.639059 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-feb7755a-94ea-4a16-a63c-c7291b9b8bab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fcae700ae4741518777a9d8addb8b9e'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:43.650249 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-feb7755a-94ea-4a16-a63c-c7291b9b8bab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fcae700ae4741518777a9d8addb8b9e'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:43.656971 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-feb7755a-94ea-4a16-a63c-c7291b9b8bab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fcae700ae4741518777a9d8addb8b9e'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:43.662696 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1386/2774] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 21:06:43 2021] DELETE /identity/v3/users/9fcae700ae4741518777a9d8addb8b9e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:06:44.011029 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0bc2a-8299-4d9f-85a1-91cc04a03b9d admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:44.013107 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-2bd0bc2a-8299-4d9f-85a1-91cc04a03b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:44.024913 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0bc2a-8299-4d9f-85a1-91cc04a03b9d admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:44.086904 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4c078-afd8-4a76-ab7b-2810ff7c3a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:44.087762 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4c078-afd8-4a76-ab7b-2810ff7c3a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:44.088045 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4c078-afd8-4a76-ab7b-2810ff7c3a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:44.088322 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4c078-afd8-4a76-ab7b-2810ff7c3a79 admin admin] PATH_INFO: `/v3/projects/2d09e89b3e8844e78f3a8dd9ca0afb95` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:44.089374 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4c078-afd8-4a76-ab7b-2810ff7c3a79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d09e89b3e8844e78f3a8dd9ca0afb95)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:44.115637 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4c078-afd8-4a76-ab7b-2810ff7c3a79 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:44.162616 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-e6c4c078-afd8-4a76-ab7b-2810ff7c3a79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d09e89b3e8844e78f3a8dd9ca0afb95', 'request_id': 'req-e6c4c078-afd8-4a76-ab7b-2810ff7c3a79'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:44.168675 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-e6c4c078-afd8-4a76-ab7b-2810ff7c3a79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d09e89b3e8844e78f3a8dd9ca0afb95', 'request_id': 'req-e6c4c078-afd8-4a76-ab7b-2810ff7c3a79'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:44.179493 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-e6c4c078-afd8-4a76-ab7b-2810ff7c3a79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d09e89b3e8844e78f3a8dd9ca0afb95', 'request_id': 'req-e6c4c078-afd8-4a76-ab7b-2810ff7c3a79'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:44.189318 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-e6c4c078-afd8-4a76-ab7b-2810ff7c3a79 admin admin] The token cache is being invalidate because project 2d09e89b3e8844e78f3a8dd9ca0afb95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 21:06:44.189596 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-e6c4c078-afd8-4a76-ab7b-2810ff7c3a79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:44.190172 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-e6c4c078-afd8-4a76-ab7b-2810ff7c3a79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:44.191570 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1389/2775] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 21:06:44 2021] DELETE /identity/v3/projects/2d09e89b3e8844e78f3a8dd9ca0afb95 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:06:44.197358 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d615e-2796-47f5-804d-aa1dbb2034d2 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:44.197658 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d615e-2796-47f5-804d-aa1dbb2034d2 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:44.198211 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d615e-2796-47f5-804d-aa1dbb2034d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:44.220769 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-2d5d615e-2796-47f5-804d-aa1dbb2034d2 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:06:44.221902 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-2d5d615e-2796-47f5-804d-aa1dbb2034d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:44.284949 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1387/2776] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:06:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:06:44.293917 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87824f26-6ba0-4d24-bd87-9ac6caa7b1d2 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:44.294296 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87824f26-6ba0-4d24-bd87-9ac6caa7b1d2 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:44.294632 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87824f26-6ba0-4d24-bd87-9ac6caa7b1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:44.316527 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-87824f26-6ba0-4d24-bd87-9ac6caa7b1d2 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:06:44.317651 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-87824f26-6ba0-4d24-bd87-9ac6caa7b1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:44.325535 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1390/2777] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:06:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:06:44.329757 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d615e-2796-47f5-804d-aa1dbb2034d2 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:44.338874 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d615e-2796-47f5-804d-aa1dbb2034d2 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:44.343090 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9d25e-42b2-4d85-b9bf-f242e899ca1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:44.343666 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9d25e-42b2-4d85-b9bf-f242e899ca1d admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:44.343954 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9d25e-42b2-4d85-b9bf-f242e899ca1d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:44.344236 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9d25e-42b2-4d85-b9bf-f242e899ca1d admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:44.344919 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9d25e-42b2-4d85-b9bf-f242e899ca1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 21:06:44.345217 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9d25e-42b2-4d85-b9bf-f242e899ca1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:44.371112 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9d25e-42b2-4d85-b9bf-f242e899ca1d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:44.384520 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1388/2778] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 21:06:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 21:06:44.388824 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87824f26-6ba0-4d24-bd87-9ac6caa7b1d2 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:44.397569 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87824f26-6ba0-4d24-bd87-9ac6caa7b1d2 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:44.401765 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485c696-8020-4852-a95d-dc492887fd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:44.402337 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485c696-8020-4852-a95d-dc492887fd4a admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:44.402738 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485c696-8020-4852-a95d-dc492887fd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:44.403051 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485c696-8020-4852-a95d-dc492887fd4a admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:44.403681 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485c696-8020-4852-a95d-dc492887fd4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:44.429640 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485c696-8020-4852-a95d-dc492887fd4a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:44.456807 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1391/2779] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 21:06:44 2021] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 21:06:44.460873 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9d25e-42b2-4d85-b9bf-f242e899ca1d admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:44.470558 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9d25e-42b2-4d85-b9bf-f242e899ca1d admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:44.535469 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cce53-7646-4883-b62f-7195d5a4fafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:44.536067 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cce53-7646-4883-b62f-7195d5a4fafb admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:44.536359 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cce53-7646-4883-b62f-7195d5a4fafb admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:44.536642 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cce53-7646-4883-b62f-7195d5a4fafb admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:44.537286 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cce53-7646-4883-b62f-7195d5a4fafb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:44.568342 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cce53-7646-4883-b62f-7195d5a4fafb admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:44.588420 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1389/2780] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 21:06:44 2021] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 21:06:44.592848 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485c696-8020-4852-a95d-dc492887fd4a admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:44.602852 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485c696-8020-4852-a95d-dc492887fd4a admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:44.613361 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafabe20-a9a7-4656-ad21-2730c7f68d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:44.613972 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafabe20-a9a7-4656-ad21-2730c7f68d0b admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:44.614262 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafabe20-a9a7-4656-ad21-2730c7f68d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:44.614543 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafabe20-a9a7-4656-ad21-2730c7f68d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:44.615262 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafabe20-a9a7-4656-ad21-2730c7f68d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:44.641592 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafabe20-a9a7-4656-ad21-2730c7f68d0b admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:44.652115 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1392/2781] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:06:44 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 21:06:44.656302 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cce53-7646-4883-b62f-7195d5a4fafb admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:44.665583 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cce53-7646-4883-b62f-7195d5a4fafb admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:44.670857 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d655a-1921-44e4-840d-28f13b6d2c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:44.671672 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d655a-1921-44e4-840d-28f13b6d2c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:44.671947 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d655a-1921-44e4-840d-28f13b6d2c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:44.672227 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d655a-1921-44e4-840d-28f13b6d2c07 admin admin] PATH_INFO: `/v3/projects/68b5347e32734bbba0e6c96c64c06162/users/2fde9acc514c4fe594ebb3dbd8a42373/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:44.692438 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d655a-1921-44e4-840d-28f13b6d2c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68b5347e32734bbba0e6c96c64c06162, user_id=2fde9acc514c4fe594ebb3dbd8a42373, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:44.718961 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d655a-1921-44e4-840d-28f13b6d2c07 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:44.731494 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1390/2782] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:06:44 2021] PUT /identity/v3/projects/68b5347e32734bbba0e6c96c64c06162/users/2fde9acc514c4fe594ebb3dbd8a42373/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:06:44.741609 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f609a-4ecb-466e-93f4-2478d72b3855 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:44.741906 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f609a-4ecb-466e-93f4-2478d72b3855 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:44.742221 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f609a-4ecb-466e-93f4-2478d72b3855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:44.780879 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-961f609a-4ecb-466e-93f4-2478d72b3855 None None] MFA Rules not processed for user `2fde9acc514c4fe594ebb3dbd8a42373`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:06:44.782028 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-961f609a-4ecb-466e-93f4-2478d72b3855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:44.858306 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1393/2783] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:06:44 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 21:06:44.867767 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d655a-1921-44e4-840d-28f13b6d2c07 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:44.869460 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-976d655a-1921-44e4-840d-28f13b6d2c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:44.935188 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d655a-1921-44e4-840d-28f13b6d2c07 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:44.938635 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfbf5a-e8de-43df-9be3-6a9c8adb5862 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:44.939244 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfbf5a-e8de-43df-9be3-6a9c8adb5862 service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:44.939531 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfbf5a-e8de-43df-9be3-6a9c8adb5862 service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:44.939811 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfbf5a-e8de-43df-9be3-6a9c8adb5862 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:44.956213 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcfbf5a-e8de-43df-9be3-6a9c8adb5862 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:44.980399 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcfbf5a-e8de-43df-9be3-6a9c8adb5862 service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:44.993462 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1391/2784] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:06:44 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:06:53.988335 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f609a-4ecb-466e-93f4-2478d72b3855 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:54.055013 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f609a-4ecb-466e-93f4-2478d72b3855 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:54.059196 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6e7d7-b46f-4bc0-82e6-61af0194bb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:54.059999 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6e7d7-b46f-4bc0-82e6-61af0194bb19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:54.060288 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6e7d7-b46f-4bc0-82e6-61af0194bb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:54.060572 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6e7d7-b46f-4bc0-82e6-61af0194bb19 admin admin] PATH_INFO: `/v3/users/2fde9acc514c4fe594ebb3dbd8a42373` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:54.061657 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6e7d7-b46f-4bc0-82e6-61af0194bb19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fde9acc514c4fe594ebb3dbd8a42373)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:54.087391 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6e7d7-b46f-4bc0-82e6-61af0194bb19 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:54.134499 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-d4c6e7d7-b46f-4bc0-82e6-61af0194bb19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fde9acc514c4fe594ebb3dbd8a42373'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:54.146429 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-d4c6e7d7-b46f-4bc0-82e6-61af0194bb19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fde9acc514c4fe594ebb3dbd8a42373'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:54.147035 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-d4c6e7d7-b46f-4bc0-82e6-61af0194bb19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fde9acc514c4fe594ebb3dbd8a42373'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:54.155028 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-d4c6e7d7-b46f-4bc0-82e6-61af0194bb19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fde9acc514c4fe594ebb3dbd8a42373'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:54.161517 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-d4c6e7d7-b46f-4bc0-82e6-61af0194bb19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fde9acc514c4fe594ebb3dbd8a42373'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:54.167198 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1394/2785] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 21:06:53 2021] DELETE /identity/v3/users/2fde9acc514c4fe594ebb3dbd8a42373 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:06:54.171967 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59e5fe-e334-4382-abf9-6a1c81475d9f None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:54.172554 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59e5fe-e334-4382-abf9-6a1c81475d9f None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:54.172554 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59e5fe-e334-4382-abf9-6a1c81475d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:54.194565 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-6d59e5fe-e334-4382-abf9-6a1c81475d9f None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:06:54.195721 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-6d59e5fe-e334-4382-abf9-6a1c81475d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:54.258027 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1392/2786] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:06:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 21:06:54.268536 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6e7d7-b46f-4bc0-82e6-61af0194bb19 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:54.269841 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-d4c6e7d7-b46f-4bc0-82e6-61af0194bb19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:54.332059 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6e7d7-b46f-4bc0-82e6-61af0194bb19 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:54.335418 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98e4aa-087b-4c24-82ce-fbd72f60de13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:54.335984 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98e4aa-087b-4c24-82ce-fbd72f60de13 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:54.336273 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98e4aa-087b-4c24-82ce-fbd72f60de13 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:54.336555 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98e4aa-087b-4c24-82ce-fbd72f60de13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:54.345773 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98e4aa-087b-4c24-82ce-fbd72f60de13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:54.370642 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98e4aa-087b-4c24-82ce-fbd72f60de13 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:54.380043 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1395/2787] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:06:54 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:06:54.718555 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59e5fe-e334-4382-abf9-6a1c81475d9f None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:54.719926 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-6d59e5fe-e334-4382-abf9-6a1c81475d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:54.730898 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59e5fe-e334-4382-abf9-6a1c81475d9f None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:54.735041 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd01b49-cb60-406d-9a49-6eaccbd02d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:54.735818 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd01b49-cb60-406d-9a49-6eaccbd02d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:54.736105 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd01b49-cb60-406d-9a49-6eaccbd02d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:54.736387 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd01b49-cb60-406d-9a49-6eaccbd02d7d admin admin] PATH_INFO: `/v3/projects/68b5347e32734bbba0e6c96c64c06162` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:54.737475 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd01b49-cb60-406d-9a49-6eaccbd02d7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=68b5347e32734bbba0e6c96c64c06162)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:54.764065 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd01b49-cb60-406d-9a49-6eaccbd02d7d admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:54.812001 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-9bd01b49-cb60-406d-9a49-6eaccbd02d7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68b5347e32734bbba0e6c96c64c06162', 'request_id': 'req-9bd01b49-cb60-406d-9a49-6eaccbd02d7d'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:54.818583 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-9bd01b49-cb60-406d-9a49-6eaccbd02d7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68b5347e32734bbba0e6c96c64c06162', 'request_id': 'req-9bd01b49-cb60-406d-9a49-6eaccbd02d7d'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:54.823973 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-9bd01b49-cb60-406d-9a49-6eaccbd02d7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68b5347e32734bbba0e6c96c64c06162', 'request_id': 'req-9bd01b49-cb60-406d-9a49-6eaccbd02d7d'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:54.839678 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-9bd01b49-cb60-406d-9a49-6eaccbd02d7d admin admin] The token cache is being invalidate because project 68b5347e32734bbba0e6c96c64c06162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 21:06:54.839987 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-9bd01b49-cb60-406d-9a49-6eaccbd02d7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:54.840589 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-9bd01b49-cb60-406d-9a49-6eaccbd02d7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:54.841968 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1393/2788] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 21:06:54 2021] DELETE /identity/v3/projects/68b5347e32734bbba0e6c96c64c06162 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:06:54.847906 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5e8e5-8589-4bc4-9b13-1dac5d348a23 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:54.848202 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5e8e5-8589-4bc4-9b13-1dac5d348a23 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:54.848484 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5e8e5-8589-4bc4-9b13-1dac5d348a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:54.870793 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-6af5e8e5-8589-4bc4-9b13-1dac5d348a23 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:06:54.872652 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-6af5e8e5-8589-4bc4-9b13-1dac5d348a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:54.936225 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1396/2789] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:06:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:06:54.943770 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a04b95-6098-4b3f-b072-fbf14d79c4ff None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:54.944007 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a04b95-6098-4b3f-b072-fbf14d79c4ff None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:54.944321 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a04b95-6098-4b3f-b072-fbf14d79c4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:54.966741 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-a3a04b95-6098-4b3f-b072-fbf14d79c4ff None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:06:54.967885 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-a3a04b95-6098-4b3f-b072-fbf14d79c4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:54.974839 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1394/2790] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:06:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:06:54.978799 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5e8e5-8589-4bc4-9b13-1dac5d348a23 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:54.989113 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5e8e5-8589-4bc4-9b13-1dac5d348a23 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:54.993267 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51595242-aa96-4e86-8792-10a61c99f739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:54.993838 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51595242-aa96-4e86-8792-10a61c99f739 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:54.994123 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51595242-aa96-4e86-8792-10a61c99f739 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:54.994402 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51595242-aa96-4e86-8792-10a61c99f739 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:54.995100 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51595242-aa96-4e86-8792-10a61c99f739 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 21:06:54.995399 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51595242-aa96-4e86-8792-10a61c99f739 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:55.021167 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51595242-aa96-4e86-8792-10a61c99f739 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:55.034006 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1397/2791] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 21:06:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 21:06:55.038333 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a04b95-6098-4b3f-b072-fbf14d79c4ff None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:55.048029 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a04b95-6098-4b3f-b072-fbf14d79c4ff None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:55.052200 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bcc40-b08b-4b05-ae30-367d8d8b5c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:55.052774 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bcc40-b08b-4b05-ae30-367d8d8b5c4e admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:55.053059 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bcc40-b08b-4b05-ae30-367d8d8b5c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:55.053335 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bcc40-b08b-4b05-ae30-367d8d8b5c4e admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:55.053957 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bcc40-b08b-4b05-ae30-367d8d8b5c4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:55.080359 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bcc40-b08b-4b05-ae30-367d8d8b5c4e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:55.106611 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1395/2792] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 21:06:55 2021] POST /identity/v3/projects => generated 359 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 21:06:55.110763 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51595242-aa96-4e86-8792-10a61c99f739 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:55.120244 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51595242-aa96-4e86-8792-10a61c99f739 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:55.182228 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fd6f8-0490-4af8-a9ab-40967ea542f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:55.182837 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fd6f8-0490-4af8-a9ab-40967ea542f4 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:55.183135 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fd6f8-0490-4af8-a9ab-40967ea542f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:55.183409 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fd6f8-0490-4af8-a9ab-40967ea542f4 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:55.184731 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6fd6f8-0490-4af8-a9ab-40967ea542f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:55.210494 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6fd6f8-0490-4af8-a9ab-40967ea542f4 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:55.228945 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1398/2793] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 21:06:55 2021] POST /identity/v3/users => generated 280 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 21:06:55.233646 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bcc40-b08b-4b05-ae30-367d8d8b5c4e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:55.243313 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bcc40-b08b-4b05-ae30-367d8d8b5c4e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:55.248169 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18bd70-d12a-4371-b820-75b8293381fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:55.248759 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18bd70-d12a-4371-b820-75b8293381fc admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:55.249048 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18bd70-d12a-4371-b820-75b8293381fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:55.249333 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18bd70-d12a-4371-b820-75b8293381fc admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:55.250019 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18bd70-d12a-4371-b820-75b8293381fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:55.275420 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18bd70-d12a-4371-b820-75b8293381fc admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:55.285913 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1396/2794] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:06:55 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 21:06:55.290076 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fd6f8-0490-4af8-a9ab-40967ea542f4 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:55.299995 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fd6f8-0490-4af8-a9ab-40967ea542f4 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:55.304385 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153366e-760d-4162-a2ae-9d22cb1c1d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:55.305164 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153366e-760d-4162-a2ae-9d22cb1c1d04 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:55.305450 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153366e-760d-4162-a2ae-9d22cb1c1d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:55.305724 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153366e-760d-4162-a2ae-9d22cb1c1d04 admin admin] PATH_INFO: `/v3/projects/b4be52619e244d7cb8a287b4a4e66f09/users/2b488b7dab0d41168888137e536e27e6/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:55.325174 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153366e-760d-4162-a2ae-9d22cb1c1d04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4be52619e244d7cb8a287b4a4e66f09, user_id=2b488b7dab0d41168888137e536e27e6, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:55.351367 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153366e-760d-4162-a2ae-9d22cb1c1d04 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:55.363957 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1399/2795] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:06:55 2021] PUT /identity/v3/projects/b4be52619e244d7cb8a287b4a4e66f09/users/2b488b7dab0d41168888137e536e27e6/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:06:55.374775 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bde83b-9ae0-4ef2-8444-0bc11da2f391 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:55.375069 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bde83b-9ae0-4ef2-8444-0bc11da2f391 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:55.375349 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bde83b-9ae0-4ef2-8444-0bc11da2f391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:55.411820 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-69bde83b-9ae0-4ef2-8444-0bc11da2f391 None None] MFA Rules not processed for user `2b488b7dab0d41168888137e536e27e6`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:06:55.412946 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-69bde83b-9ae0-4ef2-8444-0bc11da2f391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:55.482896 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1397/2796] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:06:55 2021] POST /identity/v3/auth/tokens => generated 3666 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:06:55.509149 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2ef34-fb9f-44ee-9d18-c97d8a805b5a None None] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:55.509445 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2ef34-fb9f-44ee-9d18-c97d8a805b5a None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:55.509723 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2ef34-fb9f-44ee-9d18-c97d8a805b5a None None] PATH_INFO: `/` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:55.511444 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1400/2797] 10.222.0.37 () {54 vars in 961 bytes} [Wed Dec 29 21:06:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 29 21:06:55.516183 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e139f1-0f1e-47e1-a6b7-e3649cb48723 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:55.516476 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e139f1-0f1e-47e1-a6b7-e3649cb48723 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:55.516868 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e139f1-0f1e-47e1-a6b7-e3649cb48723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:55.577489 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-49e139f1-0f1e-47e1-a6b7-e3649cb48723 None None] MFA Rules not processed for user `72f5c4b1a0e942ae9a16cda3b34e0cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:06:55.578639 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-49e139f1-0f1e-47e1-a6b7-e3649cb48723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:55.636469 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1398/2798] 10.222.0.37 () {58 vars in 1058 bytes} [Wed Dec 29 21:06:55 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:06:55.644571 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2ef34-fb9f-44ee-9d18-c97d8a805b5a None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:55.655519 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2ef34-fb9f-44ee-9d18-c97d8a805b5a None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:55.663207 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3a76d-68c2-41e0-869f-12d521ad686e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:55.663779 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3a76d-68c2-41e0-869f-12d521ad686e service cinder] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:55.664070 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3a76d-68c2-41e0-869f-12d521ad686e service cinder] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:55.664352 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3a76d-68c2-41e0-869f-12d521ad686e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:55.673051 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3a76d-68c2-41e0-869f-12d521ad686e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:55.697691 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3a76d-68c2-41e0-869f-12d521ad686e service cinder] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:55.707286 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1401/2799] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:06:55 2021] GET /identity/v3/auth/tokens => generated 3666 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:06:55.859848 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e139f1-0f1e-47e1-a6b7-e3649cb48723 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:55.928463 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e139f1-0f1e-47e1-a6b7-e3649cb48723 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:55.932764 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895c638-102c-44c8-891e-3c515712a0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:55.933611 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895c638-102c-44c8-891e-3c515712a0a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:55.933947 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895c638-102c-44c8-891e-3c515712a0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:55.934320 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895c638-102c-44c8-891e-3c515712a0a5 admin admin] PATH_INFO: `/v3/users/2b488b7dab0d41168888137e536e27e6` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:55.935459 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895c638-102c-44c8-891e-3c515712a0a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b488b7dab0d41168888137e536e27e6)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:55.961737 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895c638-102c-44c8-891e-3c515712a0a5 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:56.008776 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6895c638-102c-44c8-891e-3c515712a0a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b488b7dab0d41168888137e536e27e6'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:56.009382 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6895c638-102c-44c8-891e-3c515712a0a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b488b7dab0d41168888137e536e27e6'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:56.017484 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6895c638-102c-44c8-891e-3c515712a0a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b488b7dab0d41168888137e536e27e6'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:56.028959 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6895c638-102c-44c8-891e-3c515712a0a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b488b7dab0d41168888137e536e27e6'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:56.035767 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-6895c638-102c-44c8-891e-3c515712a0a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b488b7dab0d41168888137e536e27e6'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:56.041754 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1399/2800] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 21:06:55 2021] DELETE /identity/v3/users/2b488b7dab0d41168888137e536e27e6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:06:56.046797 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818b685-8d7a-402f-8a2e-dabf070a548d None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:56.047289 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818b685-8d7a-402f-8a2e-dabf070a548d None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:56.047454 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818b685-8d7a-402f-8a2e-dabf070a548d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:56.069181 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-e818b685-8d7a-402f-8a2e-dabf070a548d None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:06:56.070297 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-e818b685-8d7a-402f-8a2e-dabf070a548d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:56.133546 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1402/2801] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:06:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:06:56.144107 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895c638-102c-44c8-891e-3c515712a0a5 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:56.145422 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-6895c638-102c-44c8-891e-3c515712a0a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:56.209840 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895c638-102c-44c8-891e-3c515712a0a5 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:56.213143 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc0142-cd80-4b2f-bf88-e9f971c9c227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:56.213716 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc0142-cd80-4b2f-bf88-e9f971c9c227 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:56.214003 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc0142-cd80-4b2f-bf88-e9f971c9c227 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:56.214284 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc0142-cd80-4b2f-bf88-e9f971c9c227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:56.223108 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc0142-cd80-4b2f-bf88-e9f971c9c227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:56.248497 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc0142-cd80-4b2f-bf88-e9f971c9c227 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:56.257272 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1400/2802] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:06:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:06:56.599147 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818b685-8d7a-402f-8a2e-dabf070a548d None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:56.600580 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-e818b685-8d7a-402f-8a2e-dabf070a548d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:56.613496 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818b685-8d7a-402f-8a2e-dabf070a548d None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:56.617716 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88adaa-f97d-474b-9478-af0b48028880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:56.618556 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88adaa-f97d-474b-9478-af0b48028880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:56.618883 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88adaa-f97d-474b-9478-af0b48028880 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:56.619170 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88adaa-f97d-474b-9478-af0b48028880 admin admin] PATH_INFO: `/v3/projects/b4be52619e244d7cb8a287b4a4e66f09` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:56.620239 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88adaa-f97d-474b-9478-af0b48028880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4be52619e244d7cb8a287b4a4e66f09)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:56.646438 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88adaa-f97d-474b-9478-af0b48028880 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:56.695821 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-0b88adaa-f97d-474b-9478-af0b48028880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4be52619e244d7cb8a287b4a4e66f09', 'request_id': 'req-0b88adaa-f97d-474b-9478-af0b48028880'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:56.702977 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-0b88adaa-f97d-474b-9478-af0b48028880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4be52619e244d7cb8a287b4a4e66f09', 'request_id': 'req-0b88adaa-f97d-474b-9478-af0b48028880'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:56.713628 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-0b88adaa-f97d-474b-9478-af0b48028880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4be52619e244d7cb8a287b4a4e66f09', 'request_id': 'req-0b88adaa-f97d-474b-9478-af0b48028880'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:56.723169 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-0b88adaa-f97d-474b-9478-af0b48028880 admin admin] The token cache is being invalidate because project b4be52619e244d7cb8a287b4a4e66f09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 21:06:56.723450 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-0b88adaa-f97d-474b-9478-af0b48028880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:56.724026 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-0b88adaa-f97d-474b-9478-af0b48028880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:06:56.725394 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1403/2803] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 21:06:56 2021] DELETE /identity/v3/projects/b4be52619e244d7cb8a287b4a4e66f09 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:06:56.731674 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d6760-d0d5-48f1-8c0a-26e65f90fccc None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:56.731967 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d6760-d0d5-48f1-8c0a-26e65f90fccc None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:56.732247 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d6760-d0d5-48f1-8c0a-26e65f90fccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:56.756549 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-256d6760-d0d5-48f1-8c0a-26e65f90fccc None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:06:56.757685 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-256d6760-d0d5-48f1-8c0a-26e65f90fccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:56.823585 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1401/2804] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:06:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 21:06:56.831446 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6444a3c-8fa0-43c3-b6da-cb66af804473 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:56.831739 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6444a3c-8fa0-43c3-b6da-cb66af804473 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:56.832022 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6444a3c-8fa0-43c3-b6da-cb66af804473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:56.853949 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-c6444a3c-8fa0-43c3-b6da-cb66af804473 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:06:56.855109 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c6444a3c-8fa0-43c3-b6da-cb66af804473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:56.862793 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1404/2805] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:06:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:06:56.866540 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d6760-d0d5-48f1-8c0a-26e65f90fccc None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:56.875934 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d6760-d0d5-48f1-8c0a-26e65f90fccc None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:56.880137 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43316ba-6b85-4b22-9e06-ea6138bed223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:56.880719 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43316ba-6b85-4b22-9e06-ea6138bed223 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:56.881007 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43316ba-6b85-4b22-9e06-ea6138bed223 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:56.881289 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43316ba-6b85-4b22-9e06-ea6138bed223 admin admin] PATH_INFO: `/v3/domains` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:56.881972 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43316ba-6b85-4b22-9e06-ea6138bed223 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66050) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 21:06:56.882271 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43316ba-6b85-4b22-9e06-ea6138bed223 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:56.908605 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43316ba-6b85-4b22-9e06-ea6138bed223 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:56.922259 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1402/2806] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 21:06:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 21:06:56.926574 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6444a3c-8fa0-43c3-b6da-cb66af804473 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:56.935548 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6444a3c-8fa0-43c3-b6da-cb66af804473 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:56.939747 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb82967-52e1-45ee-8980-9b84d988dd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:56.940321 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb82967-52e1-45ee-8980-9b84d988dd22 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:56.940610 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb82967-52e1-45ee-8980-9b84d988dd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:56.940890 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb82967-52e1-45ee-8980-9b84d988dd22 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:56.941514 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb82967-52e1-45ee-8980-9b84d988dd22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:56.967745 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb82967-52e1-45ee-8980-9b84d988dd22 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:56.994260 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1405/2807] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 21:06:56 2021] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 21:06:56.998354 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43316ba-6b85-4b22-9e06-ea6138bed223 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:57.007750 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43316ba-6b85-4b22-9e06-ea6138bed223 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:57.070474 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80775f-157c-4168-91e5-6fd67737aa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:57.071095 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80775f-157c-4168-91e5-6fd67737aa76 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:57.071382 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80775f-157c-4168-91e5-6fd67737aa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:57.071661 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80775f-157c-4168-91e5-6fd67737aa76 admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:57.072298 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80775f-157c-4168-91e5-6fd67737aa76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:57.098970 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80775f-157c-4168-91e5-6fd67737aa76 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:57.117424 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1403/2808] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 21:06:56 2021] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 21:06:57.122211 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb82967-52e1-45ee-8980-9b84d988dd22 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:57.131897 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb82967-52e1-45ee-8980-9b84d988dd22 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:57.136061 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580ec80-767b-43a2-bd36-686325e69573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:57.136715 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580ec80-767b-43a2-bd36-686325e69573 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:57.137019 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580ec80-767b-43a2-bd36-686325e69573 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:57.137321 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580ec80-767b-43a2-bd36-686325e69573 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:57.138022 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580ec80-767b-43a2-bd36-686325e69573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:57.163090 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580ec80-767b-43a2-bd36-686325e69573 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:57.173440 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1406/2809] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:06:57 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 21:06:57.177487 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80775f-157c-4168-91e5-6fd67737aa76 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:57.187644 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80775f-157c-4168-91e5-6fd67737aa76 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:57.192340 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5af05-e272-4493-95f3-aebe114853f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:57.193149 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5af05-e272-4493-95f3-aebe114853f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:57.193434 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5af05-e272-4493-95f3-aebe114853f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:57.193715 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5af05-e272-4493-95f3-aebe114853f2 admin admin] PATH_INFO: `/v3/projects/825eaed02501461699a2c92b3f3782ff/users/950f55cc079449d08b78c1e75d490210/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:57.213405 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5af05-e272-4493-95f3-aebe114853f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=825eaed02501461699a2c92b3f3782ff, user_id=950f55cc079449d08b78c1e75d490210, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:57.240072 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5af05-e272-4493-95f3-aebe114853f2 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:57.252950 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1404/2810] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:06:57 2021] PUT /identity/v3/projects/825eaed02501461699a2c92b3f3782ff/users/950f55cc079449d08b78c1e75d490210/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:06:57.264116 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d87fa1-e8fc-4894-9402-a81acaec1bcf None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:57.264437 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d87fa1-e8fc-4894-9402-a81acaec1bcf None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:57.264722 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d87fa1-e8fc-4894-9402-a81acaec1bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:57.300038 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-86d87fa1-e8fc-4894-9402-a81acaec1bcf None None] MFA Rules not processed for user `950f55cc079449d08b78c1e75d490210`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:06:57.301181 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-86d87fa1-e8fc-4894-9402-a81acaec1bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:57.372217 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1407/2811] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:06:57 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:06:57.382076 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5af05-e272-4493-95f3-aebe114853f2 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:06:57.383675 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-bbe5af05-e272-4493-95f3-aebe114853f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:06:57.446134 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5af05-e272-4493-95f3-aebe114853f2 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:06:57.449879 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9bece-1b72-4ae3-a6c0-a0cd0372872d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f5c4b1a0e942ae9a16cda3b34e0cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:06:57.450450 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9bece-1b72-4ae3-a6c0-a0cd0372872d service cinder] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:06:57.450765 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9bece-1b72-4ae3-a6c0-a0cd0372872d service cinder] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:06:57.451047 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9bece-1b72-4ae3-a6c0-a0cd0372872d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:06:57.459034 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9bece-1b72-4ae3-a6c0-a0cd0372872d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:06:57.484563 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9bece-1b72-4ae3-a6c0-a0cd0372872d service cinder] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:06:57.492876 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1405/2812] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:06:57 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:07:20.630119 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d87fa1-e8fc-4894-9402-a81acaec1bcf None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:07:20.696981 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d87fa1-e8fc-4894-9402-a81acaec1bcf None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:07:20.701283 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71604427-af9b-4b76-95ea-fcfb98bc1d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:07:20.702631 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71604427-af9b-4b76-95ea-fcfb98bc1d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:20.703144 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71604427-af9b-4b76-95ea-fcfb98bc1d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:20.703429 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71604427-af9b-4b76-95ea-fcfb98bc1d4f admin admin] PATH_INFO: `/v3/users/950f55cc079449d08b78c1e75d490210` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:20.704500 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71604427-af9b-4b76-95ea-fcfb98bc1d4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=950f55cc079449d08b78c1e75d490210)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:07:20.729563 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71604427-af9b-4b76-95ea-fcfb98bc1d4f admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:07:20.775803 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-71604427-af9b-4b76-95ea-fcfb98bc1d4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '950f55cc079449d08b78c1e75d490210'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:07:20.787101 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-71604427-af9b-4b76-95ea-fcfb98bc1d4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '950f55cc079449d08b78c1e75d490210'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:07:20.787715 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-71604427-af9b-4b76-95ea-fcfb98bc1d4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '950f55cc079449d08b78c1e75d490210'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:07:20.795066 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-71604427-af9b-4b76-95ea-fcfb98bc1d4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '950f55cc079449d08b78c1e75d490210'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:07:20.802625 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-71604427-af9b-4b76-95ea-fcfb98bc1d4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '950f55cc079449d08b78c1e75d490210'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:07:20.808976 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1408/2813] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 21:07:20 2021] DELETE /identity/v3/users/950f55cc079449d08b78c1e75d490210 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:07:20.814552 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed2a2a-c32c-4c7a-8f46-8490dc9888c3 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:20.815085 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed2a2a-c32c-4c7a-8f46-8490dc9888c3 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:20.815196 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed2a2a-c32c-4c7a-8f46-8490dc9888c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:20.837906 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-eaed2a2a-c32c-4c7a-8f46-8490dc9888c3 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:07:20.839094 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-eaed2a2a-c32c-4c7a-8f46-8490dc9888c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:07:20.904341 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1406/2814] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:07:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 29 21:07:20.914255 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71604427-af9b-4b76-95ea-fcfb98bc1d4f admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:07:20.915563 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-71604427-af9b-4b76-95ea-fcfb98bc1d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:07:20.977107 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71604427-af9b-4b76-95ea-fcfb98bc1d4f admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:07:20.980427 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35de76-0aef-4019-ab7f-9998a88e52c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:07:20.980996 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35de76-0aef-4019-ab7f-9998a88e52c6 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:20.981286 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35de76-0aef-4019-ab7f-9998a88e52c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:20.981563 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35de76-0aef-4019-ab7f-9998a88e52c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:20.990172 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35de76-0aef-4019-ab7f-9998a88e52c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:07:21.016252 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35de76-0aef-4019-ab7f-9998a88e52c6 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:07:21.025113 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1409/2815] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:07:20 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:07:21.392121 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed2a2a-c32c-4c7a-8f46-8490dc9888c3 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:07:21.393556 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-eaed2a2a-c32c-4c7a-8f46-8490dc9888c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:07:21.404379 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed2a2a-c32c-4c7a-8f46-8490dc9888c3 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:07:21.409286 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3429e48-fc20-4c41-85c0-771e247a12a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:07:21.410006 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3429e48-fc20-4c41-85c0-771e247a12a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:21.410290 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3429e48-fc20-4c41-85c0-771e247a12a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:21.410709 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3429e48-fc20-4c41-85c0-771e247a12a2 admin admin] PATH_INFO: `/v3/projects/825eaed02501461699a2c92b3f3782ff` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:21.411995 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3429e48-fc20-4c41-85c0-771e247a12a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=825eaed02501461699a2c92b3f3782ff)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:07:21.439126 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3429e48-fc20-4c41-85c0-771e247a12a2 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:07:21.487307 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-b3429e48-fc20-4c41-85c0-771e247a12a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '825eaed02501461699a2c92b3f3782ff', 'request_id': 'req-b3429e48-fc20-4c41-85c0-771e247a12a2'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:07:21.494077 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-b3429e48-fc20-4c41-85c0-771e247a12a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '825eaed02501461699a2c92b3f3782ff', 'request_id': 'req-b3429e48-fc20-4c41-85c0-771e247a12a2'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:07:21.499579 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-b3429e48-fc20-4c41-85c0-771e247a12a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '825eaed02501461699a2c92b3f3782ff', 'request_id': 'req-b3429e48-fc20-4c41-85c0-771e247a12a2'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:07:21.515412 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-b3429e48-fc20-4c41-85c0-771e247a12a2 admin admin] The token cache is being invalidate because project 825eaed02501461699a2c92b3f3782ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 21:07:21.515700 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-b3429e48-fc20-4c41-85c0-771e247a12a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:07:21.516297 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-b3429e48-fc20-4c41-85c0-771e247a12a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:07:21.517744 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1407/2816] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 21:07:21 2021] DELETE /identity/v3/projects/825eaed02501461699a2c92b3f3782ff => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:07:21.525189 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465adcf-cc3d-440f-bc75-f8d8c03ffe65 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:21.525485 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465adcf-cc3d-440f-bc75-f8d8c03ffe65 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:21.525768 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465adcf-cc3d-440f-bc75-f8d8c03ffe65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:21.547627 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-c465adcf-cc3d-440f-bc75-f8d8c03ffe65 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:07:21.548753 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c465adcf-cc3d-440f-bc75-f8d8c03ffe65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:07:21.612421 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1410/2817] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:07:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:07:21.620491 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cda20-8596-44d9-816c-b87246c811e3 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:21.620785 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cda20-8596-44d9-816c-b87246c811e3 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:21.621068 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cda20-8596-44d9-816c-b87246c811e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:21.642892 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-3f2cda20-8596-44d9-816c-b87246c811e3 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:07:21.644029 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-3f2cda20-8596-44d9-816c-b87246c811e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:07:21.650909 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1408/2818] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:07:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:07:21.655032 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465adcf-cc3d-440f-bc75-f8d8c03ffe65 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:07:21.664924 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465adcf-cc3d-440f-bc75-f8d8c03ffe65 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:07:21.669048 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd99c6-7afe-4053-a080-896df1737242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:07:21.669628 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd99c6-7afe-4053-a080-896df1737242 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:21.669918 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd99c6-7afe-4053-a080-896df1737242 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:21.670203 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd99c6-7afe-4053-a080-896df1737242 admin admin] PATH_INFO: `/v3/domains` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:21.671549 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd99c6-7afe-4053-a080-896df1737242 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 29 21:07:21.671872 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd99c6-7afe-4053-a080-896df1737242 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:07:21.697156 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd99c6-7afe-4053-a080-896df1737242 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:07:21.709897 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1411/2819] 10.222.0.37 () {58 vars in 1152 bytes} [Wed Dec 29 21:07:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 29 21:07:21.714000 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2cda20-8596-44d9-816c-b87246c811e3 None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:07:21.723289 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2cda20-8596-44d9-816c-b87246c811e3 None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:07:21.727475 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38348aeb-3798-480e-9118-a7c153fd9532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:07:21.728052 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38348aeb-3798-480e-9118-a7c153fd9532 admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:21.728335 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38348aeb-3798-480e-9118-a7c153fd9532 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:21.728614 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38348aeb-3798-480e-9118-a7c153fd9532 admin admin] PATH_INFO: `/v3/projects` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:21.729274 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38348aeb-3798-480e-9118-a7c153fd9532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:07:21.755745 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38348aeb-3798-480e-9118-a7c153fd9532 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:07:21.782776 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1409/2820] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 21:07:21 2021] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 21:07:21.786770 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd99c6-7afe-4053-a080-896df1737242 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:07:21.796270 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd99c6-7afe-4053-a080-896df1737242 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:07:21.859254 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bedd596-9970-4154-ae9a-aa1a99aae464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:07:21.859840 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedd596-9970-4154-ae9a-aa1a99aae464 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:21.860125 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedd596-9970-4154-ae9a-aa1a99aae464 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:21.860403 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedd596-9970-4154-ae9a-aa1a99aae464 admin admin] PATH_INFO: `/v3/users` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:21.861034 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bedd596-9970-4154-ae9a-aa1a99aae464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:07:21.886587 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bedd596-9970-4154-ae9a-aa1a99aae464 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:07:21.906465 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1412/2821] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 21:07:21 2021] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 21:07:21.910551 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38348aeb-3798-480e-9118-a7c153fd9532 admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:07:21.920514 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38348aeb-3798-480e-9118-a7c153fd9532 admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:07:21.924716 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98e48c-9b12-41b7-83e6-2e33d8b619d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:07:21.925305 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98e48c-9b12-41b7-83e6-2e33d8b619d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:21.925594 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98e48c-9b12-41b7-83e6-2e33d8b619d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:21.925875 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98e48c-9b12-41b7-83e6-2e33d8b619d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:21.926560 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98e48c-9b12-41b7-83e6-2e33d8b619d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:07:21.952988 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98e48c-9b12-41b7-83e6-2e33d8b619d3 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:07:21.962927 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1410/2822] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:07:21 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 21:07:21.966940 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bedd596-9970-4154-ae9a-aa1a99aae464 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:07:21.976928 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bedd596-9970-4154-ae9a-aa1a99aae464 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:07:21.981092 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6a7f1-361b-40d6-aefd-ed1091e6cce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:07:21.981888 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6a7f1-361b-40d6-aefd-ed1091e6cce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:21.982179 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6a7f1-361b-40d6-aefd-ed1091e6cce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:21.982456 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6a7f1-361b-40d6-aefd-ed1091e6cce3 admin admin] PATH_INFO: `/v3/projects/aaeebc5bdfd54075a4cb9417e98320c5/users/f39c796fca024d12ae6c6c7c4c0b1980/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:22.001585 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6a7f1-361b-40d6-aefd-ed1091e6cce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaeebc5bdfd54075a4cb9417e98320c5, user_id=f39c796fca024d12ae6c6c7c4c0b1980, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:07:22.027943 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6a7f1-361b-40d6-aefd-ed1091e6cce3 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:07:22.041625 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1413/2823] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:07:21 2021] PUT /identity/v3/projects/aaeebc5bdfd54075a4cb9417e98320c5/users/f39c796fca024d12ae6c6c7c4c0b1980/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 21:07:22.047178 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23ddde-f025-4a7b-a88c-881b8a305b66 None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:22.047479 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23ddde-f025-4a7b-a88c-881b8a305b66 None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:22.047787 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23ddde-f025-4a7b-a88c-881b8a305b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:22.069198 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-ea23ddde-f025-4a7b-a88c-881b8a305b66 None None] MFA Rules not processed for user `a36a939159da4f1da66be9e4aad8ddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:07:22.070324 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-ea23ddde-f025-4a7b-a88c-881b8a305b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:07:22.132429 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1411/2824] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:07:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:07:22.143011 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6a7f1-361b-40d6-aefd-ed1091e6cce3 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:07:22.144580 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-30a6a7f1-361b-40d6-aefd-ed1091e6cce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:07:22.207637 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6a7f1-361b-40d6-aefd-ed1091e6cce3 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:07:22.211006 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c78cf-a26d-4694-9d8a-4913c7370170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:07:22.211575 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c78cf-a26d-4694-9d8a-4913c7370170 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:22.211863 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c78cf-a26d-4694-9d8a-4913c7370170 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:22.212145 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c78cf-a26d-4694-9d8a-4913c7370170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:22.221237 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c78cf-a26d-4694-9d8a-4913c7370170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:07:22.246175 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c78cf-a26d-4694-9d8a-4913c7370170 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:07:22.255910 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1414/2825] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:07:22 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:07:27.096296 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8703c4e-7795-449d-a0b7-a915f6f41d1f None None] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:27.096807 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8703c4e-7795-449d-a0b7-a915f6f41d1f None None] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:27.097137 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8703c4e-7795-449d-a0b7-a915f6f41d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:27.135775 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.auth.core [None req-a8703c4e-7795-449d-a0b7-a915f6f41d1f None None] MFA Rules not processed for user `f39c796fca024d12ae6c6c7c4c0b1980`. Rule list: `[]` (Enabled: `True`). {{(pid=66050) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:07:27.136959 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-a8703c4e-7795-449d-a0b7-a915f6f41d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:07:27.214890 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1412/2826] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:07:27 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:07:27.219506 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c78cf-a26d-4694-9d8a-4913c7370170 service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:07:27.228887 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c78cf-a26d-4694-9d8a-4913c7370170 service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:07:27.233774 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4bafd-ecc3-4d14-ac2c-7f29a3e44068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:07:27.234353 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4bafd-ecc3-4d14-ac2c-7f29a3e44068 admin admin] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:27.234645 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4bafd-ecc3-4d14-ac2c-7f29a3e44068 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:27.235064 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4bafd-ecc3-4d14-ac2c-7f29a3e44068 admin admin] PATH_INFO: `/v3/projects` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:27.235692 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4bafd-ecc3-4d14-ac2c-7f29a3e44068 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:07:27.266821 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4bafd-ecc3-4d14-ac2c-7f29a3e44068 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:07:27.301066 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1415/2827] 10.222.0.37 () {60 vars in 1152 bytes} [Wed Dec 29 21:07:27 2021] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 29 21:07:27.304679 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8703c4e-7795-449d-a0b7-a915f6f41d1f None None] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:07:27.315932 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8703c4e-7795-449d-a0b7-a915f6f41d1f None None] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:07:27.382539 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4ae8a-4f43-4d8c-88de-eb97760169bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:07:27.383470 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4ae8a-4f43-4d8c-88de-eb97760169bd admin admin] REQUEST_METHOD: `POST` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:27.383759 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4ae8a-4f43-4d8c-88de-eb97760169bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:27.384035 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4ae8a-4f43-4d8c-88de-eb97760169bd admin admin] PATH_INFO: `/v3/users` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:27.384890 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4ae8a-4f43-4d8c-88de-eb97760169bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:07:27.412229 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4ae8a-4f43-4d8c-88de-eb97760169bd admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:07:27.432795 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1413/2828] 10.222.0.37 () {60 vars in 1143 bytes} [Wed Dec 29 21:07:27 2021] POST /identity/v3/users => generated 298 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 29 21:07:27.437680 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4bafd-ecc3-4d14-ac2c-7f29a3e44068 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:07:27.448654 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4bafd-ecc3-4d14-ac2c-7f29a3e44068 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:07:27.453845 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748cb8f-0ed7-465a-96d1-e9656bd8a949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:07:27.454442 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748cb8f-0ed7-465a-96d1-e9656bd8a949 admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:27.454824 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748cb8f-0ed7-465a-96d1-e9656bd8a949 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:27.455111 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748cb8f-0ed7-465a-96d1-e9656bd8a949 admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:27.455797 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748cb8f-0ed7-465a-96d1-e9656bd8a949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:07:27.481037 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748cb8f-0ed7-465a-96d1-e9656bd8a949 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:07:27.491868 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1416/2829] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:07:27 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 21:07:27.496161 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4ae8a-4f43-4d8c-88de-eb97760169bd admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:07:27.507708 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4ae8a-4f43-4d8c-88de-eb97760169bd admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:07:27.512164 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101df855-c7fb-456d-b4c0-94e5b58d91de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:07:27.513073 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101df855-c7fb-456d-b4c0-94e5b58d91de admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:27.513441 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101df855-c7fb-456d-b4c0-94e5b58d91de admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:27.513792 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101df855-c7fb-456d-b4c0-94e5b58d91de admin admin] PATH_INFO: `/v3/projects/c802e57ed8264652bbef931908aebf69/users/634a331ade7045f388f347b43605f4e5/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:27.535508 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101df855-c7fb-456d-b4c0-94e5b58d91de admin admin] RBAC: Authorizing `identity:create_grant(project_id=c802e57ed8264652bbef931908aebf69, user_id=634a331ade7045f388f347b43605f4e5, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:07:27.563199 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101df855-c7fb-456d-b4c0-94e5b58d91de admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:07:27.578328 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1414/2830] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:07:27 2021] PUT /identity/v3/projects/c802e57ed8264652bbef931908aebf69/users/634a331ade7045f388f347b43605f4e5/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:07:27.582216 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748cb8f-0ed7-465a-96d1-e9656bd8a949 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:07:27.592329 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748cb8f-0ed7-465a-96d1-e9656bd8a949 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:07:27.662276 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb04e04-4b5c-4c5b-8f12-ac44e67c81ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:07:27.666839 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb04e04-4b5c-4c5b-8f12-ac44e67c81ae admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:27.666839 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb04e04-4b5c-4c5b-8f12-ac44e67c81ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:27.666839 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb04e04-4b5c-4c5b-8f12-ac44e67c81ae admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:27.666839 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb04e04-4b5c-4c5b-8f12-ac44e67c81ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:07:27.699489 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb04e04-4b5c-4c5b-8f12-ac44e67c81ae admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:07:27.712332 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1417/2831] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:07:27 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 29 21:07:27.715192 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101df855-c7fb-456d-b4c0-94e5b58d91de admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:07:27.727529 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101df855-c7fb-456d-b4c0-94e5b58d91de admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:07:27.731888 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3dda2d-4269-4bef-a962-68762d41c84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:07:27.732673 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dda2d-4269-4bef-a962-68762d41c84b admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:27.732957 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dda2d-4269-4bef-a962-68762d41c84b admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:27.733337 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dda2d-4269-4bef-a962-68762d41c84b admin admin] PATH_INFO: `/v3/projects/c802e57ed8264652bbef931908aebf69/users/634a331ade7045f388f347b43605f4e5/roles/e66e6a94ba014fd193b851ceb92695ae` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:27.735344 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3dda2d-4269-4bef-a962-68762d41c84b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c802e57ed8264652bbef931908aebf69, user_id=634a331ade7045f388f347b43605f4e5, role_id=e66e6a94ba014fd193b851ceb92695ae)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:07:27.762328 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3dda2d-4269-4bef-a962-68762d41c84b admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:07:27.774143 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1415/2832] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:07:27 2021] PUT /identity/v3/projects/c802e57ed8264652bbef931908aebf69/users/634a331ade7045f388f347b43605f4e5/roles/e66e6a94ba014fd193b851ceb92695ae => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:07:27.778131 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb04e04-4b5c-4c5b-8f12-ac44e67c81ae admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:07:27.788443 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb04e04-4b5c-4c5b-8f12-ac44e67c81ae admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:07:27.855773 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6782b4b-b4da-4ae1-9a61-d647403a236a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:07:27.856375 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6782b4b-b4da-4ae1-9a61-d647403a236a admin admin] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:27.856670 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6782b4b-b4da-4ae1-9a61-d647403a236a admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:27.856948 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6782b4b-b4da-4ae1-9a61-d647403a236a admin admin] PATH_INFO: `/v3/roles` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:27.857641 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6782b4b-b4da-4ae1-9a61-d647403a236a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:07:27.884649 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6782b4b-b4da-4ae1-9a61-d647403a236a admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:07:27.895715 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1418/2833] 10.222.0.37 () {58 vars in 1121 bytes} [Wed Dec 29 21:07:27 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 29 21:07:27.899861 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3dda2d-4269-4bef-a962-68762d41c84b admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:07:27.910645 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3dda2d-4269-4bef-a962-68762d41c84b admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:07:27.915168 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb378a-8502-4c9a-919f-058a10004a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:07:27.916087 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb378a-8502-4c9a-919f-058a10004a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:27.916446 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb378a-8502-4c9a-919f-058a10004a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:27.916841 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb378a-8502-4c9a-919f-058a10004a9e admin admin] PATH_INFO: `/v3/projects/c802e57ed8264652bbef931908aebf69/users/634a331ade7045f388f347b43605f4e5/roles/b70e4a80dd884df58c908e9f9512f589` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:27.918646 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb378a-8502-4c9a-919f-058a10004a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c802e57ed8264652bbef931908aebf69, user_id=634a331ade7045f388f347b43605f4e5, role_id=b70e4a80dd884df58c908e9f9512f589)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:07:27.946911 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb378a-8502-4c9a-919f-058a10004a9e admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:07:27.961582 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1416/2834] 10.222.0.37 () {60 vars in 1482 bytes} [Wed Dec 29 21:07:27 2021] PUT /identity/v3/projects/c802e57ed8264652bbef931908aebf69/users/634a331ade7045f388f347b43605f4e5/roles/b70e4a80dd884df58c908e9f9512f589 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:07:33.063825 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241c88d-e343-4233-a880-becbd0d31fdd None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:33.064333 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241c88d-e343-4233-a880-becbd0d31fdd None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:33.064446 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241c88d-e343-4233-a880-becbd0d31fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:33.101853 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-8241c88d-e343-4233-a880-becbd0d31fdd None None] MFA Rules not processed for user `634a331ade7045f388f347b43605f4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:07:33.103144 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-8241c88d-e343-4233-a880-becbd0d31fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:07:33.181107 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1419/2835] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:07:33 2021] POST /identity/v3/auth/tokens => generated 3757 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:07:33.193127 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb378a-8502-4c9a-919f-058a10004a9e admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:07:33.194769 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-73bb378a-8502-4c9a-919f-058a10004a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:07:33.257477 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb378a-8502-4c9a-919f-058a10004a9e admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:07:33.260724 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0d230-a069-4610-8ecc-9b3395648467 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1976a528ee24585bcaccc83e308fec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:07:33.261291 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0d230-a069-4610-8ecc-9b3395648467 service glance] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:33.261579 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0d230-a069-4610-8ecc-9b3395648467 service glance] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:33.261861 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0d230-a069-4610-8ecc-9b3395648467 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:33.326505 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0d230-a069-4610-8ecc-9b3395648467 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:07:33.352826 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0d230-a069-4610-8ecc-9b3395648467 service glance] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:07:33.362219 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1417/2836] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:07:33 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 21:07:33.462574 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6bfd3-667b-4767-8280-92161e0060e4 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:33.462913 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6bfd3-667b-4767-8280-92161e0060e4 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:33.463202 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6bfd3-667b-4767-8280-92161e0060e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:33.485206 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-c8a6bfd3-667b-4767-8280-92161e0060e4 None None] MFA Rules not processed for user `1959af22edbf47cd8afca70831d476c0`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:07:33.486342 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c8a6bfd3-667b-4767-8280-92161e0060e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:07:33.548535 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1420/2837] 10.222.0.37 () {58 vars in 1014 bytes} [Wed Dec 29 21:07:33 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:07:33.597472 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0d230-a069-4610-8ecc-9b3395648467 service glance] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:07:33.598845 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-05b0d230-a069-4610-8ecc-9b3395648467 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:07:33.678038 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0d230-a069-4610-8ecc-9b3395648467 service glance] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:07:33.682372 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f07bb-da95-408b-98a0-fa653d5aef30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd2861e377640c9b76d0dfb08cf088e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:07:33.682978 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f07bb-da95-408b-98a0-fa653d5aef30 service swift] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:33.683265 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f07bb-da95-408b-98a0-fa653d5aef30 service swift] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:33.683545 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f07bb-da95-408b-98a0-fa653d5aef30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:33.691461 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f07bb-da95-408b-98a0-fa653d5aef30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:07:33.716805 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f07bb-da95-408b-98a0-fa653d5aef30 service swift] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:07:33.725426 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1418/2838] 10.222.0.37 () {60 vars in 1384 bytes} [Wed Dec 29 21:07:33 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 29 21:07:43.225221 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08d677-4205-4faf-b8ae-05f39c65bfc0 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:43.225768 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08d677-4205-4faf-b8ae-05f39c65bfc0 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:43.225964 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08d677-4205-4faf-b8ae-05f39c65bfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:43.250221 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-aa08d677-4205-4faf-b8ae-05f39c65bfc0 None None] MFA Rules not processed for user `f39c796fca024d12ae6c6c7c4c0b1980`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:07:43.251481 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-aa08d677-4205-4faf-b8ae-05f39c65bfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:07:43.257714 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1421/2839] 10.222.0.37 () {58 vars in 957 bytes} [Wed Dec 29 21:07:43 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:07:43.355370 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f07bb-da95-408b-98a0-fa653d5aef30 service swift] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:07:43.365911 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f07bb-da95-408b-98a0-fa653d5aef30 service swift] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:07:43.369154 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a299830-7104-4010-897d-8e9e62137fd0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1976a528ee24585bcaccc83e308fec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:07:43.369730 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a299830-7104-4010-897d-8e9e62137fd0 service glance] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:43.370014 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a299830-7104-4010-897d-8e9e62137fd0 service glance] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:43.370496 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a299830-7104-4010-897d-8e9e62137fd0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:43.372325 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-2a299830-7104-4010-897d-8e9e62137fd0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:07:43.485976 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a299830-7104-4010-897d-8e9e62137fd0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:07:43.516672 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a299830-7104-4010-897d-8e9e62137fd0 service glance] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:07:43.528370 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1419/2840] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:07:43 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:07:43.896037 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08d677-4205-4faf-b8ae-05f39c65bfc0 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:07:43.965809 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08d677-4205-4faf-b8ae-05f39c65bfc0 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:07:43.971420 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0a562-d32e-43a2-b9ff-238ff2e00c84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:07:43.972024 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0a562-d32e-43a2-b9ff-238ff2e00c84 service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:43.972337 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0a562-d32e-43a2-b9ff-238ff2e00c84 service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:43.972790 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0a562-d32e-43a2-b9ff-238ff2e00c84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:43.975368 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-1ac0a562-d32e-43a2-b9ff-238ff2e00c84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:07:43.993131 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0a562-d32e-43a2-b9ff-238ff2e00c84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:07:44.019374 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0a562-d32e-43a2-b9ff-238ff2e00c84 service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:07:44.028767 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1422/2841] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:07:43 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:07:44.606808 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a299830-7104-4010-897d-8e9e62137fd0 service glance] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:07:44.609113 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-2a299830-7104-4010-897d-8e9e62137fd0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:07:44.629090 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a299830-7104-4010-897d-8e9e62137fd0 service glance] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:07:44.645969 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71e4d7-c6db-443e-86d4-5d1f6aa28a60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:07:44.646946 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71e4d7-c6db-443e-86d4-5d1f6aa28a60 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:44.648173 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71e4d7-c6db-443e-86d4-5d1f6aa28a60 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:44.648844 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71e4d7-c6db-443e-86d4-5d1f6aa28a60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:44.655254 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-3f71e4d7-c6db-443e-86d4-5d1f6aa28a60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:07:44.682604 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f71e4d7-c6db-443e-86d4-5d1f6aa28a60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:07:44.711955 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f71e4d7-c6db-443e-86d4-5d1f6aa28a60 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:07:44.724209 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1420/2842] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:07:44 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:07:46.101357 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959a173-3d67-43f9-8a4d-0130fb2d47e7 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:46.101859 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959a173-3d67-43f9-8a4d-0130fb2d47e7 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:46.101956 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959a173-3d67-43f9-8a4d-0130fb2d47e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:46.125772 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-e959a173-3d67-43f9-8a4d-0130fb2d47e7 None None] MFA Rules not processed for user `1959af22edbf47cd8afca70831d476c0`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:07:46.126969 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-e959a173-3d67-43f9-8a4d-0130fb2d47e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:07:46.133359 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1423/2843] 10.222.0.37 () {58 vars in 1014 bytes} [Wed Dec 29 21:07:46 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:07:46.147997 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71e4d7-c6db-443e-86d4-5d1f6aa28a60 service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:07:46.161940 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71e4d7-c6db-443e-86d4-5d1f6aa28a60 service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:07:46.168239 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb73d5f-4db8-4da0-a923-4e47825525f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd2861e377640c9b76d0dfb08cf088e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:07:46.168823 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb73d5f-4db8-4da0-a923-4e47825525f1 service swift] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:07:46.169105 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb73d5f-4db8-4da0-a923-4e47825525f1 service swift] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:07:46.169619 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb73d5f-4db8-4da0-a923-4e47825525f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:07:46.179003 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb73d5f-4db8-4da0-a923-4e47825525f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:07:46.205317 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb73d5f-4db8-4da0-a923-4e47825525f1 service swift] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:07:46.214976 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1421/2844] 10.222.0.37 () {60 vars in 1384 bytes} [Wed Dec 29 21:07:46 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 29 21:08:20.164033 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959a173-3d67-43f9-8a4d-0130fb2d47e7 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:08:20.174857 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959a173-3d67-43f9-8a4d-0130fb2d47e7 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:08:20.178180 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ad178-b6b3-4383-aba9-1630587f5a9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:08:20.178792 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ad178-b6b3-4383-aba9-1630587f5a9e service neutron] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:08:20.179081 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ad178-b6b3-4383-aba9-1630587f5a9e service neutron] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:08:20.179366 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ad178-b6b3-4383-aba9-1630587f5a9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:08:20.188203 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ad178-b6b3-4383-aba9-1630587f5a9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:08:20.213280 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ad178-b6b3-4383-aba9-1630587f5a9e service neutron] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:08:20.222923 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1424/2845] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:08:20 2021] GET /identity/v3/auth/tokens => generated 3757 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:08:21.748980 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb73d5f-4db8-4da0-a923-4e47825525f1 service swift] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:08:21.757877 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb73d5f-4db8-4da0-a923-4e47825525f1 service swift] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:08:21.761865 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603bcfc-2d1e-4b49-83ad-5d13cba29431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d700adb7db4848a97bab6cf4105481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:08:21.762539 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603bcfc-2d1e-4b49-83ad-5d13cba29431 service neutron] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:08:21.762922 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603bcfc-2d1e-4b49-83ad-5d13cba29431 service neutron] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:08:21.763128 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603bcfc-2d1e-4b49-83ad-5d13cba29431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:08:21.765456 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-d603bcfc-2d1e-4b49-83ad-5d13cba29431 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:08:21.775118 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603bcfc-2d1e-4b49-83ad-5d13cba29431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:08:21.800805 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603bcfc-2d1e-4b49-83ad-5d13cba29431 service neutron] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:08:21.809080 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1422/2846] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:08:21 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:10:27.094018 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ad178-b6b3-4383-aba9-1630587f5a9e service neutron] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:10:27.095442 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-ff2ad178-b6b3-4383-aba9-1630587f5a9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:10:27.168529 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ad178-b6b3-4383-aba9-1630587f5a9e service neutron] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:10:27.173566 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd624d-360a-4df5-9f36-56c33067c3fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25cb71bb64a3456fb2dc02095c487d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:10:27.174141 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd624d-360a-4df5-9f36-56c33067c3fe service placement] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:10:27.174431 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd624d-360a-4df5-9f36-56c33067c3fe service placement] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:10:27.174742 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd624d-360a-4df5-9f36-56c33067c3fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:10:27.176346 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-5acd624d-360a-4df5-9f36-56c33067c3fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:10:27.186784 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd624d-360a-4df5-9f36-56c33067c3fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:10:27.212148 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd624d-360a-4df5-9f36-56c33067c3fe service placement] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:10:27.221864 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1425/2847] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:10:27 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 29 21:10:39.868314 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603bcfc-2d1e-4b49-83ad-5d13cba29431 service neutron] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:10:39.881869 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603bcfc-2d1e-4b49-83ad-5d13cba29431 service neutron] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:10:39.891476 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cb561-a68f-4044-9cd5-803465a9eaa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51ef7e54d97a4320bda0c1926d190d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:10:39.892770 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cb561-a68f-4044-9cd5-803465a9eaa8 service nova] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:10:39.893395 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cb561-a68f-4044-9cd5-803465a9eaa8 service nova] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:10:39.894058 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cb561-a68f-4044-9cd5-803465a9eaa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:10:39.899309 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-d17cb561-a68f-4044-9cd5-803465a9eaa8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:10:39.920913 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17cb561-a68f-4044-9cd5-803465a9eaa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:10:39.963834 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17cb561-a68f-4044-9cd5-803465a9eaa8 service nova] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:10:39.976663 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1423/2848] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:10:39 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 29 21:10:50.512747 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78dd30-fc45-4b55-b4da-6fc9dcb9bbe9 None None] REQUEST_METHOD: `POST` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:10:50.513222 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78dd30-fc45-4b55-b4da-6fc9dcb9bbe9 None None] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:10:50.513335 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78dd30-fc45-4b55-b4da-6fc9dcb9bbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:10:50.581298 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.auth.core [None req-2e78dd30-fc45-4b55-b4da-6fc9dcb9bbe9 None None] MFA Rules not processed for user `1959af22edbf47cd8afca70831d476c0`. Rule list: `[]` (Enabled: `True`). {{(pid=66051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 29 21:10:50.582485 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-2e78dd30-fc45-4b55-b4da-6fc9dcb9bbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:10:50.599785 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1426/2849] 10.222.0.37 () {58 vars in 967 bytes} [Wed Dec 29 21:10:50 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 29 21:10:50.638475 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cb561-a68f-4044-9cd5-803465a9eaa8 service nova] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:10:50.662895 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cb561-a68f-4044-9cd5-803465a9eaa8 service nova] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:10:50.667483 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b399854-51ea-4a7d-a115-59f1dbf431eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd2861e377640c9b76d0dfb08cf088e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:10:50.668053 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b399854-51ea-4a7d-a115-59f1dbf431eb service swift] REQUEST_METHOD: `GET` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:10:50.668345 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b399854-51ea-4a7d-a115-59f1dbf431eb service swift] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:10:50.668631 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b399854-51ea-4a7d-a115-59f1dbf431eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:10:50.677662 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b399854-51ea-4a7d-a115-59f1dbf431eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:10:50.704008 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b399854-51ea-4a7d-a115-59f1dbf431eb service swift] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:10:50.712452 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1424/2850] 10.222.0.37 () {60 vars in 1384 bytes} [Wed Dec 29 21:10:50 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 29 21:11:01.805565 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78dd30-fc45-4b55-b4da-6fc9dcb9bbe9 None None] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:11:01.873655 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78dd30-fc45-4b55-b4da-6fc9dcb9bbe9 None None] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:11:01.878472 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a64f04-fb77-47ad-8ef0-4ffd69f5a160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:11:01.879287 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a64f04-fb77-47ad-8ef0-4ffd69f5a160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:11:01.879568 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a64f04-fb77-47ad-8ef0-4ffd69f5a160 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:11:01.879846 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a64f04-fb77-47ad-8ef0-4ffd69f5a160 admin admin] PATH_INFO: `/v3/users/f39c796fca024d12ae6c6c7c4c0b1980` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:11:01.880920 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a64f04-fb77-47ad-8ef0-4ffd69f5a160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f39c796fca024d12ae6c6c7c4c0b1980)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:11:01.906643 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a64f04-fb77-47ad-8ef0-4ffd69f5a160 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:11:01.954175 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-23a64f04-fb77-47ad-8ef0-4ffd69f5a160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f39c796fca024d12ae6c6c7c4c0b1980'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:11:01.965471 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-23a64f04-fb77-47ad-8ef0-4ffd69f5a160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f39c796fca024d12ae6c6c7c4c0b1980'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:11:01.966083 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-23a64f04-fb77-47ad-8ef0-4ffd69f5a160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f39c796fca024d12ae6c6c7c4c0b1980'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:11:01.973683 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-23a64f04-fb77-47ad-8ef0-4ffd69f5a160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f39c796fca024d12ae6c6c7c4c0b1980'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:11:01.979841 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-23a64f04-fb77-47ad-8ef0-4ffd69f5a160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f39c796fca024d12ae6c6c7c4c0b1980'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:11:01.985742 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1427/2851] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 21:11:01 2021] DELETE /identity/v3/users/f39c796fca024d12ae6c6c7c4c0b1980 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:11:02.287807 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b399854-51ea-4a7d-a115-59f1dbf431eb service swift] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:11:02.297599 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b399854-51ea-4a7d-a115-59f1dbf431eb service swift] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:11:02.359758 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ba9ff-f883-43ea-a16b-c568f95efc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:11:02.360540 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ba9ff-f883-43ea-a16b-c568f95efc5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:11:02.360829 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ba9ff-f883-43ea-a16b-c568f95efc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:11:02.361211 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ba9ff-f883-43ea-a16b-c568f95efc5f admin admin] PATH_INFO: `/v3/projects/aaeebc5bdfd54075a4cb9417e98320c5` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:11:02.362844 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ba9ff-f883-43ea-a16b-c568f95efc5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaeebc5bdfd54075a4cb9417e98320c5)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:11:02.388361 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ba9ff-f883-43ea-a16b-c568f95efc5f admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:11:02.435405 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-762ba9ff-f883-43ea-a16b-c568f95efc5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaeebc5bdfd54075a4cb9417e98320c5', 'request_id': 'req-762ba9ff-f883-43ea-a16b-c568f95efc5f'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:11:02.442205 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-762ba9ff-f883-43ea-a16b-c568f95efc5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaeebc5bdfd54075a4cb9417e98320c5', 'request_id': 'req-762ba9ff-f883-43ea-a16b-c568f95efc5f'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:11:02.447163 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-762ba9ff-f883-43ea-a16b-c568f95efc5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaeebc5bdfd54075a4cb9417e98320c5', 'request_id': 'req-762ba9ff-f883-43ea-a16b-c568f95efc5f'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:11:02.463540 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-762ba9ff-f883-43ea-a16b-c568f95efc5f admin admin] The token cache is being invalidate because project aaeebc5bdfd54075a4cb9417e98320c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 21:11:02.463820 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-762ba9ff-f883-43ea-a16b-c568f95efc5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:11:02.464405 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-762ba9ff-f883-43ea-a16b-c568f95efc5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:11:02.465771 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1425/2852] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 21:11:02 2021] DELETE /identity/v3/projects/aaeebc5bdfd54075a4cb9417e98320c5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:11:02.469695 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a64f04-fb77-47ad-8ef0-4ffd69f5a160 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:11:02.471833 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-23a64f04-fb77-47ad-8ef0-4ffd69f5a160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:11:02.484059 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a64f04-fb77-47ad-8ef0-4ffd69f5a160 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:11:02.547144 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd404a07-50fd-4dca-bf88-70cec25ed9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:11:02.547950 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd404a07-50fd-4dca-bf88-70cec25ed9c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:11:02.548244 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd404a07-50fd-4dca-bf88-70cec25ed9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:11:02.548526 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd404a07-50fd-4dca-bf88-70cec25ed9c1 admin admin] PATH_INFO: `/v3/users/634a331ade7045f388f347b43605f4e5` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:11:02.549738 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd404a07-50fd-4dca-bf88-70cec25ed9c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=634a331ade7045f388f347b43605f4e5)` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:11:02.575478 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd404a07-50fd-4dca-bf88-70cec25ed9c1 admin admin] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:11:02.626257 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-dd404a07-50fd-4dca-bf88-70cec25ed9c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '634a331ade7045f388f347b43605f4e5'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:11:02.639000 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-dd404a07-50fd-4dca-bf88-70cec25ed9c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '634a331ade7045f388f347b43605f4e5'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:11:02.639616 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-dd404a07-50fd-4dca-bf88-70cec25ed9c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '634a331ade7045f388f347b43605f4e5'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:11:02.647299 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-dd404a07-50fd-4dca-bf88-70cec25ed9c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '634a331ade7045f388f347b43605f4e5'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:11:02.654214 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.notifications [None req-dd404a07-50fd-4dca-bf88-70cec25ed9c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '634a331ade7045f388f347b43605f4e5'} {{(pid=66051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:11:02.660198 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1428/2853] 10.222.0.37 () {58 vars in 1223 bytes} [Wed Dec 29 21:11:02 2021] DELETE /identity/v3/users/634a331ade7045f388f347b43605f4e5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 29 21:11:02.872908 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ba9ff-f883-43ea-a16b-c568f95efc5f admin admin] Authenticating user token {{(pid=66050) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:11:02.874354 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.fernet_utils [None req-762ba9ff-f883-43ea-a16b-c568f95efc5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66050) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:11:02.886525 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ba9ff-f883-43ea-a16b-c568f95efc5f admin admin] Validating token access rules against request {{(pid=66050) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:11:02.951522 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11022ed7-3e9e-4072-86e6-a8d373382866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36a939159da4f1da66be9e4aad8ddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d612e74acbd4ec5ba77fbe2eb639fcf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66050) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:11:02.952315 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11022ed7-3e9e-4072-86e6-a8d373382866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:11:02.952601 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11022ed7-3e9e-4072-86e6-a8d373382866 admin admin] SCRIPT_NAME: `/identity` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:11:02.952883 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11022ed7-3e9e-4072-86e6-a8d373382866 admin admin] PATH_INFO: `/v3/projects/c802e57ed8264652bbef931908aebf69` {{(pid=66050) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:11:02.953958 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11022ed7-3e9e-4072-86e6-a8d373382866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c802e57ed8264652bbef931908aebf69)` {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:11:02.980317 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11022ed7-3e9e-4072-86e6-a8d373382866 admin admin] RBAC: Authorization granted {{(pid=66050) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:11:03.029722 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-11022ed7-3e9e-4072-86e6-a8d373382866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c802e57ed8264652bbef931908aebf69', 'request_id': 'req-11022ed7-3e9e-4072-86e6-a8d373382866'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:11:03.036291 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-11022ed7-3e9e-4072-86e6-a8d373382866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c802e57ed8264652bbef931908aebf69', 'request_id': 'req-11022ed7-3e9e-4072-86e6-a8d373382866'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:11:03.041208 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-11022ed7-3e9e-4072-86e6-a8d373382866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c802e57ed8264652bbef931908aebf69', 'request_id': 'req-11022ed7-3e9e-4072-86e6-a8d373382866'} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:11:03.057052 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-11022ed7-3e9e-4072-86e6-a8d373382866 admin admin] The token cache is being invalidate because project c802e57ed8264652bbef931908aebf69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66050) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 29 21:11:03.057343 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-11022ed7-3e9e-4072-86e6-a8d373382866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:11:03.057931 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: DEBUG keystone.notifications [None req-11022ed7-3e9e-4072-86e6-a8d373382866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66050) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 29 21:11:03.059344 dv-cinder-823170-1-iscsi devstack@keystone.service[66050]: [pid: 66050|app: 0|req: 1426/2854] 10.222.0.37 () {58 vars in 1232 bytes} [Wed Dec 29 21:11:02 2021] DELETE /identity/v3/projects/c802e57ed8264652bbef931908aebf69 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 29 21:15:33.085362 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd404a07-50fd-4dca-bf88-70cec25ed9c1 admin admin] Authenticating user token {{(pid=66051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 29 21:15:33.086693 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-dd404a07-50fd-4dca-bf88-70cec25ed9c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:15:33.237940 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd404a07-50fd-4dca-bf88-70cec25ed9c1 admin admin] Validating token access rules against request {{(pid=66051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 29 21:15:33.299741 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef7bfa-ff8f-4d71-b556-bde06f67b86a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25cb71bb64a3456fb2dc02095c487d4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed634cf9bb9146f7a9738325a8638b70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 29 21:15:33.300314 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef7bfa-ff8f-4d71-b556-bde06f67b86a service placement] REQUEST_METHOD: `GET` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 29 21:15:33.300601 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef7bfa-ff8f-4d71-b556-bde06f67b86a service placement] SCRIPT_NAME: `/identity` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 29 21:15:33.300882 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef7bfa-ff8f-4d71-b556-bde06f67b86a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 29 21:15:33.302549 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.fernet_utils [None req-c4ef7bfa-ff8f-4d71-b556-bde06f67b86a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 29 21:15:33.313369 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef7bfa-ff8f-4d71-b556-bde06f67b86a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 29 21:15:33.338755 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef7bfa-ff8f-4d71-b556-bde06f67b86a service placement] RBAC: Authorization granted {{(pid=66051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 29 21:15:33.348917 dv-cinder-823170-1-iscsi devstack@keystone.service[66051]: [pid: 66051|app: 0|req: 1429/2855] 10.222.0.37 () {60 vars in 1365 bytes} [Wed Dec 29 21:15:33 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)